-- Logs begin at Wed 2022-09-14 11:10:55 UTC, end at Wed 2022-09-14 12:27:07 UTC. -- Sep 14 11:46:18.688162 dv-cinder-844962-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 14 11:46:18.697031 dv-cinder-844962-2-smb devstack@keystone.service[81545]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 11:46:18 2022] *** Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: nodename: dv-cinder-844962-2-smb Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: machine: x86_64 Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: clock source: unix Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: pcre jit disabled Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: detected number of CPU cores: 4 Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: current working directory: / Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: detected binary path: /usr/bin/uwsgi-core Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: your processes number limit is 47680 Sep 14 11:46:18.699027 dv-cinder-844962-2-smb devstack@keystone.service[81545]: your memory page size is 4096 bytes Sep 14 11:46:18.699676 dv-cinder-844962-2-smb devstack@keystone.service[81545]: detected max file descriptor number: 2048 Sep 14 11:46:18.699676 dv-cinder-844962-2-smb devstack@keystone.service[81545]: lock engine: pthread robust mutexes Sep 14 11:46:18.699676 dv-cinder-844962-2-smb devstack@keystone.service[81545]: thunder lock: enabled Sep 14 11:46:18.699676 dv-cinder-844962-2-smb devstack@keystone.service[81545]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 14 11:46:18.699676 dv-cinder-844962-2-smb devstack@keystone.service[81545]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 11:46:18.739625 dv-cinder-844962-2-smb devstack@keystone.service[81545]: Python main interpreter initialized at 0x55e9dc75b9c0 Sep 14 11:46:18.739625 dv-cinder-844962-2-smb devstack@keystone.service[81545]: python threads support enabled Sep 14 11:46:18.739625 dv-cinder-844962-2-smb devstack@keystone.service[81545]: your server socket listen backlog is limited to 100 connections Sep 14 11:46:18.739625 dv-cinder-844962-2-smb devstack@keystone.service[81545]: your mercy for graceful operations on workers is 90 seconds Sep 14 11:46:18.740012 dv-cinder-844962-2-smb devstack@keystone.service[81545]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 11:46:18.740124 dv-cinder-844962-2-smb devstack@keystone.service[81545]: *** Operational MODE: preforking *** Sep 14 11:46:18.740394 dv-cinder-844962-2-smb devstack@keystone.service[81545]: *** uWSGI is running in multiple interpreter mode *** Sep 14 11:46:18.740394 dv-cinder-844962-2-smb devstack@keystone.service[81545]: spawned uWSGI master process (pid: 81545) Sep 14 11:46:18.740590 dv-cinder-844962-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 14 11:46:18.741558 dv-cinder-844962-2-smb devstack@keystone.service[81545]: spawned uWSGI worker 1 (pid: 81556, cores: 1) Sep 14 11:46:18.741558 dv-cinder-844962-2-smb devstack@keystone.service[81545]: spawned uWSGI worker 2 (pid: 81557, cores: 1) Sep 14 11:46:18.742137 dv-cinder-844962-2-smb devstack@keystone.service[81545]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 11:46:23.057099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 11:46:23.057099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: from cryptography.utils import int_from_bytes Sep 14 11:46:23.057888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 11:46:23.057888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: from cryptography.utils import int_from_bytes Sep 14 11:46:23.061022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 11:46:23.061022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: from cryptography.utils import int_from_bytes Sep 14 11:46:23.062091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 11:46:23.062091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: from cryptography.utils import int_from_bytes Sep 14 11:46:23.109874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 11:46:23.110065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 11:46:23.110292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] command line args: [] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 11:46:23.110597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 11:46:23.110775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ================================================================================ {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 11:46:23.111028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] admin_token = **** {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.111271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] config_dir = [] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.111455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.111634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] config_source = [] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.111812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] debug = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.112032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.113160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.113160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.113160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.113470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.113591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] list_limit = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.113665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] log_config_append = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.113841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.114049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] log_dir = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.114282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] log_file = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.114526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.114776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.115030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.115278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.115456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.115630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.115874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.116120 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.116354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.116589 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.116824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.116943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 11:46:23.117064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.117176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 11:46:23.117286 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.117501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] command line args: [] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 11:46:23.117623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.117791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.117995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 11:46:23.118314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.118446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ================================================================================ {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 11:46:23.118567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] publish_errors = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.118718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.118831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] admin_token = **** {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.118947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.119111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.119279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] config_dir = [] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.119394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.119575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.119853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.119980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] standard_threads = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.120102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] config_source = [] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.120221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.120339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.120455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] debug = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.120573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.120690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] use_journal = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.120809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.120952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] use_json = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.121066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.121185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] use_stderr = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.121297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.121420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] use_syslog = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.121420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.121644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.121774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.121887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.122003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.122122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] list_limit = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.122122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] log_config_append = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.122370 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.122483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.122593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.122703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] log_dir = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.122824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.122942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] log_file = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.123053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.123169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.123287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.123438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.123595 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.123726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.123843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.124553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.124553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.124835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.124954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.125073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.125251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.125367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.125367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.125621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.125742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.125854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.125965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.126075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.126196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.126357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.126471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.126588 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.126732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.126853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.126973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.127090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.127207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.127324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.127442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.127442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.127739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.127853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.127963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] publish_errors = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.128085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.128197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.128308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.128418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.128418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.128632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.128751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.128863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.128974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.129084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.129195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] standard_threads = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.129311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.129433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.129545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.129656 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.129778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.129890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.130001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.130119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] use_journal = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.130258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.130376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] use_json = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.130376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] use_stderr = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.130591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.130702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] use_syslog = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.130824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.130937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 11:46:23.131047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.131163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.131330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.131587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.131747 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.131747 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.131957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.131957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.132164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.132164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.132385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.132502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.132612 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.132724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.132833 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.132943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.133124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.133237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.133347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.133459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.133570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.133686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.133807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.133918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.134029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.134144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.134279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.134403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.134523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.134635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.134746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.134864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.134975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.135086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.135204 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.135316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.135432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.135550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.135661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.135771 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.135890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.136002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.136112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.136231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.136348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.136460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.136652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.136796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.136796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.137052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.137199 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.137419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.137551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.137717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.137882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.138020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.138186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.138354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.138493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.138608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.138720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.138834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.138952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.139077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.139200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.139320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.139320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.139540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.139540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.141207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.141361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.141500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.141627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.141751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.141910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.142025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.142140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.142335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.142335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.142537 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.142692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.142810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.142810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.142999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.142999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.143179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.143275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.143369 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.143509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.143621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.143725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.143823 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.143918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144026 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144407 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.144999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.145094 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.145188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.145290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.145394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.145492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.145587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.145688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.145785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.145887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.145985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.146086 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.146182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.146300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.146399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.146889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.146998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.146998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.147196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.147312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.147435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.147560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.147685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.147813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.147929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.148045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.148168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.148285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.148400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.148524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.148640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.148755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.148870 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.149026 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.149143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.149272 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.149391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.149507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.149622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.149737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] auth.external = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.149851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.149974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.150091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.150255 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.150375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.150491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.150606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.150735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] auth.password = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.150852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.150967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] auth.token = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.151088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.151210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.151326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.151456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.151573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.151688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.151835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.151951 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.152066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.152190 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.152307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.152423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.152538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.152654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.152768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.152891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] credential.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.153006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.153121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.153242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.153358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.153473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.153596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.153713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.153828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.153949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.154092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.154233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.154352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.154480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.154607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.154724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.154840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.154955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.155071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.155186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.155327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.155446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.155562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.155678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.155795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.155910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.156033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.156151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.156266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.156388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.156511 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.156627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.156756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] federation.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.156874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.156989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.157105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.157220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.157366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.157495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.157612 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.157742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.157742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.157962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.158076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.158192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.158333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.158449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.158565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.158680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.158808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.158927 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] auth.external = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.159043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.159159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.159337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.159337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.159586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.159704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.159820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.159935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.160051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] auth.password = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.160166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.160365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] auth.token = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.160484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.160600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.160715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.160830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.160946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.161074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.161192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.161311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.161426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.161541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.161657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.161780 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.161897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.162012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.162135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.162266 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] credential.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.162383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.162511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.162629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.162751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.162869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.162984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.163106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.163259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.163361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.163458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.163579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.163698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.163813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.163937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.164054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.164171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.164286 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.164402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.164517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.164517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.164744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.164875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.165000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.165122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.165239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.165363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.165480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.165602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.165718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.165833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.165949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.166072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.166189 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] federation.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.166356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.166473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.166588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.166703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.166831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.166948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.167064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.167179 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.167294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.167410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.167533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.167650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.167766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.167881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.167997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.168120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.168237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.168353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.168758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.168874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.168990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.168990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.169222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.169338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.169461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.169577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.169692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.169692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.169919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.170034 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.170149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.170280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.170397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.170526 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.170650 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.170766 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.171384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.171506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.171622 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.171747 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.171864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.171978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.172094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.172208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.172323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.172450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.172568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.172691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.172836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.172836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.173969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.174147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.175572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.175572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.175744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.175818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.175818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.175961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.176930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177337 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.177880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.178008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.178078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.178231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.178439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.178519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] resource.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.178713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.178921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.179012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.179188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.179415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.179501 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.179676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.179914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.179994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.180160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.180385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.180463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.180625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.180859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] role.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.180937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.181108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] role.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.181317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.181396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.181574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.181796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.181883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.182056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.182333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.182421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.182597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.182800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.182905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.183077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.183274 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.183354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.183545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.183759 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.183846 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.184028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.184249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.184327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.184567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.184715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.184987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.185179 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.185258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.185459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.185636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.185714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.185942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.186261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.186393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.187163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.187425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.187548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.187678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.187908 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.188029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.188145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.188384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.188504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.188630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.188870 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.188990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.189128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.189336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.189458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.189604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.189816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.189943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.190060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.190311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] token.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.190434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.190564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.190772 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.191176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.191298 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.191506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.191627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.191752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.191978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.192097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.192213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.192456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.192574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.192699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.192929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.193049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.193165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.193386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.193511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.193637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.193870 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.193969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.194113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.194378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.194479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.194644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.194843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.194923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.connection = **** {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.195137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.195312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.195390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.195595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.195683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.195836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.195914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.196071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.196150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.196313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.196401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.196549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.196629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.196786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.196865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.197033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.197121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.197271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.197350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.197526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.197606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.197750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.197837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.197996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.198075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.198247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.198330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.198499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.198590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.198733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.198813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.198975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.199054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.199213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.199299 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.199372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81556) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 11:46:23.199504 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.199750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.199994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.200239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.200493 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.200741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.200980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.201223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.201470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] resource.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.201726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.202017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.202283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.202757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.203129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.203374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.203630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.203877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.204122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.204368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] role.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.204620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] role.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.204858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.205114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.205368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.205623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.205877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.206131 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.206409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.206664 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.206917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.207158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.207412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.207665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.207916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.208167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.208593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.208838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.209094 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.209349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.209602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.209854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.210093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.210379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.210639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.210888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.211153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.211392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.211629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.211885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.212145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.212397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.212637 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.212876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.213110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.213348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] token.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.213589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.213841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.214079 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.214378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.214630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.214871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.215119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.215364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.215616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.215858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.216100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.216338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.216589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.216865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.217099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.217372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.217692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.218151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.connection = **** {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.218589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.218854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.219104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.219353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 11:46:23.225957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 11:46:23.229147 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.229380 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.229609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.238548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.248491 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.248726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.248954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.258195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.266782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.267012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.282651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.282886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.320924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.327011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.377161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.377395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.379019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.379261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.533101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.533331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.533549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.533662 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.533773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.533905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.534011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.534139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.534261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.534389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.534613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.534832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.559077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.559315 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.559544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.559686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.559783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.559922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.560000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.560149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.560237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.560372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.560452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.560594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.560916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.561151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.571908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.575475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.586993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.587102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.587226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.587307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.587458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.587539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.587688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.587769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.587913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.588001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.588134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.588215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.588354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81556) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.588435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81557) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 11:46:23.605840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.606051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 11:46:23.606425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.606637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 11:46:23.606916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.607187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.607453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.607715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.610051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.610468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 11:46:23.611081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.611456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 11:46:23.611939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.612223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.612500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.612771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.618058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.618372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.618653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.618944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.622396 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.622683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.622961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.623252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.626065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.629011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.629302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.629588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.629874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.630160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.630453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.630730 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.631828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.631968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.631968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.631968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.631968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.633796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.634090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.634403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.634692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.634980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.635248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.635526 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.635806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.636088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.636369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.636644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.654567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.656633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.656904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.660752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.661565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.661856 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.662189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.662347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.662585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.667201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.667493 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.667898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.668569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.668863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.675344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.675468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.675647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.675734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.675945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.676241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.676524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.676807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.677089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.677366 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.679744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.680163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.680455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.680747 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.682884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.683187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.683479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.683769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.693329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.693616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.697490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.700032 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.700314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.700751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.701055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.704469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.705322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.707614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.707912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.708508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.711722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.712024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.712199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.712318 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.719311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.719311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.719311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.719522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.719522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.719777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.720074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.720475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.720765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.721059 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.729198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.729491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.729769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.730041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.736970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.737318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.737616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.737893 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.738163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.738513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.740022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.740462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.743068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.743359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.743647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.743936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.744342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.744940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.746643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.748170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.748451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.752044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.752336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.752638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.752961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.753280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.762275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.762275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.762275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.762275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.762275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.762275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.762772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.765275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.765757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.766135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.766453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.766746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.767030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.767314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.773886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.776816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.779799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.781294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.782794 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.783082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.783162 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.783476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.786103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.789135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.789811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.790600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.791309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.792079 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.792368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.792654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.794199 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.794627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.794921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.795206 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.799501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.800972 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.805219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.805219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.805219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.805402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.805402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.805402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.805402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.810654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81556) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.810949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.811263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.812159 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.812522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.812812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.813089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.813381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.813657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.813745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.813941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.814022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.814242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.814326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.814516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.815005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.815283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81556) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.821501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81557) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 11:46:23.821793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.822126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.822506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.822709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.822984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.823263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.823557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.823836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.824109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.824394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.824667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.824941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.825217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81557) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 11:46:23.850223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e9dc75b9c0 pid: 81556 (default app) Sep 14 11:46:23.853579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf630-3b5a-4e0c-8e23-a1ac6cd86281 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:23.853868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf630-3b5a-4e0c-8e23-a1ac6cd86281 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:23.854144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf630-3b5a-4e0c-8e23-a1ac6cd86281 None None] PATH_INFO: `/v3` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:23.858404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Wed Sep 14 11:46:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:23.861880 dv-cinder-844962-2-smb devstack@keystone.service[81557]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e9dc75b9c0 pid: 81557 (default app) Sep 14 11:46:31.567327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190f52c-bfdb-4165-96fa-24a7555dabee None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:31.567846 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190f52c-bfdb-4165-96fa-24a7555dabee None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:31.567926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190f52c-bfdb-4165-96fa-24a7555dabee None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:31.569176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 2/2] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:46:31.576689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:31.577088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:31.577242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:31.648482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: INFO dbcounter [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] Registered counter for database keystone Sep 14 11:46:31.668535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG oslo_db.sqlalchemy.engines [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 11:46:31.675539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writer thread running {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 11:46:31.861451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG passlib.handlers.bcrypt [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81557) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 11:46:31.861770 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG passlib.handlers.bcrypt [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81557) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 11:46:31.920005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:31.922292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:32.056116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1/3] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 11:46:32.523097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190f52c-bfdb-4165-96fa-24a7555dabee None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:32.594157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: INFO dbcounter [None req-8190f52c-bfdb-4165-96fa-24a7555dabee None None] Registered counter for database keystone Sep 14 11:46:32.615497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG oslo_db.sqlalchemy.engines [None req-8190f52c-bfdb-4165-96fa-24a7555dabee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81556) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 11:46:32.621944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writer thread running {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 11:46:32.740883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190f52c-bfdb-4165-96fa-24a7555dabee None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:32.745160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd5a9e-b8c3-4573-8a62-ef7b853927a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:32.745782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd5a9e-b8c3-4573-8a62-ef7b853927a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:32.746061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd5a9e-b8c3-4573-8a62-ef7b853927a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:32.746353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd5a9e-b8c3-4573-8a62-ef7b853927a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:32.756333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd5a9e-b8c3-4573-8a62-ef7b853927a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:32.809461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d1dd5a9e-b8c3-4573-8a62-ef7b853927a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 11:46:32.809741 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd5a9e-b8c3-4573-8a62-ef7b853927a0 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:32.820043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 3/4] 10.222.0.77 () {58 vars in 1324 bytes} [Wed Sep 14 11:46:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 11:46:32.826022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:32.843801 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce788326-39a6-4bf0-83f8-6cb2992e1864 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:32.848161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f1be-a070-4331-b5ec-9a9ab88af465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:32.849436 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f1be-a070-4331-b5ec-9a9ab88af465 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:32.849714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f1be-a070-4331-b5ec-9a9ab88af465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:32.849981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f1be-a070-4331-b5ec-9a9ab88af465 admin admin] PATH_INFO: `/v3/projects/44214f6312fa43ec8a83e2996bf5a5af` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:32.851460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9f1be-a070-4331-b5ec-9a9ab88af465 admin admin] RBAC: Authorizing `identity:get_project(project_id=44214f6312fa43ec8a83e2996bf5a5af)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:32.904643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bde9f1be-a070-4331-b5ec-9a9ab88af465 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 11:46:32.904985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9f1be-a070-4331-b5ec-9a9ab88af465 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:32.909618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 2/5] 10.222.0.77 () {56 vars in 1207 bytes} [Wed Sep 14 11:46:32 2022] GET /identity/v3/projects/44214f6312fa43ec8a83e2996bf5a5af => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:35.009914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aad6d-dddb-4bdb-a754-85b91a852a49 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:35.010455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aad6d-dddb-4bdb-a754-85b91a852a49 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:35.010536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aad6d-dddb-4bdb-a754-85b91a852a49 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:35.014571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 4/6] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:46:35.020629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48686a7-7ca3-4684-8b34-73d58bec0750 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:35.021001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48686a7-7ca3-4684-8b34-73d58bec0750 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:35.021171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48686a7-7ca3-4684-8b34-73d58bec0750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:35.040728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-e48686a7-7ca3-4684-8b34-73d58bec0750 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:35.042275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e48686a7-7ca3-4684-8b34-73d58bec0750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:35.049942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 3/7] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 11:46:35.319818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aad6d-dddb-4bdb-a754-85b91a852a49 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:35.331843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aad6d-dddb-4bdb-a754-85b91a852a49 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:35.335950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ab1b0-ea63-4a7e-bfd4-08d2c03b3b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:35.336553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ab1b0-ea63-4a7e-bfd4-08d2c03b3b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:35.336832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ab1b0-ea63-4a7e-bfd4-08d2c03b3b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:35.337105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ab1b0-ea63-4a7e-bfd4-08d2c03b3b87 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:35.345240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ab1b0-ea63-4a7e-bfd4-08d2c03b3b87 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:35.347027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ab1b0-ea63-4a7e-bfd4-08d2c03b3b87 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:35.355569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 5/8] 10.222.0.77 () {58 vars in 1324 bytes} [Wed Sep 14 11:46:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 11:46:35.361481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48686a7-7ca3-4684-8b34-73d58bec0750 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:35.370450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48686a7-7ca3-4684-8b34-73d58bec0750 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:35.375307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caad186-20ec-4168-9317-f0abe1d3d5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:35.375922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad186-20ec-4168-9317-f0abe1d3d5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:35.376198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad186-20ec-4168-9317-f0abe1d3d5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:35.376465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad186-20ec-4168-9317-f0abe1d3d5f8 admin admin] PATH_INFO: `/v3/users/4e56bee89b494082b820a81a258feb86` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:35.377771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caad186-20ec-4168-9317-f0abe1d3d5f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=4e56bee89b494082b820a81a258feb86)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:35.379597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caad186-20ec-4168-9317-f0abe1d3d5f8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:35.381095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 4/9] 10.222.0.77 () {56 vars in 1198 bytes} [Wed Sep 14 11:46:35 2022] GET /identity/v3/users/4e56bee89b494082b820a81a258feb86 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:37.598099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c401f5-fe9b-409e-acd8-ff2f0c8e0579 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:37.598724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c401f5-fe9b-409e-acd8-ff2f0c8e0579 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:37.598724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c401f5-fe9b-409e-acd8-ff2f0c8e0579 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:37.599999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 6/10] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:46:37.605220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a4076-244f-4d11-b612-bb1975ee7108 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:37.605664 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a4076-244f-4d11-b612-bb1975ee7108 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:37.605757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a4076-244f-4d11-b612-bb1975ee7108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:37.612753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2948-c2da-4069-bd35-0006c0a1c0d3 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:37.613041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2948-c2da-4069-bd35-0006c0a1c0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:37.613318 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2948-c2da-4069-bd35-0006c0a1c0d3 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:37.614795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 7/11] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:46:37.620164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7956-e643-40fa-9f36-62494410a9e5 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:37.620448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7956-e643-40fa-9f36-62494410a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:37.620717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7956-e643-40fa-9f36-62494410a9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:37.625762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ee2a4076-244f-4d11-b612-bb1975ee7108 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:37.626975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ee2a4076-244f-4d11-b612-bb1975ee7108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:37.662769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG passlib.handlers.bcrypt [None req-3b8c7956-e643-40fa-9f36-62494410a9e5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81556) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 11:46:37.663164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG passlib.handlers.bcrypt [None req-3b8c7956-e643-40fa-9f36-62494410a9e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81556) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 11:46:37.707252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 5/12] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:37.712914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-3b8c7956-e643-40fa-9f36-62494410a9e5 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:37.714524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3b8c7956-e643-40fa-9f36-62494410a9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:37.812813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 8/13] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:46:37.974778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a4076-244f-4d11-b612-bb1975ee7108 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:38.000477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:38.078502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c7956-e643-40fa-9f36-62494410a9e5 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:38.079002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a4076-244f-4d11-b612-bb1975ee7108 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:38.115397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2d221-4a92-42db-9de5-48755135a195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:38.116044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d221-4a92-42db-9de5-48755135a195 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:38.116327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d221-4a92-42db-9de5-48755135a195 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:38.116600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d221-4a92-42db-9de5-48755135a195 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:38.128113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2d221-4a92-42db-9de5-48755135a195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-9fd2d221-4a92-42db-9de5-48755135a195 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:46:38.136954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:46:38.137868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:46:38.138968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 6/14] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:46:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:46:38.143871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2d221-4a92-42db-9de5-48755135a195 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:38.179190 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c7956-e643-40fa-9f36-62494410a9e5 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:38.181439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:38.216443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fd7fa-6b56-423f-8068-21dc5dc515c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:38.217311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fd7fa-6b56-423f-8068-21dc5dc515c3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:38.217604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fd7fa-6b56-423f-8068-21dc5dc515c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:38.217882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fd7fa-6b56-423f-8068-21dc5dc515c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:38.224419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:38.242633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2d221-4a92-42db-9de5-48755135a195 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:38.275392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572b5ff-d2c5-4d9d-8532-17056339eeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:38.275993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b5ff-d2c5-4d9d-8532-17056339eeff None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:38.276268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b5ff-d2c5-4d9d-8532-17056339eeff None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:38.276545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b5ff-d2c5-4d9d-8532-17056339eeff None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:38.277201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572b5ff-d2c5-4d9d-8532-17056339eeff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:38.277493 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572b5ff-d2c5-4d9d-8532-17056339eeff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:38.278900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572b5ff-d2c5-4d9d-8532-17056339eeff None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:38.285766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fd7fa-6b56-423f-8068-21dc5dc515c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:38.287291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fd7fa-6b56-423f-8068-21dc5dc515c3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:38.290312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 7/15] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:46:38.295950 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572b5ff-d2c5-4d9d-8532-17056339eeff None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:38.385593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 9/16] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 11:46:38.391229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fd7fa-6b56-423f-8068-21dc5dc515c3 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:38.393851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:38.394563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572b5ff-d2c5-4d9d-8532-17056339eeff None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:38.427426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cef38-9979-4a2f-9bc9-e89761227aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:38.428055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cef38-9979-4a2f-9bc9-e89761227aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:38.428339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cef38-9979-4a2f-9bc9-e89761227aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:38.428620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cef38-9979-4a2f-9bc9-e89761227aa4 None admin] PATH_INFO: `/v3/users/4e56bee89b494082b820a81a258feb86` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:38.429766 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cef38-9979-4a2f-9bc9-e89761227aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=4e56bee89b494082b820a81a258feb86)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:38.431258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cef38-9979-4a2f-9bc9-e89761227aa4 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:38.432813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 8/17] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:46:38 2022] GET /identity/v3/users/4e56bee89b494082b820a81a258feb86 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:46:38.438837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cef38-9979-4a2f-9bc9-e89761227aa4 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:38.453693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:38.487623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fd7fa-6b56-423f-8068-21dc5dc515c3 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:38.521319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b598b2-3f4f-4ca4-a8f3-fd4c2942ee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:38.522201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b598b2-3f4f-4ca4-a8f3-fd4c2942ee36 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:38.522576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b598b2-3f4f-4ca4-a8f3-fd4c2942ee36 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:38.522860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b598b2-3f4f-4ca4-a8f3-fd4c2942ee36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:38.537383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cef38-9979-4a2f-9bc9-e89761227aa4 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:38.541234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b598b2-3f4f-4ca4-a8f3-fd4c2942ee36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:38.542734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b598b2-3f4f-4ca4-a8f3-fd4c2942ee36 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-83b598b2-3f4f-4ca4-a8f3-fd4c2942ee36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:46:38.561294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:46:38.562679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:46:38.563539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:46:38.563539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:46:38.563539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:46:38.563539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 10/18] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:46:38.568605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b598b2-3f4f-4ca4-a8f3-fd4c2942ee36 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:38.575300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d957726-59f4-4697-b045-85ac12211ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:38.575941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957726-59f4-4697-b045-85ac12211ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:38.576225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957726-59f4-4697-b045-85ac12211ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:38.576500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957726-59f4-4697-b045-85ac12211ea7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:38.577677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d957726-59f4-4697-b045-85ac12211ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:38.579271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d957726-59f4-4697-b045-85ac12211ea7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:38.581052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 9/19] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:46:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:46:38.586477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d957726-59f4-4697-b045-85ac12211ea7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:38.629285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:38.669675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:38.674820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b598b2-3f4f-4ca4-a8f3-fd4c2942ee36 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:38.688597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d957726-59f4-4697-b045-85ac12211ea7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:38.707639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19a2e9-fdcb-4120-bfa8-d1cd3704c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:38.708243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a2e9-fdcb-4120-bfa8-d1cd3704c0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:38.708526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a2e9-fdcb-4120-bfa8-d1cd3704c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:38.708802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a2e9-fdcb-4120-bfa8-d1cd3704c0c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:38.709447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a2e9-fdcb-4120-bfa8-d1cd3704c0c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:38.709749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a2e9-fdcb-4120-bfa8-d1cd3704c0c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:38.711165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a2e9-fdcb-4120-bfa8-d1cd3704c0c3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:38.723129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b3d11-4cd6-4ad2-a7b0-0a28c8cece8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:38.723736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3d11-4cd6-4ad2-a7b0-0a28c8cece8a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:38.724018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3d11-4cd6-4ad2-a7b0-0a28c8cece8a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:38.724290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3d11-4cd6-4ad2-a7b0-0a28c8cece8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:38.725023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b3d11-4cd6-4ad2-a7b0-0a28c8cece8a None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.domain.id=default, user.id=4e56bee89b494082b820a81a258feb86) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:38.725334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b3d11-4cd6-4ad2-a7b0-0a28c8cece8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:38.726827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b3d11-4cd6-4ad2-a7b0-0a28c8cece8a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:38.728657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 11/20] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:46:38.734321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 10/21] 10.222.0.77 () {56 vars in 1322 bytes} [Wed Sep 14 11:46:38 2022] GET /identity/v3/role_assignments?user.id=4e56bee89b494082b820a81a258feb86&scope.domain.id=default&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:46:41.195123 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4605-64ac-4230-99ab-a8949bb2ec7d None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:41.195673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4605-64ac-4230-99ab-a8949bb2ec7d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:41.195673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd4605-64ac-4230-99ab-a8949bb2ec7d None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:41.197282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 12/22] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:41.203041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96d94-b7b9-4591-aa41-1368fc3aa522 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:41.203663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96d94-b7b9-4591-aa41-1368fc3aa522 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:41.203663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96d94-b7b9-4591-aa41-1368fc3aa522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:41.231205 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5ab96d94-b7b9-4591-aa41-1368fc3aa522 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:41.232413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5ab96d94-b7b9-4591-aa41-1368fc3aa522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:41.255831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe533d-7444-4b1b-9987-0d4262a2adb3 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:41.256125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe533d-7444-4b1b-9987-0d4262a2adb3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:41.256374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe533d-7444-4b1b-9987-0d4262a2adb3 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:41.257846 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 13/23] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:41.263092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99a90-564a-4d1e-bbf4-80870ede57ac None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:41.263371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99a90-564a-4d1e-bbf4-80870ede57ac None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:41.263642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99a90-564a-4d1e-bbf4-80870ede57ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:41.292488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c6c99a90-564a-4d1e-bbf4-80870ede57ac None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:41.293686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c6c99a90-564a-4d1e-bbf4-80870ede57ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:41.361462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 11/24] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:46:41.446123 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 14/25] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:46:41.580356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc24512-9317-4433-a354-faa167b947f7 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:41.580665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc24512-9317-4433-a354-faa167b947f7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:41.580901 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc24512-9317-4433-a354-faa167b947f7 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:41.582541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 12/26] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:41.587618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54889b9f-e16a-452f-ba2d-afcf82346449 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:41.587905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54889b9f-e16a-452f-ba2d-afcf82346449 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:41.588184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54889b9f-e16a-452f-ba2d-afcf82346449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:41.614477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-54889b9f-e16a-452f-ba2d-afcf82346449 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:41.615670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-54889b9f-e16a-452f-ba2d-afcf82346449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:41.678445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:41.711326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 15/27] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:41.881741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc24512-9317-4433-a354-faa167b947f7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:41.981132 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:42.009614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54889b9f-e16a-452f-ba2d-afcf82346449 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:42.043094 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc24512-9317-4433-a354-faa167b947f7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:42.113559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6015d6-ae04-4107-bd22-8b6f046b4824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:42.119091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6015d6-ae04-4107-bd22-8b6f046b4824 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:42.119370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6015d6-ae04-4107-bd22-8b6f046b4824 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:42.119828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6015d6-ae04-4107-bd22-8b6f046b4824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:42.140836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6015d6-ae04-4107-bd22-8b6f046b4824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:42.142602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6015d6-ae04-4107-bd22-8b6f046b4824 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:42.173938 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54889b9f-e16a-452f-ba2d-afcf82346449 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-9d6015d6-ae04-4107-bd22-8b6f046b4824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:46:42.177440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:46:42.178307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:46:42.179184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:46:42.179184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:46:42.179184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:46:42.183125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 13/28] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:46:42.184050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6015d6-ae04-4107-bd22-8b6f046b4824 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:42.223317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39ff24-59ea-4088-9a0c-3f6ab3f2ef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:42.224716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39ff24-59ea-4088-9a0c-3f6ab3f2ef83 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:42.225196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39ff24-59ea-4088-9a0c-3f6ab3f2ef83 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:42.225668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39ff24-59ea-4088-9a0c-3f6ab3f2ef83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:42.245651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39ff24-59ea-4088-9a0c-3f6ab3f2ef83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-9d39ff24-59ea-4088-9a0c-3f6ab3f2ef83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:46:42.253350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:46:42.254227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:46:42.254986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:46:42.257385 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 16/29] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:46:42.258415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39ff24-59ea-4088-9a0c-3f6ab3f2ef83 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:42.322752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:42.341734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6015d6-ae04-4107-bd22-8b6f046b4824 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:42.377950 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:42.387366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f790de7-b068-4375-a008-5cb4db127e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:42.388201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790de7-b068-4375-a008-5cb4db127e61 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:42.388626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790de7-b068-4375-a008-5cb4db127e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:42.389055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790de7-b068-4375-a008-5cb4db127e61 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:42.389885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f790de7-b068-4375-a008-5cb4db127e61 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:42.391548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f790de7-b068-4375-a008-5cb4db127e61 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:42.405041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39ff24-59ea-4088-9a0c-3f6ab3f2ef83 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:42.443203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763854a-9423-4eef-8428-4a6c717039f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:42.443849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763854a-9423-4eef-8428-4a6c717039f0 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:42.444126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763854a-9423-4eef-8428-4a6c717039f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:42.444395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763854a-9423-4eef-8428-4a6c717039f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:42.445587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763854a-9423-4eef-8428-4a6c717039f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:42.445587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763854a-9423-4eef-8428-4a6c717039f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:42.446844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763854a-9423-4eef-8428-4a6c717039f0 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:42.463615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 17/30] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:42.463615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763854a-9423-4eef-8428-4a6c717039f0 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:42.572232 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:42.579523 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763854a-9423-4eef-8428-4a6c717039f0 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:42.603338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 14/31] 10.222.0.77 () {60 vars in 1131 bytes} [Wed Sep 14 11:46:42 2022] POST /identity/v3/roles => generated 219 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:46:42.605143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881418-7c5b-4716-9982-97c1be9e990c None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:42.605635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881418-7c5b-4716-9982-97c1be9e990c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:42.606108 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881418-7c5b-4716-9982-97c1be9e990c None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:42.607930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 15/32] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:42.610486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881418-7c5b-4716-9982-97c1be9e990c None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:42.638939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b1cdf-ec31-4db8-91a9-91c1801f4766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:42.640514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b1cdf-ec31-4db8-91a9-91c1801f4766 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:42.641803 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b1cdf-ec31-4db8-91a9-91c1801f4766 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:42.643107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b1cdf-ec31-4db8-91a9-91c1801f4766 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:42.644345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b1cdf-ec31-4db8-91a9-91c1801f4766 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:42.645725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b1cdf-ec31-4db8-91a9-91c1801f4766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:42.647597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b1cdf-ec31-4db8-91a9-91c1801f4766 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:42.676039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 18/33] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:46:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:42.677838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cc8f2-f05e-4e7f-a068-ac6e36ec00a2 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:42.679986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cc8f2-f05e-4e7f-a068-ac6e36ec00a2 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:42.681407 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cc8f2-f05e-4e7f-a068-ac6e36ec00a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:42.723078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9a3cc8f2-f05e-4e7f-a068-ac6e36ec00a2 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:42.724644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9a3cc8f2-f05e-4e7f-a068-ac6e36ec00a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:42.851502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881418-7c5b-4716-9982-97c1be9e990c None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:42.852793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 19/34] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:42.854040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cc8f2-f05e-4e7f-a068-ac6e36ec00a2 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:42.901776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3216dab-aea8-4a89-b9c8-97297a9a96bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:42.902421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3216dab-aea8-4a89-b9c8-97297a9a96bc None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:42.903261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3216dab-aea8-4a89-b9c8-97297a9a96bc None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:42.903700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3216dab-aea8-4a89-b9c8-97297a9a96bc None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:42.904779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3216dab-aea8-4a89-b9c8-97297a9a96bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:42.907210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3216dab-aea8-4a89-b9c8-97297a9a96bc None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:42.983220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:42.996030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cc8f2-f05e-4e7f-a068-ac6e36ec00a2 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:43.013801 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 16/35] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:46:42 2022] POST /identity/v3/projects => generated 301 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:46:43.020352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360c043-b916-4dbe-9118-66955c0ca9df None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.021438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360c043-b916-4dbe-9118-66955c0ca9df None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.021994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360c043-b916-4dbe-9118-66955c0ca9df None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.024375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 17/36] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:43.026344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0889d-fad4-4fe2-8f30-d641f12076bd None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.027037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0889d-fad4-4fe2-8f30-d641f12076bd None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.028021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0889d-fad4-4fe2-8f30-d641f12076bd None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.030040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 18/37] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:43.032518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5df85-1e81-433d-bbc3-d714f71a1fac None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.033111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5df85-1e81-433d-bbc3-d714f71a1fac None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.033673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5df85-1e81-433d-bbc3-d714f71a1fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.036489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee96fc1-0f7c-4f52-a14c-91ee99f37d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:43.037151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee96fc1-0f7c-4f52-a14c-91ee99f37d04 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.037431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee96fc1-0f7c-4f52-a14c-91ee99f37d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.037707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee96fc1-0f7c-4f52-a14c-91ee99f37d04 None admin] PATH_INFO: `/v3/users/4e56bee89b494082b820a81a258feb86` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.039285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee96fc1-0f7c-4f52-a14c-91ee99f37d04 None admin] RBAC: Authorizing `identity:get_user(user_id=4e56bee89b494082b820a81a258feb86)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:43.040837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee96fc1-0f7c-4f52-a14c-91ee99f37d04 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:43.043047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 20/38] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:46:42 2022] GET /identity/v3/users/4e56bee89b494082b820a81a258feb86 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:43.048852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f3e2-d6ef-4d55-ae3a-0ccac26288fb None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.048852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f3e2-d6ef-4d55-ae3a-0ccac26288fb None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.048852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f3e2-d6ef-4d55-ae3a-0ccac26288fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.064965 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-33d5df85-1e81-433d-bbc3-d714f71a1fac None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:43.067598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-33d5df85-1e81-433d-bbc3-d714f71a1fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:43.070728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-0297f3e2-d6ef-4d55-ae3a-0ccac26288fb None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:43.072345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0297f3e2-d6ef-4d55-ae3a-0ccac26288fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:43.112274 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:43.157331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 21/39] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:43.158441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f3e2-d6ef-4d55-ae3a-0ccac26288fb None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:43.165334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 19/40] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:43.211140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5df85-1e81-433d-bbc3-d714f71a1fac None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:43.257417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:43.273224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f3e2-d6ef-4d55-ae3a-0ccac26288fb None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:43.314491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03623c4d-8956-4b69-b7c0-bdb24f3b3f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:43.315726 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03623c4d-8956-4b69-b7c0-bdb24f3b3f94 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.316274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03623c4d-8956-4b69-b7c0-bdb24f3b3f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.316551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03623c4d-8956-4b69-b7c0-bdb24f3b3f94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.318025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03623c4d-8956-4b69-b7c0-bdb24f3b3f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:43.319589 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03623c4d-8956-4b69-b7c0-bdb24f3b3f94 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:43.321155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 22/41] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:46:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:43.327195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03623c4d-8956-4b69-b7c0-bdb24f3b3f94 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:43.333110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5df85-1e81-433d-bbc3-d714f71a1fac None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:43.373448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e294987-b03c-4ac1-9d18-1395fb5cde19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:43.374996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e294987-b03c-4ac1-9d18-1395fb5cde19 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.375502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e294987-b03c-4ac1-9d18-1395fb5cde19 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.375986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e294987-b03c-4ac1-9d18-1395fb5cde19 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.376873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e294987-b03c-4ac1-9d18-1395fb5cde19 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:43.378578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e294987-b03c-4ac1-9d18-1395fb5cde19 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:43.439317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03623c4d-8956-4b69-b7c0-bdb24f3b3f94 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:43.459104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 20/42] 10.222.0.77 () {60 vars in 1131 bytes} [Wed Sep 14 11:46:43 2022] POST /identity/v3/roles => generated 225 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:46:43.460377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e294987-b03c-4ac1-9d18-1395fb5cde19 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:43.476876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e66eee-0fcd-4232-8c0d-230a01f768f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:43.477574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e66eee-0fcd-4232-8c0d-230a01f768f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.477856 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e66eee-0fcd-4232-8c0d-230a01f768f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.478133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e66eee-0fcd-4232-8c0d-230a01f768f4 None admin] PATH_INFO: `/v3/domains/default/users/4e56bee89b494082b820a81a258feb86/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.480358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e66eee-0fcd-4232-8c0d-230a01f768f4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4e56bee89b494082b820a81a258feb86, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:43.481911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e66eee-0fcd-4232-8c0d-230a01f768f4 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:43.609923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:43.647249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 23/43] 10.222.0.77 () {58 vars in 1361 bytes} [Wed Sep 14 11:46:43 2022] PUT /identity/v3/domains/default/users/4e56bee89b494082b820a81a258feb86/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:46:43.648392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e66eee-0fcd-4232-8c0d-230a01f768f4 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:43.670377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:43.705399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e294987-b03c-4ac1-9d18-1395fb5cde19 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:43.753402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf2879-4847-409b-8f76-89e046f73110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:43.754075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf2879-4847-409b-8f76-89e046f73110 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.754444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf2879-4847-409b-8f76-89e046f73110 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.754730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf2879-4847-409b-8f76-89e046f73110 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.755928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf2879-4847-409b-8f76-89e046f73110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:43.757400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf2879-4847-409b-8f76-89e046f73110 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:43.759287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 21/44] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:46:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:43.765044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf2879-4847-409b-8f76-89e046f73110 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:43.797449 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e66eee-0fcd-4232-8c0d-230a01f768f4 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:43.840145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e806d-6265-4484-afd4-ab1533af2013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:43.840771 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e806d-6265-4484-afd4-ab1533af2013 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.841322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e806d-6265-4484-afd4-ab1533af2013 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.841609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e806d-6265-4484-afd4-ab1533af2013 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.842847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e806d-6265-4484-afd4-ab1533af2013 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:43.844444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e806d-6265-4484-afd4-ab1533af2013 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:43.875293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:43.881010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf2879-4847-409b-8f76-89e046f73110 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:43.914726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cfa59-7271-4cb6-bf2d-cd0b11d630c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:43.915338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cfa59-7271-4cb6-bf2d-cd0b11d630c4 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:43.919074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cfa59-7271-4cb6-bf2d-cd0b11d630c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:43.919074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cfa59-7271-4cb6-bf2d-cd0b11d630c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:43.919074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cfa59-7271-4cb6-bf2d-cd0b11d630c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:43.919074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cfa59-7271-4cb6-bf2d-cd0b11d630c4 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:44.010680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 24/45] 10.222.0.77 () {60 vars in 1131 bytes} [Wed Sep 14 11:46:43 2022] POST /identity/v3/roles => generated 223 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:46:44.046243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 22/46] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:46:43 2022] POST /identity/v3/projects => generated 312 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:46:45.829039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886d16a-3b97-45f9-bead-c204b3db1e14 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:45.829542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886d16a-3b97-45f9-bead-c204b3db1e14 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:45.829623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886d16a-3b97-45f9-bead-c204b3db1e14 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:45.831005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 25/47] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:45.836391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7696-c9a8-4d94-89ca-175df86aa458 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:45.836818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7696-c9a8-4d94-89ca-175df86aa458 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:45.836962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7696-c9a8-4d94-89ca-175df86aa458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:45.855025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-76fb7696-c9a8-4d94-89ca-175df86aa458 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:45.856222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-76fb7696-c9a8-4d94-89ca-175df86aa458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:45.923012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 23/48] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:46.192283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886d16a-3b97-45f9-bead-c204b3db1e14 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:46.228695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68b59a-c982-41db-920d-699ea7186e7e None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:46.228983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68b59a-c982-41db-920d-699ea7186e7e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:46.229270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68b59a-c982-41db-920d-699ea7186e7e None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:46.230648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 24/49] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:46:46.236515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb06ec3-5ff6-4390-83c1-4e04e1e433b7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:46.236868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb06ec3-5ff6-4390-83c1-4e04e1e433b7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:46.237148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb06ec3-5ff6-4390-83c1-4e04e1e433b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:46.255071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5fb06ec3-5ff6-4390-83c1-4e04e1e433b7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:46.256261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5fb06ec3-5ff6-4390-83c1-4e04e1e433b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:46.270524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:46.296387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886d16a-3b97-45f9-bead-c204b3db1e14 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:46.323863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 25/50] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:46:46.329124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72887bd9-68ea-4bfb-936f-d188aba8d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:46.329755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887bd9-68ea-4bfb-936f-d188aba8d8fc None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:46.330035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887bd9-68ea-4bfb-936f-d188aba8d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:46.330342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887bd9-68ea-4bfb-936f-d188aba8d8fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:46.340342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72887bd9-68ea-4bfb-936f-d188aba8d8fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-72887bd9-68ea-4bfb-936f-d188aba8d8fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:46:46.345824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:46:46.346818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:46:46.347559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 26/51] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:46:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:46:46.353957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb06ec3-5ff6-4390-83c1-4e04e1e433b7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:46.366307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:46.453511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb06ec3-5ff6-4390-83c1-4e04e1e433b7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:46.485651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d5a36-cc6d-4381-a183-6c475328c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:46.486304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5a36-cc6d-4381-a183-6c475328c06f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:46.486572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5a36-cc6d-4381-a183-6c475328c06f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:46.486842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5a36-cc6d-4381-a183-6c475328c06f None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:46.487501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d5a36-cc6d-4381-a183-6c475328c06f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:46.487802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d5a36-cc6d-4381-a183-6c475328c06f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:46.489167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d5a36-cc6d-4381-a183-6c475328c06f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:46.496901 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 26/52] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:46:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:46.502830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72887bd9-68ea-4bfb-936f-d188aba8d8fc None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:46.591432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d5a36-cc6d-4381-a183-6c475328c06f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:46.603460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72887bd9-68ea-4bfb-936f-d188aba8d8fc None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:46.638031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360e155-6ec8-4dd1-94a2-8f97af541a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:46.638701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360e155-6ec8-4dd1-94a2-8f97af541a5d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:46.638985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360e155-6ec8-4dd1-94a2-8f97af541a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:46.639265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360e155-6ec8-4dd1-94a2-8f97af541a5d None admin] PATH_INFO: `/v3/users/4e56bee89b494082b820a81a258feb86` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:46.640647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360e155-6ec8-4dd1-94a2-8f97af541a5d None admin] RBAC: Authorizing `identity:get_user(user_id=4e56bee89b494082b820a81a258feb86)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:46.642112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360e155-6ec8-4dd1-94a2-8f97af541a5d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:46.643728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 27/53] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:46:46 2022] GET /identity/v3/users/4e56bee89b494082b820a81a258feb86 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:46:46.649019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360e155-6ec8-4dd1-94a2-8f97af541a5d None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:46.651578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:46.669975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:46.703862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d5a36-cc6d-4381-a183-6c475328c06f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:46.741081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945ad1d-d97f-46b5-8582-24fed18fc52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:46.741737 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945ad1d-d97f-46b5-8582-24fed18fc52e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:46.742024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945ad1d-d97f-46b5-8582-24fed18fc52e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:46.742332 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945ad1d-d97f-46b5-8582-24fed18fc52e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:46.743520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945ad1d-d97f-46b5-8582-24fed18fc52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:46.744993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945ad1d-d97f-46b5-8582-24fed18fc52e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:46.746844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 27/54] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:46:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:46:46.752714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945ad1d-d97f-46b5-8582-24fed18fc52e None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:46.852509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945ad1d-d97f-46b5-8582-24fed18fc52e None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:46.856789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360e155-6ec8-4dd1-94a2-8f97af541a5d None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:46.888595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf2c6a-3a65-494c-b8f5-bff99296631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:46.889208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2c6a-3a65-494c-b8f5-bff99296631d None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:46.889517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2c6a-3a65-494c-b8f5-bff99296631d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:46.890021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf2c6a-3a65-494c-b8f5-bff99296631d None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:46.890759 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf2c6a-3a65-494c-b8f5-bff99296631d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:46.891700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbbf74-7020-4b83-a6a3-c0db9b2f3f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:46.892334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbbf74-7020-4b83-a6a3-c0db9b2f3f6a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:46.892436 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf2c6a-3a65-494c-b8f5-bff99296631d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:46.892618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbbf74-7020-4b83-a6a3-c0db9b2f3f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:46.892895 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbbf74-7020-4b83-a6a3-c0db9b2f3f6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:46.894094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbbf74-7020-4b83-a6a3-c0db9b2f3f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:46.895556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbbf74-7020-4b83-a6a3-c0db9b2f3f6a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:46.897163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 28/55] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:46:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:46:46.902415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:46.902862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbbf74-7020-4b83-a6a3-c0db9b2f3f6a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:46.970587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:46.984252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 28/56] 10.222.0.77 () {60 vars in 1140 bytes} [Wed Sep 14 11:46:46 2022] POST /identity/v3/projects => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:46:47.003016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbbf74-7020-4b83-a6a3-c0db9b2f3f6a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:47.038961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba66768-6100-45bf-83b7-dbede8d1826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:47.039591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66768-6100-45bf-83b7-dbede8d1826e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:47.039873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66768-6100-45bf-83b7-dbede8d1826e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:47.040149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66768-6100-45bf-83b7-dbede8d1826e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:47.040899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba66768-6100-45bf-83b7-dbede8d1826e None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.domain.id=default, user.id=4e56bee89b494082b820a81a258feb86) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:47.041210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba66768-6100-45bf-83b7-dbede8d1826e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:47.042793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba66768-6100-45bf-83b7-dbede8d1826e None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:47.052232 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 29/57] 10.222.0.77 () {56 vars in 1322 bytes} [Wed Sep 14 11:46:46 2022] GET /identity/v3/role_assignments?user.id=4e56bee89b494082b820a81a258feb86&scope.domain.id=default&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:46:49.154155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df438d7b-6151-4535-af43-dda0fb97fb6b None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:49.154732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df438d7b-6151-4535-af43-dda0fb97fb6b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:49.154732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df438d7b-6151-4535-af43-dda0fb97fb6b None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:49.156672 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 29/58] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:49.161891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc1cd-a706-42b6-b6ca-389afa49f542 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:49.162277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc1cd-a706-42b6-b6ca-389afa49f542 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:49.162484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc1cd-a706-42b6-b6ca-389afa49f542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:49.180817 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-786bc1cd-a706-42b6-b6ca-389afa49f542 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:49.182360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-786bc1cd-a706-42b6-b6ca-389afa49f542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:49.246486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 30/59] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:49.508967 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df438d7b-6151-4535-af43-dda0fb97fb6b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:49.609277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df438d7b-6151-4535-af43-dda0fb97fb6b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:49.642160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba184cf-d197-4dd6-9838-c3b00a3b897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:49.642819 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba184cf-d197-4dd6-9838-c3b00a3b897b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:49.643100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba184cf-d197-4dd6-9838-c3b00a3b897b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:49.643375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba184cf-d197-4dd6-9838-c3b00a3b897b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:49.644481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba184cf-d197-4dd6-9838-c3b00a3b897b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:49.645950 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba184cf-d197-4dd6-9838-c3b00a3b897b None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:49.647527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 30/60] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:46:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:49.653118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc1cd-a706-42b6-b6ca-389afa49f542 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:49.712266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:49.747974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc1cd-a706-42b6-b6ca-389afa49f542 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:49.780899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679ae33-349c-4e41-bd3f-88f8653010c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:49.781439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ae33-349c-4e41-bd3f-88f8653010c3 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:49.781767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ae33-349c-4e41-bd3f-88f8653010c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:49.782024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679ae33-349c-4e41-bd3f-88f8653010c3 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:49.782689 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679ae33-349c-4e41-bd3f-88f8653010c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:49.784132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679ae33-349c-4e41-bd3f-88f8653010c3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:49.908502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 31/61] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:46:49 2022] POST /identity/v3/users => generated 275 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:46:53.216685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3551-398e-4ada-86a8-079f22fad7ec None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:53.218308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3551-398e-4ada-86a8-079f22fad7ec None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:53.218997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3551-398e-4ada-86a8-079f22fad7ec None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:53.220585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 31/62] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:53.226394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650786d-d6e4-47cc-b9cb-8157c3108f29 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:53.227341 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650786d-d6e4-47cc-b9cb-8157c3108f29 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:53.227761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650786d-d6e4-47cc-b9cb-8157c3108f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:53.251387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9650786d-d6e4-47cc-b9cb-8157c3108f29 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:53.252657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9650786d-d6e4-47cc-b9cb-8157c3108f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:53.357114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 32/63] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:53.365714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85eebb-a3b7-4ec3-b6d9-32600c22f577 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:53.366494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85eebb-a3b7-4ec3-b6d9-32600c22f577 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:53.366983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85eebb-a3b7-4ec3-b6d9-32600c22f577 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:53.368568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 32/64] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:53.377746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601d7e-163c-4c3a-ba6f-f7178b880f49 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:53.382599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601d7e-163c-4c3a-ba6f-f7178b880f49 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:53.382599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601d7e-163c-4c3a-ba6f-f7178b880f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:53.408780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-15601d7e-163c-4c3a-ba6f-f7178b880f49 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:53.409979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-15601d7e-163c-4c3a-ba6f-f7178b880f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:53.478417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:53.502860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 33/65] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:53.539570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f051d5-54e6-4eae-b5a7-a9fed53b3da1 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:53.540198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f051d5-54e6-4eae-b5a7-a9fed53b3da1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:53.540670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f051d5-54e6-4eae-b5a7-a9fed53b3da1 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:53.542305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 33/66] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:53.548118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b14d07-f3bb-4db3-a7ba-925fe8347a1d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:53.548406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b14d07-f3bb-4db3-a7ba-925fe8347a1d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:53.548685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b14d07-f3bb-4db3-a7ba-925fe8347a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:53.576047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-37b14d07-f3bb-4db3-a7ba-925fe8347a1d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:53.577844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-37b14d07-f3bb-4db3-a7ba-925fe8347a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:53.684094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 34/67] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:53.689269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f051d5-54e6-4eae-b5a7-a9fed53b3da1 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:53.788857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:53.832414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b14d07-f3bb-4db3-a7ba-925fe8347a1d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:53.856645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f051d5-54e6-4eae-b5a7-a9fed53b3da1 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:53.908550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43ec3-91a3-4bca-94e8-3edbc30ca17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:53.909569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43ec3-91a3-4bca-94e8-3edbc30ca17c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:53.910045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43ec3-91a3-4bca-94e8-3edbc30ca17c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:53.910540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43ec3-91a3-4bca-94e8-3edbc30ca17c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:53.926645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e43ec3-91a3-4bca-94e8-3edbc30ca17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-55e43ec3-91a3-4bca-94e8-3edbc30ca17c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:46:53.933679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:46:53.934584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:46:53.935338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:46:53.935905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 34/68] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:46:53.938368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e70fa-d562-4352-943b-50027895ef46 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:53.938659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e70fa-d562-4352-943b-50027895ef46 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:53.938937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e70fa-d562-4352-943b-50027895ef46 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:53.940354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 35/69] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:53.945775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e70fa-d562-4352-943b-50027895ef46 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:53.985993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b14d07-f3bb-4db3-a7ba-925fe8347a1d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:53.998168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:54.027059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1fd80-5b54-49e1-afbc-823200ca9cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:54.028062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1fd80-5b54-49e1-afbc-823200ca9cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.028556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1fd80-5b54-49e1-afbc-823200ca9cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.029012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1fd80-5b54-49e1-afbc-823200ca9cb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.040239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1fd80-5b54-49e1-afbc-823200ca9cb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-1cc1fd80-5b54-49e1-afbc-823200ca9cb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:46:54.045027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:46:54.046568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:46:54.047626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 35/70] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:46:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:46:54.048493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bdf25-18ee-4a2a-a858-1ce65964c046 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.048493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bdf25-18ee-4a2a-a858-1ce65964c046 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.048903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bdf25-18ee-4a2a-a858-1ce65964c046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.062571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e70fa-d562-4352-943b-50027895ef46 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:54.066612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-bb1bdf25-18ee-4a2a-a858-1ce65964c046 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:54.067801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-bb1bdf25-18ee-4a2a-a858-1ce65964c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:54.080232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:54.096371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e09f-6ad6-4e6d-aaa7-9cd47b5c553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:54.096988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e09f-6ad6-4e6d-aaa7-9cd47b5c553d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.097275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e09f-6ad6-4e6d-aaa7-9cd47b5c553d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.097555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e09f-6ad6-4e6d-aaa7-9cd47b5c553d None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.098253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e09f-6ad6-4e6d-aaa7-9cd47b5c553d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:54.098562 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e09f-6ad6-4e6d-aaa7-9cd47b5c553d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:54.099956 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e09f-6ad6-4e6d-aaa7-9cd47b5c553d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:54.109394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 36/71] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:46:54.110366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e09f-6ad6-4e6d-aaa7-9cd47b5c553d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:54.134685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 36/72] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:54.136047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817f14-64bb-4adb-b80d-3e6125ff9199 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.136331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817f14-64bb-4adb-b80d-3e6125ff9199 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.136606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817f14-64bb-4adb-b80d-3e6125ff9199 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.137866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 37/73] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:54.138587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf817f14-64bb-4adb-b80d-3e6125ff9199 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:54.238586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e09f-6ad6-4e6d-aaa7-9cd47b5c553d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:54.246953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:54.251430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf817f14-64bb-4adb-b80d-3e6125ff9199 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:54.276652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88ef1a-99c5-40c4-ac8f-8bd64cffd1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:54.277328 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88ef1a-99c5-40c4-ac8f-8bd64cffd1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.277561 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88ef1a-99c5-40c4-ac8f-8bd64cffd1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.277834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88ef1a-99c5-40c4-ac8f-8bd64cffd1f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.286869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc27c3-6069-44b7-9a53-089ef740e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:54.287485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc27c3-6069-44b7-9a53-089ef740e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.287768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc27c3-6069-44b7-9a53-089ef740e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.288036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc27c3-6069-44b7-9a53-089ef740e5e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.288477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88ef1a-99c5-40c4-ac8f-8bd64cffd1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:46:54.288696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc27c3-6069-44b7-9a53-089ef740e5e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:54.289000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc27c3-6069-44b7-9a53-089ef740e5e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:54.290462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc27c3-6069-44b7-9a53-089ef740e5e6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-3a88ef1a-99c5-40c4-ac8f-8bd64cffd1f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:46:54.294236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:46:54.295048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:46:54.296182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 37/74] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:46:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:46:54.297466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88ef1a-99c5-40c4-ac8f-8bd64cffd1f5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:54.302575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 38/75] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:46:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:54.304260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa35e-e2ba-4bd7-a885-5c2a5d1af29b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.304753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa35e-e2ba-4bd7-a885-5c2a5d1af29b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.305321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa35e-e2ba-4bd7-a885-5c2a5d1af29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.328012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-7cafa35e-e2ba-4bd7-a885-5c2a5d1af29b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:54.329247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7cafa35e-e2ba-4bd7-a885-5c2a5d1af29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:54.342716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:54.401980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 39/76] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:54.403140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafa35e-e2ba-4bd7-a885-5c2a5d1af29b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:54.403630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88ef1a-99c5-40c4-ac8f-8bd64cffd1f5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:54.438036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16a5a-90fd-4ff1-9f1c-cf33a07de7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:54.438953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16a5a-90fd-4ff1-9f1c-cf33a07de7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.439384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16a5a-90fd-4ff1-9f1c-cf33a07de7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.439657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16a5a-90fd-4ff1-9f1c-cf33a07de7c2 None admin] PATH_INFO: `/v3/users/4e56bee89b494082b820a81a258feb86` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.441096 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e16a5a-90fd-4ff1-9f1c-cf33a07de7c2 None admin] RBAC: Authorizing `identity:get_user(user_id=4e56bee89b494082b820a81a258feb86)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:54.442602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e16a5a-90fd-4ff1-9f1c-cf33a07de7c2 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:54.444177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 38/77] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:46:54 2022] GET /identity/v3/users/4e56bee89b494082b820a81a258feb86 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:54.444941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16a5a-90fd-4ff1-9f1c-cf33a07de7c2 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:54.505775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:54.515544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafa35e-e2ba-4bd7-a885-5c2a5d1af29b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:54.550192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d13609-a63d-4287-9721-1da07268f7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:54.550771 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d13609-a63d-4287-9721-1da07268f7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.551071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d13609-a63d-4287-9721-1da07268f7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.551324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d13609-a63d-4287-9721-1da07268f7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.552000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d13609-a63d-4287-9721-1da07268f7f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:54.552312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d13609-a63d-4287-9721-1da07268f7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:54.553687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d13609-a63d-4287-9721-1da07268f7f0 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:54.561543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16a5a-90fd-4ff1-9f1c-cf33a07de7c2 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:54.567131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 40/78] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:46:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:54.567131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d13609-a63d-4287-9721-1da07268f7f0 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:54.576177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:54.605241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84ad9-380a-4a8d-8bd0-1b98e35bdc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:54.605887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84ad9-380a-4a8d-8bd0-1b98e35bdc64 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.606168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84ad9-380a-4a8d-8bd0-1b98e35bdc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.606516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84ad9-380a-4a8d-8bd0-1b98e35bdc64 None admin] PATH_INFO: `/v3/users/465764cb0a1f478290cb4e10c56c3094` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.628050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a84ad9-380a-4a8d-8bd0-1b98e35bdc64 None admin] RBAC: Authorizing `identity:get_user(user_id=465764cb0a1f478290cb4e10c56c3094)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:54.629530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a84ad9-380a-4a8d-8bd0-1b98e35bdc64 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:54.631402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 39/79] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:46:54 2022] GET /identity/v3/users/465764cb0a1f478290cb4e10c56c3094 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:54.636590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84ad9-380a-4a8d-8bd0-1b98e35bdc64 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:54.676198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d13609-a63d-4287-9721-1da07268f7f0 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:54.710817 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c44551-7f86-4ff2-aa1b-bb8f45f645e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:54.711454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c44551-7f86-4ff2-aa1b-bb8f45f645e0 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.711738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c44551-7f86-4ff2-aa1b-bb8f45f645e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.712014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c44551-7f86-4ff2-aa1b-bb8f45f645e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.723728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c44551-7f86-4ff2-aa1b-bb8f45f645e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-b0c44551-7f86-4ff2-aa1b-bb8f45f645e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:46:54.728970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:46:54.729828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:46:54.730598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 41/80] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:46:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:46:54.731215 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c44551-7f86-4ff2-aa1b-bb8f45f645e0 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:54.746149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84ad9-380a-4a8d-8bd0-1b98e35bdc64 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:54.746627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:54.780421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd12ba-976c-4832-8cfc-21bba3743e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:54.781208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd12ba-976c-4832-8cfc-21bba3743e50 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.781493 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd12ba-976c-4832-8cfc-21bba3743e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.781841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd12ba-976c-4832-8cfc-21bba3743e50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.814250 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:54.829383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c44551-7f86-4ff2-aa1b-bb8f45f645e0 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:54.849168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd12ba-976c-4832-8cfc-21bba3743e50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:54.850709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd12ba-976c-4832-8cfc-21bba3743e50 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:54.862977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf574f7-810a-4bb5-b8f1-174c3ed1708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:54.863616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf574f7-810a-4bb5-b8f1-174c3ed1708e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:54.863901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf574f7-810a-4bb5-b8f1-174c3ed1708e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:54.864179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf574f7-810a-4bb5-b8f1-174c3ed1708e None admin] PATH_INFO: `/v3/users/465764cb0a1f478290cb4e10c56c3094` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:54.865335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf574f7-810a-4bb5-b8f1-174c3ed1708e None admin] RBAC: Authorizing `identity:get_user(user_id=465764cb0a1f478290cb4e10c56c3094)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:54.866818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf574f7-810a-4bb5-b8f1-174c3ed1708e None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:54.868391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 42/81] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:46:54 2022] GET /identity/v3/users/465764cb0a1f478290cb4e10c56c3094 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:54.872913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf574f7-810a-4bb5-b8f1-174c3ed1708e None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:54.946614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 40/82] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:46:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:46:54.947471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd12ba-976c-4832-8cfc-21bba3743e50 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:54.957415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:54.975586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf574f7-810a-4bb5-b8f1-174c3ed1708e None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:55.008974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac70fae-36cd-4243-b77b-97d503c0aece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:55.009592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac70fae-36cd-4243-b77b-97d503c0aece None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:55.009877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac70fae-36cd-4243-b77b-97d503c0aece None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:55.010153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac70fae-36cd-4243-b77b-97d503c0aece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:55.012614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:55.048135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd12ba-976c-4832-8cfc-21bba3743e50 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:55.077908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac70fae-36cd-4243-b77b-97d503c0aece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:55.079385 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac70fae-36cd-4243-b77b-97d503c0aece None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:55.083169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5148a-f5ca-49f4-b776-45b7960c905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:55.083809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5148a-f5ca-49f4-b776-45b7960c905d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:55.084094 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5148a-f5ca-49f4-b776-45b7960c905d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:55.084449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5148a-f5ca-49f4-b776-45b7960c905d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:55.086336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5148a-f5ca-49f4-b776-45b7960c905d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:55.087829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5148a-f5ca-49f4-b776-45b7960c905d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:55.089414 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 41/83] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:46:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:55.090496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5148a-f5ca-49f4-b776-45b7960c905d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:55.160297 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:55.179634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 43/84] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:46:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:46:55.180554 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac70fae-36cd-4243-b77b-97d503c0aece None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:55.196487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5148a-f5ca-49f4-b776-45b7960c905d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:55.230862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455fb01-aec8-4c4e-9a1d-773f748de6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:55.231471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455fb01-aec8-4c4e-9a1d-773f748de6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:55.231755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455fb01-aec8-4c4e-9a1d-773f748de6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:55.232031 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455fb01-aec8-4c4e-9a1d-773f748de6c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:55.232698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455fb01-aec8-4c4e-9a1d-773f748de6c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:55.233701 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455fb01-aec8-4c4e-9a1d-773f748de6c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:55.235393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455fb01-aec8-4c4e-9a1d-773f748de6c3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:55.236719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:55.243923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 42/85] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:46:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:55.247095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455fb01-aec8-4c4e-9a1d-773f748de6c3 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:55.283646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac70fae-36cd-4243-b77b-97d503c0aece None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:55.317412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad40dae-086f-4b85-921d-0dd6c2d1bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:55.318031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad40dae-086f-4b85-921d-0dd6c2d1bc68 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:55.318350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad40dae-086f-4b85-921d-0dd6c2d1bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:55.318632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad40dae-086f-4b85-921d-0dd6c2d1bc68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:55.346614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455fb01-aec8-4c4e-9a1d-773f748de6c3 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:55.369133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:55.379827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b9693-1f42-4f4c-b4c6-2b0466c6bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:55.383318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b9693-1f42-4f4c-b4c6-2b0466c6bc1f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:55.383318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b9693-1f42-4f4c-b4c6-2b0466c6bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:55.383318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b9693-1f42-4f4c-b4c6-2b0466c6bc1f None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:55.383318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b9693-1f42-4f4c-b4c6-2b0466c6bc1f None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:55.383604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b9693-1f42-4f4c-b4c6-2b0466c6bc1f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:55.384640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad40dae-086f-4b85-921d-0dd6c2d1bc68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:55.385164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 43/86] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:46:55 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:55.385912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b9693-1f42-4f4c-b4c6-2b0466c6bc1f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:55.386096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad40dae-086f-4b85-921d-0dd6c2d1bc68 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:55.447958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:55.485224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 44/87] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:46:55.486180 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b9693-1f42-4f4c-b4c6-2b0466c6bc1f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:55.486335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad40dae-086f-4b85-921d-0dd6c2d1bc68 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:55.519766 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadfdcf-717e-497d-a084-6dee0cc6a798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:55.520378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadfdcf-717e-497d-a084-6dee0cc6a798 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:55.520659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadfdcf-717e-497d-a084-6dee0cc6a798 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:55.520934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadfdcf-717e-497d-a084-6dee0cc6a798 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:55.521581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadfdcf-717e-497d-a084-6dee0cc6a798 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:55.523051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadfdcf-717e-497d-a084-6dee0cc6a798 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:55.569119 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:55.589845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad40dae-086f-4b85-921d-0dd6c2d1bc68 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:55.623250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caa6d9-39b3-4d34-9ebf-ff82af84e50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:55.623990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caa6d9-39b3-4d34-9ebf-ff82af84e50f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:55.624268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caa6d9-39b3-4d34-9ebf-ff82af84e50f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:55.624542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caa6d9-39b3-4d34-9ebf-ff82af84e50f None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:55.625760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13caa6d9-39b3-4d34-9ebf-ff82af84e50f None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:55.627270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13caa6d9-39b3-4d34-9ebf-ff82af84e50f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:55.629355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 45/88] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:46:55 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:55.630260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caa6d9-39b3-4d34-9ebf-ff82af84e50f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:55.636645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 44/89] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:46:55 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:46:55.650461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadfdcf-717e-497d-a084-6dee0cc6a798 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:55.747323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadfdcf-717e-497d-a084-6dee0cc6a798 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:55.749501 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caa6d9-39b3-4d34-9ebf-ff82af84e50f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:55.770837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:55.786772 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e343c0-b5da-4984-95ee-3cab9ef52a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:55.787405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e343c0-b5da-4984-95ee-3cab9ef52a02 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:55.787694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e343c0-b5da-4984-95ee-3cab9ef52a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:55.787982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e343c0-b5da-4984-95ee-3cab9ef52a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:55.788730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e343c0-b5da-4984-95ee-3cab9ef52a02 None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784, user.id=4e56bee89b494082b820a81a258feb86) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:55.789068 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e343c0-b5da-4984-95ee-3cab9ef52a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:55.790373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43d0ca-9679-47ef-ad69-aa09796e9381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:55.790545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e343c0-b5da-4984-95ee-3cab9ef52a02 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:55.791328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43d0ca-9679-47ef-ad69-aa09796e9381 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:55.791751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43d0ca-9679-47ef-ad69-aa09796e9381 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:55.792161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43d0ca-9679-47ef-ad69-aa09796e9381 None admin] PATH_INFO: `/v3/users/465764cb0a1f478290cb4e10c56c3094` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:55.793549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43d0ca-9679-47ef-ad69-aa09796e9381 None admin] RBAC: Authorizing `identity:get_user(user_id=465764cb0a1f478290cb4e10c56c3094)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:55.795056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43d0ca-9679-47ef-ad69-aa09796e9381 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:55.796711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 45/90] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:46:55 2022] GET /identity/v3/role_assignments?user.id=4e56bee89b494082b820a81a258feb86&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:55.802141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 46/91] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:46:55 2022] GET /identity/v3/users/465764cb0a1f478290cb4e10c56c3094 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:55.802141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43d0ca-9679-47ef-ad69-aa09796e9381 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:55.803328 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e343c0-b5da-4984-95ee-3cab9ef52a02 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:55.880894 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:55.952730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e343c0-b5da-4984-95ee-3cab9ef52a02 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:55.994424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43d0ca-9679-47ef-ad69-aa09796e9381 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:56.007051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2b29b-8eb9-44ff-b598-f5a06de15933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:56.007929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2b29b-8eb9-44ff-b598-f5a06de15933 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:56.008349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2b29b-8eb9-44ff-b598-f5a06de15933 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:56.008758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2b29b-8eb9-44ff-b598-f5a06de15933 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:56.010050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2b29b-8eb9-44ff-b598-f5a06de15933 None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:56.011710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2b29b-8eb9-44ff-b598-f5a06de15933 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:56.013529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 46/92] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:46:55 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:56.014781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2b29b-8eb9-44ff-b598-f5a06de15933 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:56.040754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ef5bf-eff8-4daf-b3da-312cffcb399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:56.041677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ef5bf-eff8-4daf-b3da-312cffcb399c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:56.041963 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ef5bf-eff8-4daf-b3da-312cffcb399c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:56.042292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ef5bf-eff8-4daf-b3da-312cffcb399c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:56.043037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ef5bf-eff8-4daf-b3da-312cffcb399c None admin] RBAC: Adding query filter params (role.id=5fb006eca1744bd592b59b08b23ef7f2, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784, user.id=465764cb0a1f478290cb4e10c56c3094) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:56.043352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ef5bf-eff8-4daf-b3da-312cffcb399c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:56.044860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ef5bf-eff8-4daf-b3da-312cffcb399c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:56.052731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 47/93] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:46:55 2022] GET /identity/v3/role_assignments?user.id=465764cb0a1f478290cb4e10c56c3094&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:56.053583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ef5bf-eff8-4daf-b3da-312cffcb399c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:56.084451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:56.173345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2b29b-8eb9-44ff-b598-f5a06de15933 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:56.217009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:56.234962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a659a-ee76-40c1-908d-675571352841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:56.235501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a659a-ee76-40c1-908d-675571352841 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:56.235781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a659a-ee76-40c1-908d-675571352841 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:56.236052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a659a-ee76-40c1-908d-675571352841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:56.244148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ef5bf-eff8-4daf-b3da-312cffcb399c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:56.289476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33278a-ae7c-4b87-993c-b7f620823c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:56.290937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33278a-ae7c-4b87-993c-b7f620823c24 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:56.291984 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33278a-ae7c-4b87-993c-b7f620823c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:56.292467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33278a-ae7c-4b87-993c-b7f620823c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:56.293406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33278a-ae7c-4b87-993c-b7f620823c24 None admin] RBAC: Adding query filter params (role.id=08735f4fc39148328610ad98ba651850, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784, user.id=465764cb0a1f478290cb4e10c56c3094) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:56.293943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33278a-ae7c-4b87-993c-b7f620823c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:56.296181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33278a-ae7c-4b87-993c-b7f620823c24 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:56.306750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 48/94] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:46:56 2022] GET /identity/v3/role_assignments?user.id=465764cb0a1f478290cb4e10c56c3094&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=08735f4fc39148328610ad98ba651850 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:56.369273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a659a-ee76-40c1-908d-675571352841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:56.370837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a659a-ee76-40c1-908d-675571352841 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:56.443830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:56.510100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 47/95] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:46:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:46:56.516725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33278a-ae7c-4b87-993c-b7f620823c24 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:56.638160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33278a-ae7c-4b87-993c-b7f620823c24 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:56.677255 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e147fe-fbd7-416b-960d-6b25f8bd20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:56.678304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e147fe-fbd7-416b-960d-6b25f8bd20a8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:56.678795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e147fe-fbd7-416b-960d-6b25f8bd20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:56.679443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e147fe-fbd7-416b-960d-6b25f8bd20a8 None admin] PATH_INFO: `/v3/projects/b3a661c42d054bea9c90f745e6642ab2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:56.680797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e147fe-fbd7-416b-960d-6b25f8bd20a8 None admin] RBAC: Authorizing `identity:get_project(project_id=b3a661c42d054bea9c90f745e6642ab2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:56.682472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e147fe-fbd7-416b-960d-6b25f8bd20a8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:56.684704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 49/96] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:46:56 2022] GET /identity/v3/projects/b3a661c42d054bea9c90f745e6642ab2 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:56.691081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a659a-ee76-40c1-908d-675571352841 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:56.863296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a659a-ee76-40c1-908d-675571352841 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:56.909325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473865b7-5131-45d8-99cd-e1a13d3f575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:56.909931 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473865b7-5131-45d8-99cd-e1a13d3f575e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:56.910234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473865b7-5131-45d8-99cd-e1a13d3f575e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:56.910515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473865b7-5131-45d8-99cd-e1a13d3f575e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:56.911247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473865b7-5131-45d8-99cd-e1a13d3f575e None admin] RBAC: Adding query filter params (role.id=5fb006eca1744bd592b59b08b23ef7f2, scope.project.id=b3a661c42d054bea9c90f745e6642ab2, user.id=465764cb0a1f478290cb4e10c56c3094) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:56.911557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473865b7-5131-45d8-99cd-e1a13d3f575e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:56.913008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473865b7-5131-45d8-99cd-e1a13d3f575e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:56.923280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 48/97] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:46:56 2022] GET /identity/v3/role_assignments?user.id=465764cb0a1f478290cb4e10c56c3094&scope.project.id=b3a661c42d054bea9c90f745e6642ab2&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:58.683135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baeaa6-8527-443a-9f07-9f5e646608bb None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:58.684144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baeaa6-8527-443a-9f07-9f5e646608bb None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:58.684718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baeaa6-8527-443a-9f07-9f5e646608bb None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:58.687056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 50/98] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:58.692632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12583-7802-4bf8-b74d-b9e0dee624e6 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:58.693429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12583-7802-4bf8-b74d-b9e0dee624e6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:58.693921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12583-7802-4bf8-b74d-b9e0dee624e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:58.712550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-bac12583-7802-4bf8-b74d-b9e0dee624e6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:58.714063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-bac12583-7802-4bf8-b74d-b9e0dee624e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:58.726825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:58.802021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 49/99] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:58.996207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849997-2a5d-4410-a2c9-0b4490d2df69 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:58.996495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849997-2a5d-4410-a2c9-0b4490d2df69 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:58.996959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f849997-2a5d-4410-a2c9-0b4490d2df69 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:58.999267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 51/100] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:59.005048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808a41a-58c4-406b-b9ca-a22347e60b2f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:59.005534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808a41a-58c4-406b-b9ca-a22347e60b2f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:59.005955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808a41a-58c4-406b-b9ca-a22347e60b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:59.026905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-0808a41a-58c4-406b-b9ca-a22347e60b2f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:59.028319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0808a41a-58c4-406b-b9ca-a22347e60b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:59.103981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408515-7df5-4749-bfed-e7ecfe3b2060 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:59.104602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408515-7df5-4749-bfed-e7ecfe3b2060 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:59.105070 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408515-7df5-4749-bfed-e7ecfe3b2060 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:59.106663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 52/101] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:59.113201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8f1e8-cf0b-4144-8307-8754fdeb6690 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:59.113770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8f1e8-cf0b-4144-8307-8754fdeb6690 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:59.114271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8f1e8-cf0b-4144-8307-8754fdeb6690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:59.120347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 50/102] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:46:59.146515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-15d8f1e8-cf0b-4144-8307-8754fdeb6690 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:59.148071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-15d8f1e8-cf0b-4144-8307-8754fdeb6690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:46:59.160243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:59.184538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808a41a-58c4-406b-b9ca-a22347e60b2f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:59.274076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 53/103] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:46:59.318606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:59.338163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808a41a-58c4-406b-b9ca-a22347e60b2f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:59.392876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaec87e-f2c2-4436-988e-fa8d48a71af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:59.393537 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaec87e-f2c2-4436-988e-fa8d48a71af6 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:59.393826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaec87e-f2c2-4436-988e-fa8d48a71af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:59.394196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaec87e-f2c2-4436-988e-fa8d48a71af6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:59.414914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaec87e-f2c2-4436-988e-fa8d48a71af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-1eaec87e-f2c2-4436-988e-fa8d48a71af6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:46:59.419936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:46:59.421481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:46:59.423484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 51/104] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:46:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:46:59.427284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8f1e8-cf0b-4144-8307-8754fdeb6690 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:59.595982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8f1e8-cf0b-4144-8307-8754fdeb6690 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:59.639761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795eeee-8a68-47e0-97b0-901412fe1827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:59.640390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795eeee-8a68-47e0-97b0-901412fe1827 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:59.645290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795eeee-8a68-47e0-97b0-901412fe1827 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:59.645594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795eeee-8a68-47e0-97b0-901412fe1827 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:59.646339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795eeee-8a68-47e0-97b0-901412fe1827 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:46:59.646883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795eeee-8a68-47e0-97b0-901412fe1827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:59.648282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795eeee-8a68-47e0-97b0-901412fe1827 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:59.657633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 54/105] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:46:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:59.663185 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaec87e-f2c2-4436-988e-fa8d48a71af6 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:59.736812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795eeee-8a68-47e0-97b0-901412fe1827 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:59.750841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:59.835658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaec87e-f2c2-4436-988e-fa8d48a71af6 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:59.869195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795eeee-8a68-47e0-97b0-901412fe1827 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:46:59.877993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf065316-3e3c-4607-b5bc-beeb4a89df6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:59.879036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065316-3e3c-4607-b5bc-beeb4a89df6e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:59.879826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065316-3e3c-4607-b5bc-beeb4a89df6e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:59.880616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065316-3e3c-4607-b5bc-beeb4a89df6e None admin] PATH_INFO: `/v3/users/4e56bee89b494082b820a81a258feb86` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:59.882645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf065316-3e3c-4607-b5bc-beeb4a89df6e None admin] RBAC: Authorizing `identity:get_user(user_id=4e56bee89b494082b820a81a258feb86)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:59.885404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf065316-3e3c-4607-b5bc-beeb4a89df6e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:59.888488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 52/106] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:46:59 2022] GET /identity/v3/users/4e56bee89b494082b820a81a258feb86 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:59.891301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff63d-bb71-4f2b-9dd7-2d6de24e6314 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:59.891803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff63d-bb71-4f2b-9dd7-2d6de24e6314 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:59.892259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff63d-bb71-4f2b-9dd7-2d6de24e6314 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:59.893752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 53/107] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:59.899339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45eb19-5138-4b8c-9c53-47098b105e31 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:59.899916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45eb19-5138-4b8c-9c53-47098b105e31 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:59.900395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45eb19-5138-4b8c-9c53-47098b105e31 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:59.901933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 54/108] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:46:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:46:59.902902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45eb19-5138-4b8c-9c53-47098b105e31 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:46:59.912866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:46:59.920440 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d2257-fd02-4fba-a0d6-b5ac3b42a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:46:59.921648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d2257-fd02-4fba-a0d6-b5ac3b42a48d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:59.922083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d2257-fd02-4fba-a0d6-b5ac3b42a48d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:59.922927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d2257-fd02-4fba-a0d6-b5ac3b42a48d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:59.924595 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d2257-fd02-4fba-a0d6-b5ac3b42a48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:46:59.926784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d2257-fd02-4fba-a0d6-b5ac3b42a48d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:46:59.928912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 55/109] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:46:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:46:59.930460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885200b-a877-4a77-bc8c-558f16b2e39f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:46:59.930756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885200b-a877-4a77-bc8c-558f16b2e39f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:46:59.931041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885200b-a877-4a77-bc8c-558f16b2e39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:46:59.956142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-1885200b-a877-4a77-bc8c-558f16b2e39f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:46:59.957597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1885200b-a877-4a77-bc8c-558f16b2e39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:00.044217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45eb19-5138-4b8c-9c53-47098b105e31 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:00.049831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 56/110] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:00.050793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885200b-a877-4a77-bc8c-558f16b2e39f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:00.055746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:00.096615 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a2a4-ea38-4ada-84c4-29b78690ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:00.097616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a2a4-ea38-4ada-84c4-29b78690ee55 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:00.098124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a2a4-ea38-4ada-84c4-29b78690ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:00.098757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a2a4-ea38-4ada-84c4-29b78690ee55 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:00.100277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a2a4-ea38-4ada-84c4-29b78690ee55 None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:00.102136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a2a4-ea38-4ada-84c4-29b78690ee55 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:00.104685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 55/111] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:46:59 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:00.106296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535333c-7c2e-4b91-84d1-5abe5c575b35 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:00.106786 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535333c-7c2e-4b91-84d1-5abe5c575b35 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:00.107281 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535333c-7c2e-4b91-84d1-5abe5c575b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:00.132622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b535333c-7c2e-4b91-84d1-5abe5c575b35 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:00.136278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b535333c-7c2e-4b91-84d1-5abe5c575b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:00.186196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885200b-a877-4a77-bc8c-558f16b2e39f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:00.228796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd1058-68be-4b7e-8086-abd92dd47b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:00.229710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd1058-68be-4b7e-8086-abd92dd47b09 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:00.230563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd1058-68be-4b7e-8086-abd92dd47b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:00.230986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd1058-68be-4b7e-8086-abd92dd47b09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:00.242524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 56/112] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:00.243822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535333c-7c2e-4b91-84d1-5abe5c575b35 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:00.246620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:00.265646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd1058-68be-4b7e-8086-abd92dd47b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-cabd1058-68be-4b7e-8086-abd92dd47b09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:00.279798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:00.280923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 57/113] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:00.282356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd1058-68be-4b7e-8086-abd92dd47b09 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:00.392414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:00.402718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535333c-7c2e-4b91-84d1-5abe5c575b35 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:00.435479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd1058-68be-4b7e-8086-abd92dd47b09 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:00.448974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ffc14-136e-4f46-b6b0-4c161c2bfe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:00.449591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ffc14-136e-4f46-b6b0-4c161c2bfe2c None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:00.449868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ffc14-136e-4f46-b6b0-4c161c2bfe2c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:00.450140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ffc14-136e-4f46-b6b0-4c161c2bfe2c None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:00.450830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ffc14-136e-4f46-b6b0-4c161c2bfe2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:00.452296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ffc14-136e-4f46-b6b0-4c161c2bfe2c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:00.475173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139aa80-f846-4661-95a3-fc84fbe33129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:00.475857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139aa80-f846-4661-95a3-fc84fbe33129 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:00.476142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139aa80-f846-4661-95a3-fc84fbe33129 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:00.476495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139aa80-f846-4661-95a3-fc84fbe33129 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/users/4e56bee89b494082b820a81a258feb86/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:00.478480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139aa80-f846-4661-95a3-fc84fbe33129 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d5dbb2d887b42bfb6786e6517b28784, user_id=4e56bee89b494082b820a81a258feb86, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:00.482361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139aa80-f846-4661-95a3-fc84fbe33129 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:00.546248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 57/114] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:47:00 2022] POST /identity/v3/projects => generated 302 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:47:00.550229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ffc14-136e-4f46-b6b0-4c161c2bfe2c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:00.609916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 58/115] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:47:00 2022] PUT /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/users/4e56bee89b494082b820a81a258feb86/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:00.610826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139aa80-f846-4661-95a3-fc84fbe33129 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:00.644263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:00.709053 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ffc14-136e-4f46-b6b0-4c161c2bfe2c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:00.762308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50086b-0071-46b0-945b-2c3678811bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:00.762651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50086b-0071-46b0-945b-2c3678811bdf None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:00.762939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50086b-0071-46b0-945b-2c3678811bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:00.763221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50086b-0071-46b0-945b-2c3678811bdf None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:00.764741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50086b-0071-46b0-945b-2c3678811bdf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:00.764947 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50086b-0071-46b0-945b-2c3678811bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:00.766602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50086b-0071-46b0-945b-2c3678811bdf None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:00.778391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 58/116] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:00.778602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139aa80-f846-4661-95a3-fc84fbe33129 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:00.779007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50086b-0071-46b0-945b-2c3678811bdf None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:00.816810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:00.830430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb0e87-0735-422e-88e2-f9d2b9333074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:00.831094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0e87-0735-422e-88e2-f9d2b9333074 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:00.831383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0e87-0735-422e-88e2-f9d2b9333074 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:00.831669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0e87-0735-422e-88e2-f9d2b9333074 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:00.842934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb0e87-0735-422e-88e2-f9d2b9333074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-54cb0e87-0735-422e-88e2-f9d2b9333074 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:00.849520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:00.850552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:00.851462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 59/117] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:00.852452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cdad8-b636-4fa8-bbc3-7a0ad3d0440e None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:00.852742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cdad8-b636-4fa8-bbc3-7a0ad3d0440e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:00.853022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cdad8-b636-4fa8-bbc3-7a0ad3d0440e None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:00.859755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 60/118] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:00.860728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cdad8-b636-4fa8-bbc3-7a0ad3d0440e None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:00.920016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50086b-0071-46b0-945b-2c3678811bdf None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:00.939435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:00.960068 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655ee7-2e28-4ded-832c-2ba50a2b90d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:00.960751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655ee7-2e28-4ded-832c-2ba50a2b90d6 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:00.961886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655ee7-2e28-4ded-832c-2ba50a2b90d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:00.962169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655ee7-2e28-4ded-832c-2ba50a2b90d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:00.978053 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b655ee7-2e28-4ded-832c-2ba50a2b90d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-2b655ee7-2e28-4ded-832c-2ba50a2b90d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:00.984363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:00.985249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:00.985980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:00.986566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 59/119] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:00.992260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655ee7-2e28-4ded-832c-2ba50a2b90d6 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:01.003569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cdad8-b636-4fa8-bbc3-7a0ad3d0440e None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:01.052339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b22b2-0f2d-4ab5-aff3-4843659114e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:01.053588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b22b2-0f2d-4ab5-aff3-4843659114e1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:01.053891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b22b2-0f2d-4ab5-aff3-4843659114e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:01.054175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b22b2-0f2d-4ab5-aff3-4843659114e1 None admin] PATH_INFO: `/v3/users/1c6b18f7143e47208f708743d0837b40` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:01.076315 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b22b2-0f2d-4ab5-aff3-4843659114e1 None admin] RBAC: Authorizing `identity:get_user(user_id=1c6b18f7143e47208f708743d0837b40)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:01.078950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b22b2-0f2d-4ab5-aff3-4843659114e1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:01.080674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 61/120] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:00 2022] GET /identity/v3/users/1c6b18f7143e47208f708743d0837b40 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:01.081866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58213cdb-2497-4dcb-a6ed-4865c6249d60 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:01.083460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58213cdb-2497-4dcb-a6ed-4865c6249d60 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:01.083755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58213cdb-2497-4dcb-a6ed-4865c6249d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:01.105703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-58213cdb-2497-4dcb-a6ed-4865c6249d60 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:01.107003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-58213cdb-2497-4dcb-a6ed-4865c6249d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:01.112839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655ee7-2e28-4ded-832c-2ba50a2b90d6 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:01.162157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:01.163406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f276b-8ce1-4429-8b52-50897d35a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:01.164032 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f276b-8ce1-4429-8b52-50897d35a881 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:01.164322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f276b-8ce1-4429-8b52-50897d35a881 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:01.164603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f276b-8ce1-4429-8b52-50897d35a881 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:01.165284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f276b-8ce1-4429-8b52-50897d35a881 None admin] RBAC: Adding query filter params (name=member) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:01.165593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f276b-8ce1-4429-8b52-50897d35a881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:01.167017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f276b-8ce1-4429-8b52-50897d35a881 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:01.178514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 60/121] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:01.179306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f276b-8ce1-4429-8b52-50897d35a881 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:01.205105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 62/122] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:01.206077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58213cdb-2497-4dcb-a6ed-4865c6249d60 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:01.233297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:01.297834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f276b-8ce1-4429-8b52-50897d35a881 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:01.333396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58213cdb-2497-4dcb-a6ed-4865c6249d60 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:01.334110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3027e9d-deb8-4222-bfc0-733b687ff8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:01.334885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3027e9d-deb8-4222-bfc0-733b687ff8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:01.335177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3027e9d-deb8-4222-bfc0-733b687ff8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:01.335450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3027e9d-deb8-4222-bfc0-733b687ff8b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:01.336274 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3027e9d-deb8-4222-bfc0-733b687ff8b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:01.336584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3027e9d-deb8-4222-bfc0-733b687ff8b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:01.337958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3027e9d-deb8-4222-bfc0-733b687ff8b1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:01.347482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 61/123] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:01.348149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3027e9d-deb8-4222-bfc0-733b687ff8b1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:01.383241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06df8e-da44-4ffd-b028-a6e7b3e6907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:01.383926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06df8e-da44-4ffd-b028-a6e7b3e6907c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:01.384210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06df8e-da44-4ffd-b028-a6e7b3e6907c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:01.384489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06df8e-da44-4ffd-b028-a6e7b3e6907c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:01.471362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:01.523144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06df8e-da44-4ffd-b028-a6e7b3e6907c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:01.524625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06df8e-da44-4ffd-b028-a6e7b3e6907c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:01.539693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:01.543389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3027e9d-deb8-4222-bfc0-733b687ff8b1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:01.590155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bacfc-7a52-4c4c-a9d5-4590eb4913e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:01.590833 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bacfc-7a52-4c4c-a9d5-4590eb4913e5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:01.591118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bacfc-7a52-4c4c-a9d5-4590eb4913e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:01.591398 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bacfc-7a52-4c4c-a9d5-4590eb4913e5 None admin] PATH_INFO: `/v3/users/465764cb0a1f478290cb4e10c56c3094` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:01.592744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bacfc-7a52-4c4c-a9d5-4590eb4913e5 None admin] RBAC: Authorizing `identity:get_user(user_id=465764cb0a1f478290cb4e10c56c3094)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:01.594237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bacfc-7a52-4c4c-a9d5-4590eb4913e5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:01.595854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 62/124] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:01 2022] GET /identity/v3/users/465764cb0a1f478290cb4e10c56c3094 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:01.596721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bacfc-7a52-4c4c-a9d5-4590eb4913e5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:01.673299 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 63/125] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:01.674905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06df8e-da44-4ffd-b028-a6e7b3e6907c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:01.717727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bacfc-7a52-4c4c-a9d5-4590eb4913e5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:01.761250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:01.767088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab838c1b-c7cb-4605-81e7-099f4eef083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:01.768005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838c1b-c7cb-4605-81e7-099f4eef083e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:01.768471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838c1b-c7cb-4605-81e7-099f4eef083e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:01.768907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838c1b-c7cb-4605-81e7-099f4eef083e None admin] PATH_INFO: `/v3/users/465764cb0a1f478290cb4e10c56c3094` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:01.770596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab838c1b-c7cb-4605-81e7-099f4eef083e None admin] RBAC: Authorizing `identity:get_user(user_id=465764cb0a1f478290cb4e10c56c3094)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:01.772791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab838c1b-c7cb-4605-81e7-099f4eef083e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:01.776322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 63/126] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:01 2022] GET /identity/v3/users/465764cb0a1f478290cb4e10c56c3094 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:01.776322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab838c1b-c7cb-4605-81e7-099f4eef083e None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:01.793885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06df8e-da44-4ffd-b028-a6e7b3e6907c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:01.821425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:01.835885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19470272-2b78-4e14-bd83-0bbcb7c02cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:01.836674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19470272-2b78-4e14-bd83-0bbcb7c02cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:01.837031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19470272-2b78-4e14-bd83-0bbcb7c02cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:01.837424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19470272-2b78-4e14-bd83-0bbcb7c02cc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:01.850189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19470272-2b78-4e14-bd83-0bbcb7c02cc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-19470272-2b78-4e14-bd83-0bbcb7c02cc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:01.856943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:01.858383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:01.859363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:01.864313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 64/127] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:01.865285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19470272-2b78-4e14-bd83-0bbcb7c02cc2 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:01.899214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab838c1b-c7cb-4605-81e7-099f4eef083e None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:01.934936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d6856-0855-43d9-ba54-9cdb65daf7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:01.937095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d6856-0855-43d9-ba54-9cdb65daf7ba None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:01.937582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d6856-0855-43d9-ba54-9cdb65daf7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:01.938055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d6856-0855-43d9-ba54-9cdb65daf7ba None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:01.939474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d6856-0855-43d9-ba54-9cdb65daf7ba None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:01.941506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d6856-0855-43d9-ba54-9cdb65daf7ba None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:01.943435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 64/128] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:01 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:01.944418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d6856-0855-43d9-ba54-9cdb65daf7ba None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:01.981323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19470272-2b78-4e14-bd83-0bbcb7c02cc2 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:02.018720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:02.025453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b5a91-bdb3-4353-834f-42c868aa45be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:02.026481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b5a91-bdb3-4353-834f-42c868aa45be None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:02.026833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b5a91-bdb3-4353-834f-42c868aa45be None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:02.027186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b5a91-bdb3-4353-834f-42c868aa45be None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:02.028409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b5a91-bdb3-4353-834f-42c868aa45be None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:02.030410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b5a91-bdb3-4353-834f-42c868aa45be None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:02.033031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 65/129] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:01 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:02.033922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b5a91-bdb3-4353-834f-42c868aa45be None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:02.065257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d6856-0855-43d9-ba54-9cdb65daf7ba None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:02.078600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:02.114497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3188b-a3cc-484a-b7af-b660dc3fd5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:02.115443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3188b-a3cc-484a-b7af-b660dc3fd5ee None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:02.115738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3188b-a3cc-484a-b7af-b660dc3fd5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:02.116020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3188b-a3cc-484a-b7af-b660dc3fd5ee None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:02.117750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3188b-a3cc-484a-b7af-b660dc3fd5ee None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:02.119507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3188b-a3cc-484a-b7af-b660dc3fd5ee None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:02.122621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 65/130] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:01 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:02.123724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3188b-a3cc-484a-b7af-b660dc3fd5ee None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:02.158559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b5a91-bdb3-4353-834f-42c868aa45be None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:02.199645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4387f49-2078-4786-bcd1-ea9c1b3ba546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:02.200536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4387f49-2078-4786-bcd1-ea9c1b3ba546 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:02.200999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4387f49-2078-4786-bcd1-ea9c1b3ba546 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:02.201980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4387f49-2078-4786-bcd1-ea9c1b3ba546 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:02.203019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4387f49-2078-4786-bcd1-ea9c1b3ba546 None admin] RBAC: Adding query filter params (name=member) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:02.203892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4387f49-2078-4786-bcd1-ea9c1b3ba546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:02.205891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4387f49-2078-4786-bcd1-ea9c1b3ba546 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:02.215474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 66/131] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:02.221588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4387f49-2078-4786-bcd1-ea9c1b3ba546 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:02.259521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3188b-a3cc-484a-b7af-b660dc3fd5ee None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:02.293758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:02.304853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d690104-fcad-4299-8839-c9e6375c87e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:02.305806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d690104-fcad-4299-8839-c9e6375c87e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:02.306293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d690104-fcad-4299-8839-c9e6375c87e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:02.306980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d690104-fcad-4299-8839-c9e6375c87e7 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/users/465764cb0a1f478290cb4e10c56c3094/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:02.309007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d690104-fcad-4299-8839-c9e6375c87e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d5dbb2d887b42bfb6786e6517b28784, user_id=465764cb0a1f478290cb4e10c56c3094, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:02.311309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d690104-fcad-4299-8839-c9e6375c87e7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:02.340002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4387f49-2078-4786-bcd1-ea9c1b3ba546 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:02.376428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53efd-8f2d-4b22-aa3e-f87e5086355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:02.377055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53efd-8f2d-4b22-aa3e-f87e5086355f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:02.377345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53efd-8f2d-4b22-aa3e-f87e5086355f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:02.377626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53efd-8f2d-4b22-aa3e-f87e5086355f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:02.378398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53efd-8f2d-4b22-aa3e-f87e5086355f None admin] RBAC: Adding query filter params (role.id=abe4ea559dbb48b7a4437bbab79636ab, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784, user.id=1c6b18f7143e47208f708743d0837b40) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:02.378713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53efd-8f2d-4b22-aa3e-f87e5086355f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:02.380250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53efd-8f2d-4b22-aa3e-f87e5086355f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:02.390586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 67/132] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:02 2022] GET /identity/v3/role_assignments?user.id=1c6b18f7143e47208f708743d0837b40&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=abe4ea559dbb48b7a4437bbab79636ab => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:02.390586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53efd-8f2d-4b22-aa3e-f87e5086355f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:02.412034 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 66/133] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:47:02 2022] PUT /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/users/465764cb0a1f478290cb4e10c56c3094/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:02.414160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d690104-fcad-4299-8839-c9e6375c87e7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:02.462294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:02.554124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d690104-fcad-4299-8839-c9e6375c87e7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:02.595863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1beefc-9f93-4ae1-8511-499a113cd599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:02.596952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1beefc-9f93-4ae1-8511-499a113cd599 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:02.597442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1beefc-9f93-4ae1-8511-499a113cd599 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:02.597986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1beefc-9f93-4ae1-8511-499a113cd599 None admin] PATH_INFO: `/v3/users/465764cb0a1f478290cb4e10c56c3094` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:02.599593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1beefc-9f93-4ae1-8511-499a113cd599 None admin] RBAC: Authorizing `identity:get_user(user_id=465764cb0a1f478290cb4e10c56c3094)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:02.601447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1beefc-9f93-4ae1-8511-499a113cd599 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:02.603615 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 67/134] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:02 2022] GET /identity/v3/users/465764cb0a1f478290cb4e10c56c3094 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:02.610917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1beefc-9f93-4ae1-8511-499a113cd599 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:02.632102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53efd-8f2d-4b22-aa3e-f87e5086355f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:02.728275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:02.751614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012f3ec-85ce-4e29-b01a-9e4975311647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:02.752313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012f3ec-85ce-4e29-b01a-9e4975311647 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:02.752644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012f3ec-85ce-4e29-b01a-9e4975311647 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:02.752875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012f3ec-85ce-4e29-b01a-9e4975311647 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/users/465764cb0a1f478290cb4e10c56c3094/roles/08735f4fc39148328610ad98ba651850` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:02.755128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012f3ec-85ce-4e29-b01a-9e4975311647 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d5dbb2d887b42bfb6786e6517b28784, user_id=465764cb0a1f478290cb4e10c56c3094, role_id=08735f4fc39148328610ad98ba651850)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:02.756594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012f3ec-85ce-4e29-b01a-9e4975311647 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:02.758643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1beefc-9f93-4ae1-8511-499a113cd599 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:02.769572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:02.799612 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d6372-5b72-420c-80d9-aa19f3b7df91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:02.800267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d6372-5b72-420c-80d9-aa19f3b7df91 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:02.800577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d6372-5b72-420c-80d9-aa19f3b7df91 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:02.800854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d6372-5b72-420c-80d9-aa19f3b7df91 None admin] PATH_INFO: `/v3/projects/b3a661c42d054bea9c90f745e6642ab2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:02.802019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d6372-5b72-420c-80d9-aa19f3b7df91 None admin] RBAC: Authorizing `identity:get_project(project_id=b3a661c42d054bea9c90f745e6642ab2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:02.803520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d6372-5b72-420c-80d9-aa19f3b7df91 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:02.805715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 68/135] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:02 2022] GET /identity/v3/projects/b3a661c42d054bea9c90f745e6642ab2 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:02.811961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d6372-5b72-420c-80d9-aa19f3b7df91 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:02.823857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 68/136] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:47:02 2022] PUT /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/users/465764cb0a1f478290cb4e10c56c3094/roles/08735f4fc39148328610ad98ba651850 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:02.961564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d6372-5b72-420c-80d9-aa19f3b7df91 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:03.007214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7dd30-3798-4e72-82e4-62e26e02de6d None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:03.007497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7dd30-3798-4e72-82e4-62e26e02de6d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:03.007778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7dd30-3798-4e72-82e4-62e26e02de6d None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:03.009277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 69/137] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:47:03.014613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e3abc-42e3-44d3-a8a9-2154a0b4c74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:03.015727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3abc-42e3-44d3-a8a9-2154a0b4c74c None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:03.016395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3abc-42e3-44d3-a8a9-2154a0b4c74c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:03.017019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3abc-42e3-44d3-a8a9-2154a0b4c74c None admin] PATH_INFO: `/v3/projects/b3a661c42d054bea9c90f745e6642ab2/users/465764cb0a1f478290cb4e10c56c3094/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:03.019426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e3abc-42e3-44d3-a8a9-2154a0b4c74c None admin] RBAC: Authorizing `identity:create_grant(project_id=b3a661c42d054bea9c90f745e6642ab2, user_id=465764cb0a1f478290cb4e10c56c3094, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:03.021468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e3abc-42e3-44d3-a8a9-2154a0b4c74c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:03.021706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c8e3d-c196-4503-9de8-00cbf500a866 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:03.021986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c8e3d-c196-4503-9de8-00cbf500a866 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:03.022289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c8e3d-c196-4503-9de8-00cbf500a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:03.059415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-223c8e3d-c196-4503-9de8-00cbf500a866 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:03.060608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-223c8e3d-c196-4503-9de8-00cbf500a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:03.152197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 69/138] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:47:02 2022] PUT /identity/v3/projects/b3a661c42d054bea9c90f745e6642ab2/users/465764cb0a1f478290cb4e10c56c3094/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:03.158648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 70/139] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:03.430773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b4ca-5a4c-462e-ae00-6686bc17ecb7 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:03.431294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b4ca-5a4c-462e-ae00-6686bc17ecb7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:03.431720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b4ca-5a4c-462e-ae00-6686bc17ecb7 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:03.433222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 70/140] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:03.439112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478fcd9-e57e-4700-8296-44f41ec8fd99 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:03.439514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478fcd9-e57e-4700-8296-44f41ec8fd99 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:03.439890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478fcd9-e57e-4700-8296-44f41ec8fd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:03.467567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e478fcd9-e57e-4700-8296-44f41ec8fd99 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:03.468908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e478fcd9-e57e-4700-8296-44f41ec8fd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:03.550451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 71/141] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:03.667795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b4ca-5a4c-462e-ae00-6686bc17ecb7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:03.705213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:03.794889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b4ca-5a4c-462e-ae00-6686bc17ecb7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:03.844868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c09d7-528a-4b5e-a861-768551250e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:03.845524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c09d7-528a-4b5e-a861-768551250e28 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:03.845802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c09d7-528a-4b5e-a861-768551250e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:03.846071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c09d7-528a-4b5e-a861-768551250e28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:03.847259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c09d7-528a-4b5e-a861-768551250e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:03.848714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c09d7-528a-4b5e-a861-768551250e28 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:03.850706 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 71/142] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:03.859609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478fcd9-e57e-4700-8296-44f41ec8fd99 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:03.935414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:04.011290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478fcd9-e57e-4700-8296-44f41ec8fd99 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:04.059825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81a4b-409f-4b20-9e9d-8e4f22ec5b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:04.060460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81a4b-409f-4b20-9e9d-8e4f22ec5b8a None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:04.060797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81a4b-409f-4b20-9e9d-8e4f22ec5b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:04.061138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81a4b-409f-4b20-9e9d-8e4f22ec5b8a None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:04.061808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f81a4b-409f-4b20-9e9d-8e4f22ec5b8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:04.063316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f81a4b-409f-4b20-9e9d-8e4f22ec5b8a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:04.115167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c09d7-528a-4b5e-a861-768551250e28 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:04.189510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 72/143] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:47:03 2022] POST /identity/v3/users => generated 283 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:47:04.257240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:04.264570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c09d7-528a-4b5e-a861-768551250e28 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:04.313156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5c578-241b-44fb-b2e4-f1361c6dd3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:04.313925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c578-241b-44fb-b2e4-f1361c6dd3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:04.314228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c578-241b-44fb-b2e4-f1361c6dd3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:04.314500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c578-241b-44fb-b2e4-f1361c6dd3a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:04.327350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5c578-241b-44fb-b2e4-f1361c6dd3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-c6a5c578-241b-44fb-b2e4-f1361c6dd3a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:04.332283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:04.333144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:04.334381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 72/144] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:04.339362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81a4b-409f-4b20-9e9d-8e4f22ec5b8a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:04.472524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81a4b-409f-4b20-9e9d-8e4f22ec5b8a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:04.491173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:04.513824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0041b-4e98-41cb-b2cf-a55c4962cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:04.515044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0041b-4e98-41cb-b2cf-a55c4962cf9a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:04.515538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0041b-4e98-41cb-b2cf-a55c4962cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:04.516035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0041b-4e98-41cb-b2cf-a55c4962cf9a None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:04.516934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0041b-4e98-41cb-b2cf-a55c4962cf9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:04.517476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0041b-4e98-41cb-b2cf-a55c4962cf9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:04.519134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0041b-4e98-41cb-b2cf-a55c4962cf9a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:04.534875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 73/145] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:04.540695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5c578-241b-44fb-b2e4-f1361c6dd3a1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:04.706928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5c578-241b-44fb-b2e4-f1361c6dd3a1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:04.754769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a3475-6839-4252-b369-9be4b0c08e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:04.755457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a3475-6839-4252-b369-9be4b0c08e8e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:04.755743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a3475-6839-4252-b369-9be4b0c08e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:04.756019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a3475-6839-4252-b369-9be4b0c08e8e None admin] PATH_INFO: `/v3/users/4e56bee89b494082b820a81a258feb86` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:04.757156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a3475-6839-4252-b369-9be4b0c08e8e None admin] RBAC: Authorizing `identity:get_user(user_id=4e56bee89b494082b820a81a258feb86)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:04.758685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a3475-6839-4252-b369-9be4b0c08e8e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:04.760584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 73/146] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:04 2022] GET /identity/v3/users/4e56bee89b494082b820a81a258feb86 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:04.766764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0041b-4e98-41cb-b2cf-a55c4962cf9a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:04.910619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0041b-4e98-41cb-b2cf-a55c4962cf9a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:04.951275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6e31a-e9d4-4c1a-89f2-7e3c1fb20cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:04.952820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e31a-e9d4-4c1a-89f2-7e3c1fb20cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:04.953302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e31a-e9d4-4c1a-89f2-7e3c1fb20cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:04.953772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6e31a-e9d4-4c1a-89f2-7e3c1fb20cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:04.989466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:05.041500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6e31a-e9d4-4c1a-89f2-7e3c1fb20cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:05.042939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6e31a-e9d4-4c1a-89f2-7e3c1fb20cf5 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:05.167729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 74/147] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:05.173828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a3475-6839-4252-b369-9be4b0c08e8e None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:05.222661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:05.302478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a3475-6839-4252-b369-9be4b0c08e8e None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:05.346440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f14be-ed94-43c4-9347-da6b6b65aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:05.347230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f14be-ed94-43c4-9347-da6b6b65aa39 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:05.347520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f14be-ed94-43c4-9347-da6b6b65aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:05.347796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f14be-ed94-43c4-9347-da6b6b65aa39 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:05.348956 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f14be-ed94-43c4-9347-da6b6b65aa39 None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:05.350442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f14be-ed94-43c4-9347-da6b6b65aa39 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:05.352336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 74/148] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:05 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:05.358360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6e31a-e9d4-4c1a-89f2-7e3c1fb20cf5 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:05.435347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:05.482142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6e31a-e9d4-4c1a-89f2-7e3c1fb20cf5 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:05.525843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90d563-f7df-4d7d-b6cb-264b1815f53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:05.526887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90d563-f7df-4d7d-b6cb-264b1815f53f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:05.527377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90d563-f7df-4d7d-b6cb-264b1815f53f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:05.527855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90d563-f7df-4d7d-b6cb-264b1815f53f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:05.528814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90d563-f7df-4d7d-b6cb-264b1815f53f None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784, user.id=4e56bee89b494082b820a81a258feb86) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:05.529423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90d563-f7df-4d7d-b6cb-264b1815f53f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:05.531140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90d563-f7df-4d7d-b6cb-264b1815f53f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:05.538539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 75/149] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:05 2022] GET /identity/v3/role_assignments?user.id=4e56bee89b494082b820a81a258feb86&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:05.686859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ab57-e126-434e-9fa1-4af6deb043c8 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:05.687173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ab57-e126-434e-9fa1-4af6deb043c8 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:05.687415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ab57-e126-434e-9fa1-4af6deb043c8 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:05.689060 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 75/150] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:05.700305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bb3a8-5947-4113-b9d0-9c1b6fc70236 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:05.700919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bb3a8-5947-4113-b9d0-9c1b6fc70236 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:05.701970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bb3a8-5947-4113-b9d0-9c1b6fc70236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:05.727376 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2b3bb3a8-5947-4113-b9d0-9c1b6fc70236 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:05.728990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2b3bb3a8-5947-4113-b9d0-9c1b6fc70236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:05.764408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30413b37-ad0f-46db-a275-f7bb81970b68 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:05.764776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30413b37-ad0f-46db-a275-f7bb81970b68 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:05.764968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30413b37-ad0f-46db-a275-f7bb81970b68 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:05.768431 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 76/151] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:05.773479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0201a-e783-43a8-a657-9a382d5dd4c2 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:05.773756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0201a-e783-43a8-a657-9a382d5dd4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:05.774034 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0201a-e783-43a8-a657-9a382d5dd4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:05.807375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5bb0201a-e783-43a8-a657-9a382d5dd4c2 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:05.808707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5bb0201a-e783-43a8-a657-9a382d5dd4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:05.829651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 76/152] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:05.912903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 77/153] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:06.186686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bb3a8-5947-4113-b9d0-9c1b6fc70236 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:06.259124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:06.303697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bb3a8-5947-4113-b9d0-9c1b6fc70236 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:06.343028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832550ba-a359-425b-aba4-7036896d1107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:06.344046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832550ba-a359-425b-aba4-7036896d1107 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:06.344532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832550ba-a359-425b-aba4-7036896d1107 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:06.345014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832550ba-a359-425b-aba4-7036896d1107 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:06.361003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832550ba-a359-425b-aba4-7036896d1107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-832550ba-a359-425b-aba4-7036896d1107 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:06.366578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:06.367504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:06.368266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:06.370768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 77/154] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:06.383450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0201a-e783-43a8-a657-9a382d5dd4c2 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:06.425282 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:06.439131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1166b0-7ce5-4826-bc40-1a7cb92bc69b None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:06.439131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1166b0-7ce5-4826-bc40-1a7cb92bc69b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:06.439131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1166b0-7ce5-4826-bc40-1a7cb92bc69b None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:06.439742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 78/155] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:06.444453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1166b0-7ce5-4826-bc40-1a7cb92bc69b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:06.537556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0201a-e783-43a8-a657-9a382d5dd4c2 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:06.584703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1166b0-7ce5-4826-bc40-1a7cb92bc69b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:06.592976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc24f8-14de-4c5d-b588-b6dac1d0f553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:06.593839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc24f8-14de-4c5d-b588-b6dac1d0f553 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:06.594358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc24f8-14de-4c5d-b588-b6dac1d0f553 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:06.594769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc24f8-14de-4c5d-b588-b6dac1d0f553 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:06.595590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc24f8-14de-4c5d-b588-b6dac1d0f553 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:06.596115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc24f8-14de-4c5d-b588-b6dac1d0f553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:06.597642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc24f8-14de-4c5d-b588-b6dac1d0f553 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:06.610093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 78/156] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:06.611741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8e0a0-1471-456f-85ac-258006b408d5 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:06.612160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8e0a0-1471-456f-85ac-258006b408d5 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:06.612556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8e0a0-1471-456f-85ac-258006b408d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:06.620095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:06.638439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-15d8e0a0-1471-456f-85ac-258006b408d5 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:06.638943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012da19-2570-4c0f-b95e-1a5735e5b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:06.639652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-15d8e0a0-1471-456f-85ac-258006b408d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:06.640264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012da19-2570-4c0f-b95e-1a5735e5b5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:06.640796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012da19-2570-4c0f-b95e-1a5735e5b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:06.641319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012da19-2570-4c0f-b95e-1a5735e5b5f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:06.655175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012da19-2570-4c0f-b95e-1a5735e5b5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-3012da19-2570-4c0f-b95e-1a5735e5b5f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:06.661450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:06.662402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:06.663178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:06.665803 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 79/157] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:06.667841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc0db0-a8df-45b5-893d-d219149141f9 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:06.668331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc0db0-a8df-45b5-893d-d219149141f9 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:06.668746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc0db0-a8df-45b5-893d-d219149141f9 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:06.670977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 80/158] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:06.676678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc0db0-a8df-45b5-893d-d219149141f9 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:06.753349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 79/159] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:06.754772 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8e0a0-1471-456f-85ac-258006b408d5 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:06.773970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:06.898463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc0db0-a8df-45b5-893d-d219149141f9 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:06.942747 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8e0a0-1471-456f-85ac-258006b408d5 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:06.990115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a333675-42b0-4847-b281-cd57a3c9fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:06.990939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a333675-42b0-4847-b281-cd57a3c9fa0b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:06.991347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a333675-42b0-4847-b281-cd57a3c9fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:06.991753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a333675-42b0-4847-b281-cd57a3c9fa0b None admin] PATH_INFO: `/v3/users/1c6b18f7143e47208f708743d0837b40` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:06.992907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a333675-42b0-4847-b281-cd57a3c9fa0b None admin] RBAC: Authorizing `identity:get_user(user_id=1c6b18f7143e47208f708743d0837b40)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:06.994412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a333675-42b0-4847-b281-cd57a3c9fa0b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:06.996289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 81/160] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:06 2022] GET /identity/v3/users/1c6b18f7143e47208f708743d0837b40 => generated 289 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:06.997506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52b5e-3dfc-496f-99c7-b9c9db8506fe None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:06.997823 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52b5e-3dfc-496f-99c7-b9c9db8506fe None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:07.002935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52b5e-3dfc-496f-99c7-b9c9db8506fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:07.038878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-4ec52b5e-3dfc-496f-99c7-b9c9db8506fe None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:07.039043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b0d6b-618e-4e06-8ef8-b55337a2aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:07.039540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b0d6b-618e-4e06-8ef8-b55337a2aed5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:07.039823 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b0d6b-618e-4e06-8ef8-b55337a2aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:07.040000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4ec52b5e-3dfc-496f-99c7-b9c9db8506fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:07.040091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b0d6b-618e-4e06-8ef8-b55337a2aed5 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:07.040768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b0d6b-618e-4e06-8ef8-b55337a2aed5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:07.041070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b0d6b-618e-4e06-8ef8-b55337a2aed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:07.042476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b0d6b-618e-4e06-8ef8-b55337a2aed5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:07.068142 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 80/161] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:07.069169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b0d6b-618e-4e06-8ef8-b55337a2aed5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:07.115696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:07.159710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 82/162] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:07.160673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec52b5e-3dfc-496f-99c7-b9c9db8506fe None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:07.212335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:07.249041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b0d6b-618e-4e06-8ef8-b55337a2aed5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:07.321027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c090a3-a44f-4539-bc82-b7d3f6b78e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:07.322001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c090a3-a44f-4539-bc82-b7d3f6b78e52 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:07.322524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c090a3-a44f-4539-bc82-b7d3f6b78e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:07.323015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c090a3-a44f-4539-bc82-b7d3f6b78e52 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:07.324423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c090a3-a44f-4539-bc82-b7d3f6b78e52 None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:07.326764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c090a3-a44f-4539-bc82-b7d3f6b78e52 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:07.328641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 81/163] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:07 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:07.334534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c090a3-a44f-4539-bc82-b7d3f6b78e52 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:07.388149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec52b5e-3dfc-496f-99c7-b9c9db8506fe None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:07.445293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c090a3-a44f-4539-bc82-b7d3f6b78e52 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:07.499636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d44845-3cbf-4517-b3c6-ca4ab1561fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:07.500320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44845-3cbf-4517-b3c6-ca4ab1561fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:07.500618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44845-3cbf-4517-b3c6-ca4ab1561fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:07.500897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d44845-3cbf-4517-b3c6-ca4ab1561fd2 None admin] PATH_INFO: `/v3/users/465764cb0a1f478290cb4e10c56c3094` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:07.504247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5369e-eea9-4572-beaa-4e1437263c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:07.505214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5369e-eea9-4572-beaa-4e1437263c2b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:07.505718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5369e-eea9-4572-beaa-4e1437263c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:07.506192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5369e-eea9-4572-beaa-4e1437263c2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:07.507063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d44845-3cbf-4517-b3c6-ca4ab1561fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=465764cb0a1f478290cb4e10c56c3094)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:07.508556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d44845-3cbf-4517-b3c6-ca4ab1561fd2 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:07.510444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 83/164] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:07 2022] GET /identity/v3/users/465764cb0a1f478290cb4e10c56c3094 => generated 275 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:07.511117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d44845-3cbf-4517-b3c6-ca4ab1561fd2 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:07.528969 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5369e-eea9-4572-beaa-4e1437263c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-9ac5369e-eea9-4572-beaa-4e1437263c2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:07.536005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:07.536859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:07.537622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:07.546397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 82/165] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:07.547513 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5369e-eea9-4572-beaa-4e1437263c2b None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:07.553572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:07.604967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:07.727083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5369e-eea9-4572-beaa-4e1437263c2b None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:07.748486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d44845-3cbf-4517-b3c6-ca4ab1561fd2 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:07.764738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c493c3-92a3-4f9c-9946-a70a15b590e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:07.765663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c493c3-92a3-4f9c-9946-a70a15b590e2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:07.766276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c493c3-92a3-4f9c-9946-a70a15b590e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:07.767053 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c493c3-92a3-4f9c-9946-a70a15b590e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:07.814926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5b7c8-a290-48ba-a09f-8dc4eb8f9e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:07.815871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5b7c8-a290-48ba-a09f-8dc4eb8f9e84 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:07.816182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5b7c8-a290-48ba-a09f-8dc4eb8f9e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:07.816437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5b7c8-a290-48ba-a09f-8dc4eb8f9e84 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/users/1c6b18f7143e47208f708743d0837b40/roles/abe4ea559dbb48b7a4437bbab79636ab` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:07.822973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5b7c8-a290-48ba-a09f-8dc4eb8f9e84 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d5dbb2d887b42bfb6786e6517b28784, user_id=1c6b18f7143e47208f708743d0837b40, role_id=abe4ea559dbb48b7a4437bbab79636ab)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:07.824447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5b7c8-a290-48ba-a09f-8dc4eb8f9e84 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:07.847223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c493c3-92a3-4f9c-9946-a70a15b590e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:07.849128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c493c3-92a3-4f9c-9946-a70a15b590e2 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:07.867812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:07.909189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 84/166] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:47:07 2022] PUT /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/users/1c6b18f7143e47208f708743d0837b40/roles/abe4ea559dbb48b7a4437bbab79636ab => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:07.910029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5b7c8-a290-48ba-a09f-8dc4eb8f9e84 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:08.014840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 83/167] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:08.016065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c493c3-92a3-4f9c-9946-a70a15b590e2 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:08.170355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5b7c8-a290-48ba-a09f-8dc4eb8f9e84 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:08.185933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:08.229572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c493c3-92a3-4f9c-9946-a70a15b590e2 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:08.238109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:08.252836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e012b7-1090-4126-ad46-2e4a8bc78696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:08.253458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e012b7-1090-4126-ad46-2e4a8bc78696 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:08.253743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e012b7-1090-4126-ad46-2e4a8bc78696 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:08.254019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e012b7-1090-4126-ad46-2e4a8bc78696 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:08.254725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e012b7-1090-4126-ad46-2e4a8bc78696 None admin] RBAC: Adding query filter params (name=member) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:08.255034 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e012b7-1090-4126-ad46-2e4a8bc78696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:08.256414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e012b7-1090-4126-ad46-2e4a8bc78696 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:08.273819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 85/168] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:08.280844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e012b7-1090-4126-ad46-2e4a8bc78696 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:08.304657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e187fe-78e2-4fcb-ab0d-09bcb13af965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:08.305294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e187fe-78e2-4fcb-ab0d-09bcb13af965 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:08.305585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e187fe-78e2-4fcb-ab0d-09bcb13af965 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:08.305851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e187fe-78e2-4fcb-ab0d-09bcb13af965 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:08.330833 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e187fe-78e2-4fcb-ab0d-09bcb13af965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-52e187fe-78e2-4fcb-ab0d-09bcb13af965 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:08.335817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:08.336725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:08.337639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 84/169] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:08.339951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e187fe-78e2-4fcb-ab0d-09bcb13af965 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:08.457953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e012b7-1090-4126-ad46-2e4a8bc78696 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:08.497436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fe04b-5d1b-4379-8cc4-e9f862764252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:08.499052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe04b-5d1b-4379-8cc4-e9f862764252 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:08.499710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe04b-5d1b-4379-8cc4-e9f862764252 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:08.500200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fe04b-5d1b-4379-8cc4-e9f862764252 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:08.501598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fe04b-5d1b-4379-8cc4-e9f862764252 None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:08.503434 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fe04b-5d1b-4379-8cc4-e9f862764252 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:08.505651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 86/170] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:08 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:08.507167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f039-2f0c-46f8-94a6-872e9b4933b5 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:08.507670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f039-2f0c-46f8-94a6-872e9b4933b5 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:08.508242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f039-2f0c-46f8-94a6-872e9b4933b5 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:08.509738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 87/171] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:08.510943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f039-2f0c-46f8-94a6-872e9b4933b5 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:08.529170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e187fe-78e2-4fcb-ab0d-09bcb13af965 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:08.551078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:08.619073 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16bfad-1b40-427c-8062-45d8b592bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:08.626231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16bfad-1b40-427c-8062-45d8b592bc09 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:08.626231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16bfad-1b40-427c-8062-45d8b592bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:08.626231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16bfad-1b40-427c-8062-45d8b592bc09 None admin] PATH_INFO: `/v3/users/465764cb0a1f478290cb4e10c56c3094` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:08.626971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16bfad-1b40-427c-8062-45d8b592bc09 None admin] RBAC: Authorizing `identity:get_user(user_id=465764cb0a1f478290cb4e10c56c3094)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:08.627085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f039-2f0c-46f8-94a6-872e9b4933b5 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:08.628462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16bfad-1b40-427c-8062-45d8b592bc09 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:08.630121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 85/172] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:08 2022] GET /identity/v3/users/465764cb0a1f478290cb4e10c56c3094 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:08.631023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16bfad-1b40-427c-8062-45d8b592bc09 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:08.669783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b0e71-f950-43b8-ab2b-5fe5e3e1772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:08.670471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b0e71-f950-43b8-ab2b-5fe5e3e1772d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:08.670922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b0e71-f950-43b8-ab2b-5fe5e3e1772d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:08.671258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b0e71-f950-43b8-ab2b-5fe5e3e1772d None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:08.671943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b0e71-f950-43b8-ab2b-5fe5e3e1772d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:08.672304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b0e71-f950-43b8-ab2b-5fe5e3e1772d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:08.673695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b0e71-f950-43b8-ab2b-5fe5e3e1772d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:08.682856 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 88/173] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:08.684254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76571566-7b6f-4776-a97b-7dcf5acb32df None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:08.684552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76571566-7b6f-4776-a97b-7dcf5acb32df None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:08.684830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76571566-7b6f-4776-a97b-7dcf5acb32df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:08.705478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-76571566-7b6f-4776-a97b-7dcf5acb32df None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:08.706934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-76571566-7b6f-4776-a97b-7dcf5acb32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:08.712175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:08.780294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 89/174] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:08.781312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76571566-7b6f-4776-a97b-7dcf5acb32df None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:08.811133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:08.860897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16bfad-1b40-427c-8062-45d8b592bc09 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:08.888679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76571566-7b6f-4776-a97b-7dcf5acb32df None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:08.925361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729d3dc-c96b-4781-a023-e53366c9540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:08.926021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729d3dc-c96b-4781-a023-e53366c9540a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:08.926327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729d3dc-c96b-4781-a023-e53366c9540a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:08.926604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729d3dc-c96b-4781-a023-e53366c9540a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:08.930942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51a568-2d48-4e00-9dff-b7cd6ea887c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:08.931567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51a568-2d48-4e00-9dff-b7cd6ea887c1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:08.931841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51a568-2d48-4e00-9dff-b7cd6ea887c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:08.932110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51a568-2d48-4e00-9dff-b7cd6ea887c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:08.932853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51a568-2d48-4e00-9dff-b7cd6ea887c1 None admin] RBAC: Adding query filter params (role.id=5fb006eca1744bd592b59b08b23ef7f2, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784, user.id=465764cb0a1f478290cb4e10c56c3094) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:08.933159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51a568-2d48-4e00-9dff-b7cd6ea887c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:08.934639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51a568-2d48-4e00-9dff-b7cd6ea887c1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:08.942121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 86/175] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:08 2022] GET /identity/v3/role_assignments?user.id=465764cb0a1f478290cb4e10c56c3094&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:08.951439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51a568-2d48-4e00-9dff-b7cd6ea887c1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:09.004455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729d3dc-c96b-4781-a023-e53366c9540a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:09.005909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729d3dc-c96b-4781-a023-e53366c9540a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:09.086659 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:09.114067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 90/176] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:09.119430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729d3dc-c96b-4781-a023-e53366c9540a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:09.130541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:09.137074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51a568-2d48-4e00-9dff-b7cd6ea887c1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:09.239118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1563a9-c6d8-4950-87b6-be25a8375445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:09.239874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1563a9-c6d8-4950-87b6-be25a8375445 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:09.240156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1563a9-c6d8-4950-87b6-be25a8375445 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:09.240433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1563a9-c6d8-4950-87b6-be25a8375445 None admin] PATH_INFO: `/v3/users/465764cb0a1f478290cb4e10c56c3094` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:09.247162 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1563a9-c6d8-4950-87b6-be25a8375445 None admin] RBAC: Authorizing `identity:get_user(user_id=465764cb0a1f478290cb4e10c56c3094)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:09.249401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1563a9-c6d8-4950-87b6-be25a8375445 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:09.251293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 87/177] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:08 2022] GET /identity/v3/users/465764cb0a1f478290cb4e10c56c3094 => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:09.259464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1563a9-c6d8-4950-87b6-be25a8375445 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:09.261813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729d3dc-c96b-4781-a023-e53366c9540a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:09.311207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:09.314791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7adc61-01a1-454e-9f25-bff0e7191f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:09.315506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7adc61-01a1-454e-9f25-bff0e7191f95 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:09.316055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7adc61-01a1-454e-9f25-bff0e7191f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:09.316345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7adc61-01a1-454e-9f25-bff0e7191f95 None admin] PATH_INFO: `/v3/projects/b3a661c42d054bea9c90f745e6642ab2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:09.318492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7adc61-01a1-454e-9f25-bff0e7191f95 None admin] RBAC: Authorizing `identity:get_project(project_id=b3a661c42d054bea9c90f745e6642ab2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:09.323258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7adc61-01a1-454e-9f25-bff0e7191f95 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:09.323258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 91/178] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:09 2022] GET /identity/v3/projects/b3a661c42d054bea9c90f745e6642ab2 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:09.330173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7adc61-01a1-454e-9f25-bff0e7191f95 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:09.447623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1563a9-c6d8-4950-87b6-be25a8375445 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:09.491015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1829c0b-89cb-4fcc-ac00-2def84373781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:09.491633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829c0b-89cb-4fcc-ac00-2def84373781 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:09.491915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829c0b-89cb-4fcc-ac00-2def84373781 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:09.492191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829c0b-89cb-4fcc-ac00-2def84373781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:09.492745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7adc61-01a1-454e-9f25-bff0e7191f95 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:09.528112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:09.530876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b31b76-ff41-45f1-a80f-9b98e087bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:09.531508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b31b76-ff41-45f1-a80f-9b98e087bf73 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:09.531788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b31b76-ff41-45f1-a80f-9b98e087bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:09.532062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b31b76-ff41-45f1-a80f-9b98e087bf73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:09.532799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b31b76-ff41-45f1-a80f-9b98e087bf73 None admin] RBAC: Adding query filter params (role.id=5fb006eca1744bd592b59b08b23ef7f2, scope.project.id=b3a661c42d054bea9c90f745e6642ab2, user.id=465764cb0a1f478290cb4e10c56c3094) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:09.533113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b31b76-ff41-45f1-a80f-9b98e087bf73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:09.534636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b31b76-ff41-45f1-a80f-9b98e087bf73 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:09.541712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 92/179] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:09 2022] GET /identity/v3/role_assignments?user.id=465764cb0a1f478290cb4e10c56c3094&scope.project.id=b3a661c42d054bea9c90f745e6642ab2&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:09.542676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b31b76-ff41-45f1-a80f-9b98e087bf73 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:09.585353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1829c0b-89cb-4fcc-ac00-2def84373781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:09.586961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1829c0b-89cb-4fcc-ac00-2def84373781 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:09.644835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:09.696167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b31b76-ff41-45f1-a80f-9b98e087bf73 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:09.726445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 88/180] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:09.732948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e026ee8-e830-4687-a930-eb32862b6d64 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:09.733234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e026ee8-e830-4687-a930-eb32862b6d64 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:09.733536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e026ee8-e830-4687-a930-eb32862b6d64 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:09.735135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 89/181] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:09.735992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915c9cc-6238-42fc-a123-5edbe8ba1fcd None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:09.736500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915c9cc-6238-42fc-a123-5edbe8ba1fcd None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:09.736500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915c9cc-6238-42fc-a123-5edbe8ba1fcd None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:09.742917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 90/182] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:09.743781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915c9cc-6238-42fc-a123-5edbe8ba1fcd None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:09.744923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f303e-655c-40d8-a5c3-aa3ea2c5033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:09.745575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f303e-655c-40d8-a5c3-aa3ea2c5033f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:09.745908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f303e-655c-40d8-a5c3-aa3ea2c5033f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:09.746191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f303e-655c-40d8-a5c3-aa3ea2c5033f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:09.761635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f303e-655c-40d8-a5c3-aa3ea2c5033f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-c24f303e-655c-40d8-a5c3-aa3ea2c5033f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:09.769743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:09.770686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:09.771468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 93/183] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:09.772617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b482-2708-495b-9291-155357d20fe5 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:09.772617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b482-2708-495b-9291-155357d20fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:09.772920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828b482-2708-495b-9291-155357d20fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:09.793809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-3828b482-2708-495b-9291-155357d20fe5 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:09.795501 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3828b482-2708-495b-9291-155357d20fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:09.822321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:09.862469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915c9cc-6238-42fc-a123-5edbe8ba1fcd None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:09.898809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7ffb5-6c0f-4181-b2ae-500e107510de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:09.899433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7ffb5-6c0f-4181-b2ae-500e107510de None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:09.899709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7ffb5-6c0f-4181-b2ae-500e107510de None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:09.899980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7ffb5-6c0f-4181-b2ae-500e107510de None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:09.901087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7ffb5-6c0f-4181-b2ae-500e107510de None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:09.902555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7ffb5-6c0f-4181-b2ae-500e107510de None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:09.904532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 91/184] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:09 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:09.910511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542786a-b39f-40db-b899-ac9fdf41021c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:09.910809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542786a-b39f-40db-b899-ac9fdf41021c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:09.911058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542786a-b39f-40db-b899-ac9fdf41021c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:09.929173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-8542786a-b39f-40db-b899-ac9fdf41021c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:09.930389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8542786a-b39f-40db-b899-ac9fdf41021c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:09.954237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 94/185] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:09.954237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828b482-2708-495b-9291-155357d20fe5 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:10.005018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:10.019678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 92/186] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:10.020542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542786a-b39f-40db-b899-ac9fdf41021c None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:10.096169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828b482-2708-495b-9291-155357d20fe5 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:10.138787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:10.150761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3fdff-4855-4bec-a5db-6d1d8ab21b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:10.151392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3fdff-4855-4bec-a5db-6d1d8ab21b67 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:10.159477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3fdff-4855-4bec-a5db-6d1d8ab21b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:10.159477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3fdff-4855-4bec-a5db-6d1d8ab21b67 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:10.159477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3fdff-4855-4bec-a5db-6d1d8ab21b67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:10.159477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3fdff-4855-4bec-a5db-6d1d8ab21b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:10.162737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3fdff-4855-4bec-a5db-6d1d8ab21b67 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:10.176422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 95/187] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:10.188787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542786a-b39f-40db-b899-ac9fdf41021c None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:10.191458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3fdff-4855-4bec-a5db-6d1d8ab21b67 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:10.225896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e6db4-f23b-44b6-9b73-ec715a040b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:10.226534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e6db4-f23b-44b6-9b73-ec715a040b4e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:10.226812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e6db4-f23b-44b6-9b73-ec715a040b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:10.227085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e6db4-f23b-44b6-9b73-ec715a040b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:10.228072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e6db4-f23b-44b6-9b73-ec715a040b4e None admin] RBAC: Adding query filter params (role.id=08735f4fc39148328610ad98ba651850, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784, user.id=465764cb0a1f478290cb4e10c56c3094) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:10.228384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e6db4-f23b-44b6-9b73-ec715a040b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:10.229829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e6db4-f23b-44b6-9b73-ec715a040b4e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:10.237250 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 93/188] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:10 2022] GET /identity/v3/role_assignments?user.id=465764cb0a1f478290cb4e10c56c3094&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=08735f4fc39148328610ad98ba651850 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:10.261151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e6db4-f23b-44b6-9b73-ec715a040b4e None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:10.396421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e6db4-f23b-44b6-9b73-ec715a040b4e None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:10.424690 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:10.429308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3fdff-4855-4bec-a5db-6d1d8ab21b67 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:10.433757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b820c-2fe8-429e-b200-114eee1acaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:10.434427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b820c-2fe8-429e-b200-114eee1acaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:10.434705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b820c-2fe8-429e-b200-114eee1acaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:10.434977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b820c-2fe8-429e-b200-114eee1acaa3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:10.436348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b820c-2fe8-429e-b200-114eee1acaa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:10.443808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b820c-2fe8-429e-b200-114eee1acaa3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:10.443808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 94/189] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:10.443808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b820c-2fe8-429e-b200-114eee1acaa3 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:10.448936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:10.481730 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3886f1a-9757-4d90-8db4-7609f850530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:10.485367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3886f1a-9757-4d90-8db4-7609f850530a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:10.485367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3886f1a-9757-4d90-8db4-7609f850530a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:10.485367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3886f1a-9757-4d90-8db4-7609f850530a None admin] PATH_INFO: `/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:10.501717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3886f1a-9757-4d90-8db4-7609f850530a None admin] RBAC: Authorizing `identity:get_user(user_id=ab82c1ecb4a2442ab56e2031cb0ef5de)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:10.503796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3886f1a-9757-4d90-8db4-7609f850530a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:10.509423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 96/190] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:10 2022] GET /identity/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de => generated 283 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:10.509423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3886f1a-9757-4d90-8db4-7609f850530a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:10.579242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b820c-2fe8-429e-b200-114eee1acaa3 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:10.623434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0487b-4080-4e9f-aa88-b04530411d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:10.624097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0487b-4080-4e9f-aa88-b04530411d9a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:10.624350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0487b-4080-4e9f-aa88-b04530411d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:10.624624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0487b-4080-4e9f-aa88-b04530411d9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:10.636328 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0487b-4080-4e9f-aa88-b04530411d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:10.638688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3886f1a-9757-4d90-8db4-7609f850530a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-c1c0487b-4080-4e9f-aa88-b04530411d9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:10.641842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:10.642740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:10.643541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 95/191] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:10.647110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0487b-4080-4e9f-aa88-b04530411d9a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:10.679176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee0ed6-1fe8-42bd-84ab-6d3615f12991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:10.679787 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee0ed6-1fe8-42bd-84ab-6d3615f12991 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:10.680065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee0ed6-1fe8-42bd-84ab-6d3615f12991 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:10.680332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee0ed6-1fe8-42bd-84ab-6d3615f12991 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:10.680977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee0ed6-1fe8-42bd-84ab-6d3615f12991 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:10.682438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee0ed6-1fe8-42bd-84ab-6d3615f12991 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:10.704855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:10.747804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0487b-4080-4e9f-aa88-b04530411d9a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:10.780051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b92ec7-b5c2-4a02-8dc3-9f8278581610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:10.780685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b92ec7-b5c2-4a02-8dc3-9f8278581610 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:10.780962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b92ec7-b5c2-4a02-8dc3-9f8278581610 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:10.781277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b92ec7-b5c2-4a02-8dc3-9f8278581610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:10.793230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 97/192] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:47:10 2022] POST /identity/v3/users => generated 297 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:47:10.794122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee0ed6-1fe8-42bd-84ab-6d3615f12991 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:10.823340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:10.869287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b92ec7-b5c2-4a02-8dc3-9f8278581610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:10.870987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b92ec7-b5c2-4a02-8dc3-9f8278581610 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:10.909312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee0ed6-1fe8-42bd-84ab-6d3615f12991 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:10.932381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:10.946967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b40ad-54a3-4e5f-ae93-d4761f176820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:10.947913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b40ad-54a3-4e5f-ae93-d4761f176820 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:10.948196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b40ad-54a3-4e5f-ae93-d4761f176820 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:10.948487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b40ad-54a3-4e5f-ae93-d4761f176820 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:10.949166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b40ad-54a3-4e5f-ae93-d4761f176820 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:10.949475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b40ad-54a3-4e5f-ae93-d4761f176820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:10.951548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b40ad-54a3-4e5f-ae93-d4761f176820 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:10.960858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 98/193] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:10.961966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209a08-4831-4570-ae81-8c0dbd891318 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:10.962274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209a08-4831-4570-ae81-8c0dbd891318 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:10.962587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209a08-4831-4570-ae81-8c0dbd891318 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:10.964576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 99/194] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:10.967588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209a08-4831-4570-ae81-8c0dbd891318 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:10.991447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 96/195] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:10.997259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd373c0-dc21-46a3-991c-94a879191fdc None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:10.998226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd373c0-dc21-46a3-991c-94a879191fdc None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:10.998472 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd373c0-dc21-46a3-991c-94a879191fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:11.017483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-1bd373c0-dc21-46a3-991c-94a879191fdc None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:11.018720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1bd373c0-dc21-46a3-991c-94a879191fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:11.078057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:11.096493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209a08-4831-4570-ae81-8c0dbd891318 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:11.113145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 97/196] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:11.114621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd373c0-dc21-46a3-991c-94a879191fdc None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:11.145287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b9c2f-2f74-4e84-b24c-44434e0926b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:11.145936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9c2f-2f74-4e84-b24c-44434e0926b1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:11.146260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9c2f-2f74-4e84-b24c-44434e0926b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:11.146522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b9c2f-2f74-4e84-b24c-44434e0926b1 None admin] PATH_INFO: `/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:11.147658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b9c2f-2f74-4e84-b24c-44434e0926b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ab82c1ecb4a2442ab56e2031cb0ef5de)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:11.149109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b9c2f-2f74-4e84-b24c-44434e0926b1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:11.150903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 100/197] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:10 2022] GET /identity/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:11.156995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b9c2f-2f74-4e84-b24c-44434e0926b1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:11.213944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:11.232785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd373c0-dc21-46a3-991c-94a879191fdc None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:11.284677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bafc9-d867-4670-a15d-74cc3c01ceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:11.285333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bafc9-d867-4670-a15d-74cc3c01ceb9 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:11.285611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bafc9-d867-4670-a15d-74cc3c01ceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:11.285885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bafc9-d867-4670-a15d-74cc3c01ceb9 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:11.291029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bafc9-d867-4670-a15d-74cc3c01ceb9 None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:11.292539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bafc9-d867-4670-a15d-74cc3c01ceb9 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:11.293280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b9c2f-2f74-4e84-b24c-44434e0926b1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:11.294199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 98/198] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:11 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:11.300939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bafc9-d867-4670-a15d-74cc3c01ceb9 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:11.333459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e2e03-095d-4486-a6cd-ae016d619566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:11.334246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e2e03-095d-4486-a6cd-ae016d619566 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:11.334541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e2e03-095d-4486-a6cd-ae016d619566 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:11.334817 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e2e03-095d-4486-a6cd-ae016d619566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:11.363274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:11.412867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e2e03-095d-4486-a6cd-ae016d619566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:11.414399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e2e03-095d-4486-a6cd-ae016d619566 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:11.487555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bafc9-d867-4670-a15d-74cc3c01ceb9 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:11.539939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 101/199] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 11:47:11.540936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e2e03-095d-4486-a6cd-ae016d619566 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:11.550301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c8817-a88c-48e9-ab07-bf949c1ad80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:11.550927 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8817-a88c-48e9-ab07-bf949c1ad80a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:11.551587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8817-a88c-48e9-ab07-bf949c1ad80a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:11.551869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8817-a88c-48e9-ab07-bf949c1ad80a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:11.552933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c8817-a88c-48e9-ab07-bf949c1ad80a None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=9d227408446e4141a1dcab80c9df19f7, user.id=ab82c1ecb4a2442ab56e2031cb0ef5de) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:11.553310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c8817-a88c-48e9-ab07-bf949c1ad80a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:11.555269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c8817-a88c-48e9-ab07-bf949c1ad80a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:11.563673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 99/200] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:11 2022] GET /identity/v3/role_assignments?user.id=ab82c1ecb4a2442ab56e2031cb0ef5de&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:11.564795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c8817-a88c-48e9-ab07-bf949c1ad80a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:11.592857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:11.610633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:11.656796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e2e03-095d-4486-a6cd-ae016d619566 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:11.689787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c8817-a88c-48e9-ab07-bf949c1ad80a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:11.695558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d329c5-56f5-46c5-bcb1-8fe8f5b3c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:11.696335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d329c5-56f5-46c5-bcb1-8fe8f5b3c024 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:11.696720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d329c5-56f5-46c5-bcb1-8fe8f5b3c024 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:11.697084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d329c5-56f5-46c5-bcb1-8fe8f5b3c024 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:11.708545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d329c5-56f5-46c5-bcb1-8fe8f5b3c024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-c4d329c5-56f5-46c5-bcb1-8fe8f5b3c024 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:11.714311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:11.715265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:11.716132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 102/201] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:11.725015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d329c5-56f5-46c5-bcb1-8fe8f5b3c024 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:11.745190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ced3c5-ded8-4a94-a506-61859fd23925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:11.746106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced3c5-ded8-4a94-a506-61859fd23925 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:11.746564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced3c5-ded8-4a94-a506-61859fd23925 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:11.746988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced3c5-ded8-4a94-a506-61859fd23925 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:11.749031 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ced3c5-ded8-4a94-a506-61859fd23925 None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:11.750890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ced3c5-ded8-4a94-a506-61859fd23925 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:11.752802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 100/202] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:11 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:11.761805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ced3c5-ded8-4a94-a506-61859fd23925 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:11.874300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:11.907964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ced3c5-ded8-4a94-a506-61859fd23925 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:11.958261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d329c5-56f5-46c5-bcb1-8fe8f5b3c024 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:11.980622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed8cd0-7c4f-41d5-88a7-a198f8fa65bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:11.981231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed8cd0-7c4f-41d5-88a7-a198f8fa65bb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:11.981501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed8cd0-7c4f-41d5-88a7-a198f8fa65bb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:11.981772 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed8cd0-7c4f-41d5-88a7-a198f8fa65bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:11.982945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed8cd0-7c4f-41d5-88a7-a198f8fa65bb None admin] RBAC: Adding query filter params (role.id=08735f4fc39148328610ad98ba651850, scope.project.id=9d227408446e4141a1dcab80c9df19f7, user.id=ab82c1ecb4a2442ab56e2031cb0ef5de) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:11.983499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed8cd0-7c4f-41d5-88a7-a198f8fa65bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:11.984945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed8cd0-7c4f-41d5-88a7-a198f8fa65bb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:11.987356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:11.999324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 101/203] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:11 2022] GET /identity/v3/role_assignments?user.id=ab82c1ecb4a2442ab56e2031cb0ef5de&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=08735f4fc39148328610ad98ba651850 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:12.015484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bec286-40ed-4055-ba25-64d89405adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:12.016132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bec286-40ed-4055-ba25-64d89405adba None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:12.016412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bec286-40ed-4055-ba25-64d89405adba None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:12.016684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bec286-40ed-4055-ba25-64d89405adba None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:12.017391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bec286-40ed-4055-ba25-64d89405adba None admin] RBAC: Adding query filter params (name=reader) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:12.017696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bec286-40ed-4055-ba25-64d89405adba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:12.019517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bec286-40ed-4055-ba25-64d89405adba None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:12.037656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 103/204] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:12.043561 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed8cd0-7c4f-41d5-88a7-a198f8fa65bb None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:12.166546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed8cd0-7c4f-41d5-88a7-a198f8fa65bb None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:12.203755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce15bd-931e-4d45-a3d5-a3d6638bab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:12.204409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce15bd-931e-4d45-a3d5-a3d6638bab90 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:12.204682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce15bd-931e-4d45-a3d5-a3d6638bab90 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:12.204951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce15bd-931e-4d45-a3d5-a3d6638bab90 None admin] PATH_INFO: `/v3/users/1c6b18f7143e47208f708743d0837b40` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:12.206129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce15bd-931e-4d45-a3d5-a3d6638bab90 None admin] RBAC: Authorizing `identity:get_user(user_id=1c6b18f7143e47208f708743d0837b40)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:12.207623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce15bd-931e-4d45-a3d5-a3d6638bab90 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:12.209526 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 102/205] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:12 2022] GET /identity/v3/users/1c6b18f7143e47208f708743d0837b40 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:12.215200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bec286-40ed-4055-ba25-64d89405adba None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:12.344398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bec286-40ed-4055-ba25-64d89405adba None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:12.378720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2aa5-83f7-4da1-9f77-c08f1b9694b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:12.379337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2aa5-83f7-4da1-9f77-c08f1b9694b5 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:12.379860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2aa5-83f7-4da1-9f77-c08f1b9694b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:12.380137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2aa5-83f7-4da1-9f77-c08f1b9694b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:12.442037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:12.467547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d2aa5-83f7-4da1-9f77-c08f1b9694b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:12.469083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d2aa5-83f7-4da1-9f77-c08f1b9694b5 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:12.587800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 104/206] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:12.595800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce15bd-931e-4d45-a3d5-a3d6638bab90 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:12.624317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:12.754516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce15bd-931e-4d45-a3d5-a3d6638bab90 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:12.799845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c3f8c-7ad0-49e1-b1e5-156af72da42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:12.800493 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c3f8c-7ad0-49e1-b1e5-156af72da42f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:12.800770 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c3f8c-7ad0-49e1-b1e5-156af72da42f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:12.801039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c3f8c-7ad0-49e1-b1e5-156af72da42f None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:12.802201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c3f8c-7ad0-49e1-b1e5-156af72da42f None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:12.803666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c3f8c-7ad0-49e1-b1e5-156af72da42f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:12.805607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 103/207] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:12 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:12.811572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2aa5-83f7-4da1-9f77-c08f1b9694b5 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:12.929029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:12.963812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2aa5-83f7-4da1-9f77-c08f1b9694b5 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:13.009730 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d147eb-65da-4cbb-8af1-edc672e78075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:13.010769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d147eb-65da-4cbb-8af1-edc672e78075 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:13.011252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d147eb-65da-4cbb-8af1-edc672e78075 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:13.011725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d147eb-65da-4cbb-8af1-edc672e78075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:13.012746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d147eb-65da-4cbb-8af1-edc672e78075 None admin] RBAC: Adding query filter params (role.id=abe4ea559dbb48b7a4437bbab79636ab, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784, user.id=1c6b18f7143e47208f708743d0837b40) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:13.013338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d147eb-65da-4cbb-8af1-edc672e78075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:13.015205 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d147eb-65da-4cbb-8af1-edc672e78075 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:13.021953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 105/208] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:12 2022] GET /identity/v3/role_assignments?user.id=1c6b18f7143e47208f708743d0837b40&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=abe4ea559dbb48b7a4437bbab79636ab => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:13.461192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6708d61-d407-4a27-a77b-ce50c649a931 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:13.461467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6708d61-d407-4a27-a77b-ce50c649a931 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:13.461984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6708d61-d407-4a27-a77b-ce50c649a931 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:13.463594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 104/209] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:13.470780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea922-4d71-4867-95bb-ffac3c10dfad None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:13.471309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea922-4d71-4867-95bb-ffac3c10dfad None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:13.471775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dea922-4d71-4867-95bb-ffac3c10dfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:13.491197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-71dea922-4d71-4867-95bb-ffac3c10dfad None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:13.492720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-71dea922-4d71-4867-95bb-ffac3c10dfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:13.564456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 106/210] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:13.735160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599ef47-e6f8-4cdf-bb61-b603f5e5ef40 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:13.735760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599ef47-e6f8-4cdf-bb61-b603f5e5ef40 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:13.736243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599ef47-e6f8-4cdf-bb61-b603f5e5ef40 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:13.737813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 105/211] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:13.750679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30983efe-3aba-49ab-a354-40ff99c9bc6a None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:13.751447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30983efe-3aba-49ab-a354-40ff99c9bc6a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:13.751853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30983efe-3aba-49ab-a354-40ff99c9bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:13.774270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-30983efe-3aba-49ab-a354-40ff99c9bc6a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:13.775458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-30983efe-3aba-49ab-a354-40ff99c9bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:13.844076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:13.849430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 107/212] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:13.885812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599ef47-e6f8-4cdf-bb61-b603f5e5ef40 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:13.973464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:13.990251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599ef47-e6f8-4cdf-bb61-b603f5e5ef40 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:14.047458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18680ff-5f0b-4acb-a64d-01759f5f269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:14.048436 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18680ff-5f0b-4acb-a64d-01759f5f269a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.049011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18680ff-5f0b-4acb-a64d-01759f5f269a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.049468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18680ff-5f0b-4acb-a64d-01759f5f269a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.067643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18680ff-5f0b-4acb-a64d-01759f5f269a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-a18680ff-5f0b-4acb-a64d-01759f5f269a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:14.078448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:14.079293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:14.080072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:14.082116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 106/213] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:14.093140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30983efe-3aba-49ab-a354-40ff99c9bc6a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:14.150731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18680ff-5f0b-4acb-a64d-01759f5f269a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:14.193838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30983efe-3aba-49ab-a354-40ff99c9bc6a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:14.231099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13353ad-9f08-48e5-bf40-171ce6e4aa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:14.232906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13353ad-9f08-48e5-bf40-171ce6e4aa88 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.233260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13353ad-9f08-48e5-bf40-171ce6e4aa88 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.233624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13353ad-9f08-48e5-bf40-171ce6e4aa88 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.234404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13353ad-9f08-48e5-bf40-171ce6e4aa88 None admin] RBAC: Adding query filter params (name=member) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:14.234773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13353ad-9f08-48e5-bf40-171ce6e4aa88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:14.236236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13353ad-9f08-48e5-bf40-171ce6e4aa88 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:14.245515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 108/214] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:14.251296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13353ad-9f08-48e5-bf40-171ce6e4aa88 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:14.275929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18680ff-5f0b-4acb-a64d-01759f5f269a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:14.319241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:14.325573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488c735-3e1b-48b7-aa08-7bf722fb8960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:14.326756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c735-3e1b-48b7-aa08-7bf722fb8960 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.327213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c735-3e1b-48b7-aa08-7bf722fb8960 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.327933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488c735-3e1b-48b7-aa08-7bf722fb8960 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.330264 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488c735-3e1b-48b7-aa08-7bf722fb8960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:14.331910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488c735-3e1b-48b7-aa08-7bf722fb8960 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:14.334081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 107/215] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:14.339782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488c735-3e1b-48b7-aa08-7bf722fb8960 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:14.359355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:14.376506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13353ad-9f08-48e5-bf40-171ce6e4aa88 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:14.422410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62e53-49ef-421f-8365-a00d1a986e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:14.423052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62e53-49ef-421f-8365-a00d1a986e67 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.423333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62e53-49ef-421f-8365-a00d1a986e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.423605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62e53-49ef-421f-8365-a00d1a986e67 None admin] PATH_INFO: `/v3/users/d42521156fcb4ce581b77d44ea5d0287` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.439247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c62e53-49ef-421f-8365-a00d1a986e67 None admin] RBAC: Authorizing `identity:get_user(user_id=d42521156fcb4ce581b77d44ea5d0287)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:14.441283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c62e53-49ef-421f-8365-a00d1a986e67 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:14.442994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 109/216] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:14 2022] GET /identity/v3/users/d42521156fcb4ce581b77d44ea5d0287 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:14.451699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62e53-49ef-421f-8365-a00d1a986e67 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:14.464567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488c735-3e1b-48b7-aa08-7bf722fb8960 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:14.500948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f6110-73ef-48d7-b55a-051ce2189ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:14.501496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f6110-73ef-48d7-b55a-051ce2189ef4 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.501777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f6110-73ef-48d7-b55a-051ce2189ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.502052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f6110-73ef-48d7-b55a-051ce2189ef4 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.502900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f6110-73ef-48d7-b55a-051ce2189ef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:14.504409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f6110-73ef-48d7-b55a-051ce2189ef4 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:14.564197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62e53-49ef-421f-8365-a00d1a986e67 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:14.584601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:14.602504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8072654-7aef-48fa-bd49-7a3caf2472af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:14.603378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072654-7aef-48fa-bd49-7a3caf2472af None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.603855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072654-7aef-48fa-bd49-7a3caf2472af None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.604299 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072654-7aef-48fa-bd49-7a3caf2472af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.609072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 108/217] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:47:14 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:47:14.620447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1156d70-0747-4f4a-ae30-a202677eef47 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.620732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1156d70-0747-4f4a-ae30-a202677eef47 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.621078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1156d70-0747-4f4a-ae30-a202677eef47 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.622463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 109/218] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:14.624419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedabfb-4d00-4221-b4fa-8b2fa337124c None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.624702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedabfb-4d00-4221-b4fa-8b2fa337124c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.625307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedabfb-4d00-4221-b4fa-8b2fa337124c None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.633419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 110/219] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:14.635065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c787-3514-4b3d-9193-3343b77dfd7a None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.635352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c787-3514-4b3d-9193-3343b77dfd7a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.635626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c787-3514-4b3d-9193-3343b77dfd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.657354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-0e38c787-3514-4b3d-9193-3343b77dfd7a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:14.658661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0e38c787-3514-4b3d-9193-3343b77dfd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:14.692286 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8072654-7aef-48fa-bd49-7a3caf2472af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:14.693824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8072654-7aef-48fa-bd49-7a3caf2472af None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:14.731760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:14.742862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 111/220] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:14.743791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83949cea-ab5a-49d2-a42f-f0eaaeedfd1a None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.748205 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83949cea-ab5a-49d2-a42f-f0eaaeedfd1a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.748205 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83949cea-ab5a-49d2-a42f-f0eaaeedfd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.765002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-83949cea-ab5a-49d2-a42f-f0eaaeedfd1a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:14.766700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-83949cea-ab5a-49d2-a42f-f0eaaeedfd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:14.838346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 110/221] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:14.845280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8072654-7aef-48fa-bd49-7a3caf2472af None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:14.853152 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 112/222] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:14.870730 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:14.955042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8072654-7aef-48fa-bd49-7a3caf2472af None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:14.991049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80484c-4784-42d4-b554-e568ad5f720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:14.991955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80484c-4784-42d4-b554-e568ad5f720a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:14.992389 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80484c-4784-42d4-b554-e568ad5f720a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:14.992813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80484c-4784-42d4-b554-e568ad5f720a None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:14.994141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80484c-4784-42d4-b554-e568ad5f720a None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:14.995795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80484c-4784-42d4-b554-e568ad5f720a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:14.997637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 111/223] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:14 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:15.003719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83949cea-ab5a-49d2-a42f-f0eaaeedfd1a None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:15.023432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80484c-4784-42d4-b554-e568ad5f720a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:15.120763 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83949cea-ab5a-49d2-a42f-f0eaaeedfd1a None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:15.138353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80484c-4784-42d4-b554-e568ad5f720a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:15.141428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:15.151014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:15.159329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62152d-e096-49ab-9955-afcd87594f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:15.160179 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62152d-e096-49ab-9955-afcd87594f33 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:15.160635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62152d-e096-49ab-9955-afcd87594f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:15.161081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62152d-e096-49ab-9955-afcd87594f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:15.162065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62152d-e096-49ab-9955-afcd87594f33 None admin] RBAC: Adding query filter params (role.id=5fb006eca1744bd592b59b08b23ef7f2, scope.project.id=9d227408446e4141a1dcab80c9df19f7, user.id=d42521156fcb4ce581b77d44ea5d0287) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:15.162571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62152d-e096-49ab-9955-afcd87594f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:15.164194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62152d-e096-49ab-9955-afcd87594f33 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:15.171093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 113/224] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:15 2022] GET /identity/v3/role_assignments?user.id=d42521156fcb4ce581b77d44ea5d0287&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:15.172314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62152d-e096-49ab-9955-afcd87594f33 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:15.211551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f39d5f-0a4c-4b15-b1db-ab43955f6056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:15.212572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f39d5f-0a4c-4b15-b1db-ab43955f6056 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:15.213029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f39d5f-0a4c-4b15-b1db-ab43955f6056 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:15.213479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f39d5f-0a4c-4b15-b1db-ab43955f6056 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:15.240712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f39d5f-0a4c-4b15-b1db-ab43955f6056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-e8f39d5f-0a4c-4b15-b1db-ab43955f6056 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:15.255091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:15.256062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:15.256840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:15.261897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 112/225] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:15.266748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f39d5f-0a4c-4b15-b1db-ab43955f6056 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:15.352564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62152d-e096-49ab-9955-afcd87594f33 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:15.421954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff71a9d-2cc4-46b2-a6cc-33f6cea50915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:15.422657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff71a9d-2cc4-46b2-a6cc-33f6cea50915 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:15.422940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff71a9d-2cc4-46b2-a6cc-33f6cea50915 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:15.423223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff71a9d-2cc4-46b2-a6cc-33f6cea50915 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:15.446968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f39d5f-0a4c-4b15-b1db-ab43955f6056 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:15.451740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff71a9d-2cc4-46b2-a6cc-33f6cea50915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-5ff71a9d-2cc4-46b2-a6cc-33f6cea50915 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:15.457202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:15.458623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:15.459889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:15.466531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 114/226] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:15.477192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff71a9d-2cc4-46b2-a6cc-33f6cea50915 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:15.495356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374a86c-cb31-4aff-89be-423b90fddbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:15.495981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374a86c-cb31-4aff-89be-423b90fddbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:15.496254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374a86c-cb31-4aff-89be-423b90fddbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:15.496523 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374a86c-cb31-4aff-89be-423b90fddbc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:15.497204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374a86c-cb31-4aff-89be-423b90fddbc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:15.498021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374a86c-cb31-4aff-89be-423b90fddbc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:15.499514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374a86c-cb31-4aff-89be-423b90fddbc4 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:15.517930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 113/227] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:15.527310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374a86c-cb31-4aff-89be-423b90fddbc4 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:15.541241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:15.590122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:15.659896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff71a9d-2cc4-46b2-a6cc-33f6cea50915 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:15.704843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c9ccf-b12b-4d5b-82e0-4ae4a9dd8a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:15.705474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c9ccf-b12b-4d5b-82e0-4ae4a9dd8a75 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:15.705758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c9ccf-b12b-4d5b-82e0-4ae4a9dd8a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:15.706036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c9ccf-b12b-4d5b-82e0-4ae4a9dd8a75 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:15.706748 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c9ccf-b12b-4d5b-82e0-4ae4a9dd8a75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:15.707310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c9ccf-b12b-4d5b-82e0-4ae4a9dd8a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:15.709242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c9ccf-b12b-4d5b-82e0-4ae4a9dd8a75 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:15.720727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 115/228] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:15.727204 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c9ccf-b12b-4d5b-82e0-4ae4a9dd8a75 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:15.743765 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374a86c-cb31-4aff-89be-423b90fddbc4 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:15.812697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd4a7-643b-4843-8b1e-7a55cc9ab7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:15.813728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd4a7-643b-4843-8b1e-7a55cc9ab7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:15.814250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd4a7-643b-4843-8b1e-7a55cc9ab7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:15.814738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd4a7-643b-4843-8b1e-7a55cc9ab7c3 None admin] PATH_INFO: `/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:15.816421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cd4a7-643b-4843-8b1e-7a55cc9ab7c3 None admin] RBAC: Authorizing `identity:get_user(user_id=ab82c1ecb4a2442ab56e2031cb0ef5de)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:15.818996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cd4a7-643b-4843-8b1e-7a55cc9ab7c3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:15.823883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 114/229] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:15 2022] GET /identity/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de => generated 283 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:15.828342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd4a7-643b-4843-8b1e-7a55cc9ab7c3 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:15.931826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c9ccf-b12b-4d5b-82e0-4ae4a9dd8a75 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:15.970624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:15.980017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78beaee0-613a-40ef-b571-807a0cd761e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:15.981175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beaee0-613a-40ef-b571-807a0cd761e1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:15.981703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beaee0-613a-40ef-b571-807a0cd761e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:15.982874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beaee0-613a-40ef-b571-807a0cd761e1 None admin] PATH_INFO: `/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:15.984459 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78beaee0-613a-40ef-b571-807a0cd761e1 None admin] RBAC: Authorizing `identity:get_user(user_id=ab82c1ecb4a2442ab56e2031cb0ef5de)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:15.986128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78beaee0-613a-40ef-b571-807a0cd761e1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:15.988400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 116/230] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:15 2022] GET /identity/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:15.990425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:15.995711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78beaee0-613a-40ef-b571-807a0cd761e1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:16.048158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd4a7-643b-4843-8b1e-7a55cc9ab7c3 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:16.100411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78beaee0-613a-40ef-b571-807a0cd761e1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:16.137637 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7519dd-d81d-405f-80e9-284c7811bcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:16.138728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7519dd-d81d-405f-80e9-284c7811bcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:16.139633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7519dd-d81d-405f-80e9-284c7811bcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:16.140084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7519dd-d81d-405f-80e9-284c7811bcd0 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:16.141408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7519dd-d81d-405f-80e9-284c7811bcd0 None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:16.143201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7519dd-d81d-405f-80e9-284c7811bcd0 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:16.145001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 117/231] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:15 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:16.150669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7519dd-d81d-405f-80e9-284c7811bcd0 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:16.167015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd2bc1-3a39-4e24-a59e-acc53eb754ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:16.167687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2bc1-3a39-4e24-a59e-acc53eb754ac None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:16.167975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2bc1-3a39-4e24-a59e-acc53eb754ac None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:16.168253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2bc1-3a39-4e24-a59e-acc53eb754ac None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:16.174928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd2bc1-3a39-4e24-a59e-acc53eb754ac None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:16.176412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd2bc1-3a39-4e24-a59e-acc53eb754ac None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:16.178417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 115/232] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:15 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:16.187174 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd2bc1-3a39-4e24-a59e-acc53eb754ac None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:16.218596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:16.269530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7519dd-d81d-405f-80e9-284c7811bcd0 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:16.306904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8af42-ac01-4638-b428-ebd152346f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:16.307911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8af42-ac01-4638-b428-ebd152346f2e None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:16.308387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8af42-ac01-4638-b428-ebd152346f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:16.308850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8af42-ac01-4638-b428-ebd152346f2e None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7/users/ab82c1ecb4a2442ab56e2031cb0ef5de/roles/08735f4fc39148328610ad98ba651850` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:16.311479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8af42-ac01-4638-b428-ebd152346f2e None admin] RBAC: Authorizing `identity:create_grant(project_id=9d227408446e4141a1dcab80c9df19f7, user_id=ab82c1ecb4a2442ab56e2031cb0ef5de, role_id=08735f4fc39148328610ad98ba651850)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:16.313118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8af42-ac01-4638-b428-ebd152346f2e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:16.374774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd2bc1-3a39-4e24-a59e-acc53eb754ac None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:16.411551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff3f9-e0c4-4d36-b664-83524785a9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:16.412542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff3f9-e0c4-4d36-b664-83524785a9f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:16.413311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff3f9-e0c4-4d36-b664-83524785a9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:16.420351 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 118/233] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:47:16 2022] PUT /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7/users/ab82c1ecb4a2442ab56e2031cb0ef5de/roles/08735f4fc39148328610ad98ba651850 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 11:47:16.420925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff3f9-e0c4-4d36-b664-83524785a9f7 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7/users/ab82c1ecb4a2442ab56e2031cb0ef5de/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:16.423443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff3f9-e0c4-4d36-b664-83524785a9f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d227408446e4141a1dcab80c9df19f7, user_id=ab82c1ecb4a2442ab56e2031cb0ef5de, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:16.425409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ff3f9-e0c4-4d36-b664-83524785a9f7 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:16.514581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 116/234] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:47:16 2022] PUT /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7/users/ab82c1ecb4a2442ab56e2031cb0ef5de/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:17.342202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46523e47-3228-4481-aad7-4ad2e2644654 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:17.342749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46523e47-3228-4481-aad7-4ad2e2644654 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:17.342825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46523e47-3228-4481-aad7-4ad2e2644654 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:17.344324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 119/235] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:17.352955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651f75-05bb-4bbf-9b36-f1ada3fdf29d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:17.352955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651f75-05bb-4bbf-9b36-f1ada3fdf29d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:17.352955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651f75-05bb-4bbf-9b36-f1ada3fdf29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:17.365303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:17.371086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-59651f75-05bb-4bbf-9b36-f1ada3fdf29d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:17.372308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-59651f75-05bb-4bbf-9b36-f1ada3fdf29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:17.445896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 117/236] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:17.679370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f975-5d87-4bb1-9484-f698f0ca245b None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:17.679716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f975-5d87-4bb1-9484-f698f0ca245b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:17.679924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f975-5d87-4bb1-9484-f698f0ca245b None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:17.681515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 120/237] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:17.688216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fcdfe-db87-440f-8a9d-6e72226f05c3 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:17.688528 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fcdfe-db87-440f-8a9d-6e72226f05c3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:17.688774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fcdfe-db87-440f-8a9d-6e72226f05c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:17.720173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-915fcdfe-db87-440f-8a9d-6e72226f05c3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:17.721364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-915fcdfe-db87-440f-8a9d-6e72226f05c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:17.802738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 118/238] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:17.813819 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285911b6-4896-447c-9085-9c97682259cc None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:17.813819 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285911b6-4896-447c-9085-9c97682259cc None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:17.814156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285911b6-4896-447c-9085-9c97682259cc None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:17.816087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 121/239] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:17.821352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19574b5b-23b9-4301-aa36-4bbab47073c4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:17.821876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19574b5b-23b9-4301-aa36-4bbab47073c4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:17.822394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19574b5b-23b9-4301-aa36-4bbab47073c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:17.828281 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285911b6-4896-447c-9085-9c97682259cc None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:17.850014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-19574b5b-23b9-4301-aa36-4bbab47073c4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:17.851242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-19574b5b-23b9-4301-aa36-4bbab47073c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:17.950884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:17.959935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 119/240] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:18.008665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285911b6-4896-447c-9085-9c97682259cc None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:18.021007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:18.045338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35882a-847b-43f1-a84d-96140a3bd7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:18.045965 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35882a-847b-43f1-a84d-96140a3bd7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:18.046260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35882a-847b-43f1-a84d-96140a3bd7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:18.046536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35882a-847b-43f1-a84d-96140a3bd7d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:18.057073 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35882a-847b-43f1-a84d-96140a3bd7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-cc35882a-847b-43f1-a84d-96140a3bd7d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:18.062164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:18.063049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:18.063838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:18.067758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 122/241] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:18.073727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19574b5b-23b9-4301-aa36-4bbab47073c4 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:18.126011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35882a-847b-43f1-a84d-96140a3bd7d2 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:18.237941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35882a-847b-43f1-a84d-96140a3bd7d2 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:18.265366 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19574b5b-23b9-4301-aa36-4bbab47073c4 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:18.301301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e9df1-5730-4ce5-ae22-c703d13b5099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:18.301964 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e9df1-5730-4ce5-ae22-c703d13b5099 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:18.302300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e9df1-5730-4ce5-ae22-c703d13b5099 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:18.302580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e9df1-5730-4ce5-ae22-c703d13b5099 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:18.303531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e9df1-5730-4ce5-ae22-c703d13b5099 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:18.303833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e9df1-5730-4ce5-ae22-c703d13b5099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:18.305252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e9df1-5730-4ce5-ae22-c703d13b5099 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:18.314718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 120/242] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:18.320467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e9df1-5730-4ce5-ae22-c703d13b5099 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:18.325655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1581a87-364c-4bfa-a28d-f585ecb1ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:18.331877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1581a87-364c-4bfa-a28d-f585ecb1ec3d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:18.332170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1581a87-364c-4bfa-a28d-f585ecb1ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:18.332440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1581a87-364c-4bfa-a28d-f585ecb1ec3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:18.333718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1581a87-364c-4bfa-a28d-f585ecb1ec3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:18.335300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1581a87-364c-4bfa-a28d-f585ecb1ec3d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:18.337528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 123/243] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:18.342264 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1581a87-364c-4bfa-a28d-f585ecb1ec3d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:18.394356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:18.399796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:18.448687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e9df1-5730-4ce5-ae22-c703d13b5099 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:18.473246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1581a87-364c-4bfa-a28d-f585ecb1ec3d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:18.491305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3016e-732a-4229-93e3-382f7958ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:18.492283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3016e-732a-4229-93e3-382f7958ca23 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:18.492770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3016e-732a-4229-93e3-382f7958ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:18.493227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3016e-732a-4229-93e3-382f7958ca23 None admin] PATH_INFO: `/v3/users/ce64cfa96bfa4c24a9cfd07500b03440` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:18.510896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3016e-732a-4229-93e3-382f7958ca23 None admin] RBAC: Authorizing `identity:get_user(user_id=ce64cfa96bfa4c24a9cfd07500b03440)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:18.512782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3016e-732a-4229-93e3-382f7958ca23 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:18.515618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 121/244] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:18 2022] GET /identity/v3/users/ce64cfa96bfa4c24a9cfd07500b03440 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:18.516646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3016e-732a-4229-93e3-382f7958ca23 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:18.522735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b9f20-8513-4cfa-8b6d-a11eada89a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:18.523389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b9f20-8513-4cfa-8b6d-a11eada89a83 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:18.523672 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b9f20-8513-4cfa-8b6d-a11eada89a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:18.523954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b9f20-8513-4cfa-8b6d-a11eada89a83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:18.538196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b9f20-8513-4cfa-8b6d-a11eada89a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-651b9f20-8513-4cfa-8b6d-a11eada89a83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:18.545093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:18.545966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:18.546883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:18.547489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 124/245] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:18.550921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b9f20-8513-4cfa-8b6d-a11eada89a83 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:18.657824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3016e-732a-4229-93e3-382f7958ca23 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:18.672106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:18.676481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b9f20-8513-4cfa-8b6d-a11eada89a83 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:18.677850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:18.697509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae589a-b7d0-45ea-9662-4dea9b33ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:18.701676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae589a-b7d0-45ea-9662-4dea9b33ab69 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:18.701676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae589a-b7d0-45ea-9662-4dea9b33ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:18.701676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae589a-b7d0-45ea-9662-4dea9b33ab69 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:18.701676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae589a-b7d0-45ea-9662-4dea9b33ab69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:18.702315 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae589a-b7d0-45ea-9662-4dea9b33ab69 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:18.713390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb118dc-21e7-4359-adb7-71055cba2e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:18.714017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb118dc-21e7-4359-adb7-71055cba2e21 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:18.714589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb118dc-21e7-4359-adb7-71055cba2e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:18.714697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb118dc-21e7-4359-adb7-71055cba2e21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:18.787047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb118dc-21e7-4359-adb7-71055cba2e21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:18.788455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb118dc-21e7-4359-adb7-71055cba2e21 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:18.835314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 122/246] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:47:18 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:47:18.837377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae589a-b7d0-45ea-9662-4dea9b33ab69 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:18.928473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:18.937347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 125/247] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:18.943728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb118dc-21e7-4359-adb7-71055cba2e21 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:19.014991 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae589a-b7d0-45ea-9662-4dea9b33ab69 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:19.090829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552817d-8b99-407f-afb8-a0579533d6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:19.092958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552817d-8b99-407f-afb8-a0579533d6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.093435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552817d-8b99-407f-afb8-a0579533d6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.094151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552817d-8b99-407f-afb8-a0579533d6c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.095034 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552817d-8b99-407f-afb8-a0579533d6c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:19.095770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552817d-8b99-407f-afb8-a0579533d6c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:19.098119 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552817d-8b99-407f-afb8-a0579533d6c1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:19.099477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb118dc-21e7-4359-adb7-71055cba2e21 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:19.110858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 123/248] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:19.112912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49030-16ef-4695-8d13-f67e4ca5eb5b None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.113354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49030-16ef-4695-8d13-f67e4ca5eb5b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.113768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49030-16ef-4695-8d13-f67e4ca5eb5b None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.115947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 124/249] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:19.116941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a49030-16ef-4695-8d13-f67e4ca5eb5b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:19.156115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5181957-8b6f-43d8-a329-8143d13ec3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:19.157122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181957-8b6f-43d8-a329-8143d13ec3ac None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.157399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181957-8b6f-43d8-a329-8143d13ec3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.157674 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181957-8b6f-43d8-a329-8143d13ec3ac None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.158866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5181957-8b6f-43d8-a329-8143d13ec3ac None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:19.160487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5181957-8b6f-43d8-a329-8143d13ec3ac None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:19.162289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 126/250] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:18 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:19.164155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d01c-98f6-44fa-a5ef-a01d3a95dcba None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.164439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d01c-98f6-44fa-a5ef-a01d3a95dcba None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.164760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d01c-98f6-44fa-a5ef-a01d3a95dcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.172409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:19.187270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2dc7d01c-98f6-44fa-a5ef-a01d3a95dcba None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:19.188565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2dc7d01c-98f6-44fa-a5ef-a01d3a95dcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:19.251974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a49030-16ef-4695-8d13-f67e4ca5eb5b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:19.259656 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:19.268450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 127/251] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:19.269357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d01c-98f6-44fa-a5ef-a01d3a95dcba None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:19.295379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b261f2-0910-4efc-9869-51d435785d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:19.296023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b261f2-0910-4efc-9869-51d435785d83 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.296306 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b261f2-0910-4efc-9869-51d435785d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.296577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b261f2-0910-4efc-9869-51d435785d83 None admin] PATH_INFO: `/v3/users/d42521156fcb4ce581b77d44ea5d0287` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.297712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b261f2-0910-4efc-9869-51d435785d83 None admin] RBAC: Authorizing `identity:get_user(user_id=d42521156fcb4ce581b77d44ea5d0287)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:19.299373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b261f2-0910-4efc-9869-51d435785d83 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:19.301111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 125/252] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:19 2022] GET /identity/v3/users/d42521156fcb4ce581b77d44ea5d0287 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:19.301982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770325f-3b88-40b6-8ecd-1deb324f017b None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.303061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770325f-3b88-40b6-8ecd-1deb324f017b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.303061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770325f-3b88-40b6-8ecd-1deb324f017b None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.303767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 126/253] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:19.307881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770325f-3b88-40b6-8ecd-1deb324f017b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:19.414584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d01c-98f6-44fa-a5ef-a01d3a95dcba None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:19.450051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770325f-3b88-40b6-8ecd-1deb324f017b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:19.453261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:19.456467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074a5ef-a567-4db6-b364-5db0251a51a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:19.457078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a5ef-a567-4db6-b364-5db0251a51a0 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.457354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a5ef-a567-4db6-b364-5db0251a51a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.457625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a5ef-a567-4db6-b364-5db0251a51a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.458764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074a5ef-a567-4db6-b364-5db0251a51a0 None admin] RBAC: Adding query filter params (role.id=abe4ea559dbb48b7a4437bbab79636ab, scope.project.id=9d227408446e4141a1dcab80c9df19f7, user.id=ce64cfa96bfa4c24a9cfd07500b03440) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:19.458764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074a5ef-a567-4db6-b364-5db0251a51a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:19.460247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074a5ef-a567-4db6-b364-5db0251a51a0 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:19.467158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 128/254] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:19 2022] GET /identity/v3/role_assignments?user.id=ce64cfa96bfa4c24a9cfd07500b03440&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=abe4ea559dbb48b7a4437bbab79636ab => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:19.468579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a8d9-02a9-43c6-8b15-6418a5714526 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.468860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a8d9-02a9-43c6-8b15-6418a5714526 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.469127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a8d9-02a9-43c6-8b15-6418a5714526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.491536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-60d7a8d9-02a9-43c6-8b15-6418a5714526 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:19.492943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-60d7a8d9-02a9-43c6-8b15-6418a5714526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:19.495427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf9bc3-44ec-4aeb-a835-7e04e8a94552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:19.496374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9bc3-44ec-4aeb-a835-7e04e8a94552 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.496856 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9bc3-44ec-4aeb-a835-7e04e8a94552 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.497399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9bc3-44ec-4aeb-a835-7e04e8a94552 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.499454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf9bc3-44ec-4aeb-a835-7e04e8a94552 None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:19.501439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf9bc3-44ec-4aeb-a835-7e04e8a94552 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:19.503929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 127/255] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:19 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:19.511704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf9bc3-44ec-4aeb-a835-7e04e8a94552 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:19.588057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:19.605432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 129/256] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:19.696245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf9bc3-44ec-4aeb-a835-7e04e8a94552 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:19.725890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a8d9-02a9-43c6-8b15-6418a5714526 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:19.754483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea389f-09a1-4335-90e6-18ea28aac672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:19.755166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea389f-09a1-4335-90e6-18ea28aac672 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.755447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea389f-09a1-4335-90e6-18ea28aac672 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.755722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea389f-09a1-4335-90e6-18ea28aac672 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7/users/d42521156fcb4ce581b77d44ea5d0287/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.758646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea389f-09a1-4335-90e6-18ea28aac672 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d227408446e4141a1dcab80c9df19f7, user_id=d42521156fcb4ce581b77d44ea5d0287, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:19.760426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea389f-09a1-4335-90e6-18ea28aac672 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:19.852587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a8d9-02a9-43c6-8b15-6418a5714526 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:19.856823 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 128/257] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:47:19 2022] PUT /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7/users/d42521156fcb4ce581b77d44ea5d0287/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:19.897310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a4ad1-496e-446b-be95-b8a734a90216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:19.898513 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a4ad1-496e-446b-be95-b8a734a90216 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:19.899164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a4ad1-496e-446b-be95-b8a734a90216 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:19.899638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a4ad1-496e-446b-be95-b8a734a90216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:19.912473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a4ad1-496e-446b-be95-b8a734a90216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-e28a4ad1-496e-446b-be95-b8a734a90216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:19.918446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:19.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:19.920490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:19.923523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 130/258] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:47:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:19.930977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea389f-09a1-4335-90e6-18ea28aac672 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:19.971738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:20.063073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea389f-09a1-4335-90e6-18ea28aac672 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:20.110952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4318-ac0d-4bef-a1b5-c248834d0707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:20.111587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4318-ac0d-4bef-a1b5-c248834d0707 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:20.111874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4318-ac0d-4bef-a1b5-c248834d0707 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:20.112155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4318-ac0d-4bef-a1b5-c248834d0707 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:20.112849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4318-ac0d-4bef-a1b5-c248834d0707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:20.114315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a4ad1-496e-446b-be95-b8a734a90216 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:20.117989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4318-ac0d-4bef-a1b5-c248834d0707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:20.133056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4318-ac0d-4bef-a1b5-c248834d0707 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:20.153453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 129/259] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:20.160191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4318-ac0d-4bef-a1b5-c248834d0707 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:20.219416 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:20.268320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a4ad1-496e-446b-be95-b8a734a90216 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:20.312358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:20.327990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4318-ac0d-4bef-a1b5-c248834d0707 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:20.334094 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6438c-8362-46c2-a3f0-7dd0657adad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:20.334765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6438c-8362-46c2-a3f0-7dd0657adad1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:20.335044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6438c-8362-46c2-a3f0-7dd0657adad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:20.335315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6438c-8362-46c2-a3f0-7dd0657adad1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:20.356923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6438c-8362-46c2-a3f0-7dd0657adad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-9ff6438c-8362-46c2-a3f0-7dd0657adad1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:20.363095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:20.364056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:20.364843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 131/260] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:20.372095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6438c-8362-46c2-a3f0-7dd0657adad1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:20.421890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09ce4b-489d-4514-aec6-474c55a8087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:20.422575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09ce4b-489d-4514-aec6-474c55a8087b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:20.422857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09ce4b-489d-4514-aec6-474c55a8087b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:20.423129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09ce4b-489d-4514-aec6-474c55a8087b None admin] PATH_INFO: `/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:20.424317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09ce4b-489d-4514-aec6-474c55a8087b None admin] RBAC: Authorizing `identity:get_user(user_id=ab82c1ecb4a2442ab56e2031cb0ef5de)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:20.425944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09ce4b-489d-4514-aec6-474c55a8087b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:20.427673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 130/261] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:20 2022] GET /identity/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:20.432988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09ce4b-489d-4514-aec6-474c55a8087b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:20.554470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6438c-8362-46c2-a3f0-7dd0657adad1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:20.577967 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:20.650064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61571d4f-0e35-429b-8a98-bf527df84a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:20.650702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61571d4f-0e35-429b-8a98-bf527df84a72 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:20.650977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61571d4f-0e35-429b-8a98-bf527df84a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:20.651242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61571d4f-0e35-429b-8a98-bf527df84a72 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:20.651906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61571d4f-0e35-429b-8a98-bf527df84a72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:20.652202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61571d4f-0e35-429b-8a98-bf527df84a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:20.654183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61571d4f-0e35-429b-8a98-bf527df84a72 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:20.668034 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 132/262] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:20.675012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61571d4f-0e35-429b-8a98-bf527df84a72 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:20.678446 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09ce4b-489d-4514-aec6-474c55a8087b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:20.750399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1753a-c442-4edc-9689-b4e3eba63659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:20.751078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1753a-c442-4edc-9689-b4e3eba63659 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:20.751360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1753a-c442-4edc-9689-b4e3eba63659 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:20.751637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1753a-c442-4edc-9689-b4e3eba63659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:20.805017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:20.844595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61571d4f-0e35-429b-8a98-bf527df84a72 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:20.879169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1753a-c442-4edc-9689-b4e3eba63659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:20.881199 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1753a-c442-4edc-9689-b4e3eba63659 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:20.916336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fd3b5-e7b9-4b61-a88e-4f2a863eaccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:20.916979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fd3b5-e7b9-4b61-a88e-4f2a863eaccc None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:20.917261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fd3b5-e7b9-4b61-a88e-4f2a863eaccc None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:20.917532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fd3b5-e7b9-4b61-a88e-4f2a863eaccc None admin] PATH_INFO: `/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:20.925943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fd3b5-e7b9-4b61-a88e-4f2a863eaccc None admin] RBAC: Authorizing `identity:get_user(user_id=ab82c1ecb4a2442ab56e2031cb0ef5de)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:20.925943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fd3b5-e7b9-4b61-a88e-4f2a863eaccc None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:20.926178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 133/263] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:20 2022] GET /identity/v3/users/ab82c1ecb4a2442ab56e2031cb0ef5de => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:20.939268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fd3b5-e7b9-4b61-a88e-4f2a863eaccc None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:21.024840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:21.064261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 131/264] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 11:47:21.070902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1753a-c442-4edc-9689-b4e3eba63659 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:21.155423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fd3b5-e7b9-4b61-a88e-4f2a863eaccc None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:21.178617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:21.223424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86bf83-0aca-4bb9-93be-92f716c7e72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:21.224057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86bf83-0aca-4bb9-93be-92f716c7e72d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:21.224405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86bf83-0aca-4bb9-93be-92f716c7e72d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:21.224609 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86bf83-0aca-4bb9-93be-92f716c7e72d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:21.238322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1753a-c442-4edc-9689-b4e3eba63659 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:21.283960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571584df-bab4-4c50-bc1d-28b62311d564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:21.284659 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571584df-bab4-4c50-bc1d-28b62311d564 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:21.284945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571584df-bab4-4c50-bc1d-28b62311d564 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:21.285220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571584df-bab4-4c50-bc1d-28b62311d564 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:21.286395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571584df-bab4-4c50-bc1d-28b62311d564 None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:21.287855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571584df-bab4-4c50-bc1d-28b62311d564 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:21.289513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 132/265] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:21 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:21.295818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571584df-bab4-4c50-bc1d-28b62311d564 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:21.366020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86bf83-0aca-4bb9-93be-92f716c7e72d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:21.367437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86bf83-0aca-4bb9-93be-92f716c7e72d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:21.433451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:21.494576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571584df-bab4-4c50-bc1d-28b62311d564 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:21.534200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 134/266] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:21.540721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86bf83-0aca-4bb9-93be-92f716c7e72d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:21.554812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:21.572995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35959e9d-01ab-4c0d-8385-2066a7425ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:21.574009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959e9d-01ab-4c0d-8385-2066a7425ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:21.574533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959e9d-01ab-4c0d-8385-2066a7425ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:21.575208 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35959e9d-01ab-4c0d-8385-2066a7425ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:21.576202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959e9d-01ab-4c0d-8385-2066a7425ca2 None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=9d227408446e4141a1dcab80c9df19f7, user.id=ab82c1ecb4a2442ab56e2031cb0ef5de) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:21.576756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959e9d-01ab-4c0d-8385-2066a7425ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:21.582638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35959e9d-01ab-4c0d-8385-2066a7425ca2 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:21.596795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 133/267] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:21 2022] GET /identity/v3/role_assignments?user.id=ab82c1ecb4a2442ab56e2031cb0ef5de&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:21.692479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89a4a0-8074-4227-b73a-fefc2d546a4f None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:21.693577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89a4a0-8074-4227-b73a-fefc2d546a4f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:21.694067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89a4a0-8074-4227-b73a-fefc2d546a4f None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:21.695810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 134/268] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:47:21.702132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa881f-1a9a-4538-8527-465b51320e88 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:21.702794 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa881f-1a9a-4538-8527-465b51320e88 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:21.703267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa881f-1a9a-4538-8527-465b51320e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:21.703367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86bf83-0aca-4bb9-93be-92f716c7e72d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:21.739343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-91aa881f-1a9a-4538-8527-465b51320e88 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:21.740886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-91aa881f-1a9a-4538-8527-465b51320e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:21.741605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc58c7-1254-4457-adc3-9a7ecbc1ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:21.742286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc58c7-1254-4457-adc3-9a7ecbc1ffcf None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:21.742580 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc58c7-1254-4457-adc3-9a7ecbc1ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:21.742854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc58c7-1254-4457-adc3-9a7ecbc1ffcf None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:21.744996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc58c7-1254-4457-adc3-9a7ecbc1ffcf None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:21.745548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc58c7-1254-4457-adc3-9a7ecbc1ffcf None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:21.747813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 135/269] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:21 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:21.754745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc58c7-1254-4457-adc3-9a7ecbc1ffcf None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:21.779176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:21.903419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 135/270] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:47:21.906707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc58c7-1254-4457-adc3-9a7ecbc1ffcf None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:21.963067 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e043ab9-648d-46fa-a5ba-2ee6f35a0288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:21.963680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e043ab9-648d-46fa-a5ba-2ee6f35a0288 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:21.963962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e043ab9-648d-46fa-a5ba-2ee6f35a0288 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:21.964237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e043ab9-648d-46fa-a5ba-2ee6f35a0288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:21.964981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e043ab9-648d-46fa-a5ba-2ee6f35a0288 None admin] RBAC: Adding query filter params (role.id=08735f4fc39148328610ad98ba651850, scope.project.id=9d227408446e4141a1dcab80c9df19f7, user.id=ab82c1ecb4a2442ab56e2031cb0ef5de) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:21.965290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e043ab9-648d-46fa-a5ba-2ee6f35a0288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:21.967462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e043ab9-648d-46fa-a5ba-2ee6f35a0288 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:21.973921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 136/271] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:21 2022] GET /identity/v3/role_assignments?user.id=ab82c1ecb4a2442ab56e2031cb0ef5de&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=08735f4fc39148328610ad98ba651850 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:22.315808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d4858-4b5a-445b-995c-eba8ec2adfa4 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:22.316042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d4858-4b5a-445b-995c-eba8ec2adfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:22.316296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d4858-4b5a-445b-995c-eba8ec2adfa4 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:22.317950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 136/272] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:22.323618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ea910-323f-487a-a543-ab74ddf145d3 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:22.323904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ea910-323f-487a-a543-ab74ddf145d3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:22.324183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ea910-323f-487a-a543-ab74ddf145d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:22.342877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d4858-4b5a-445b-995c-eba8ec2adfa4 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:22.349136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-427ea910-323f-487a-a543-ab74ddf145d3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:22.350390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-427ea910-323f-487a-a543-ab74ddf145d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:22.444764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 137/273] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:47:22.476150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d4858-4b5a-445b-995c-eba8ec2adfa4 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:22.500297 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:22.512003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96de5e8-362d-4fa9-9118-f16038438b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:22.517408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96de5e8-362d-4fa9-9118-f16038438b50 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:22.517408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96de5e8-362d-4fa9-9118-f16038438b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:22.517408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96de5e8-362d-4fa9-9118-f16038438b50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:22.524192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96de5e8-362d-4fa9-9118-f16038438b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-d96de5e8-362d-4fa9-9118-f16038438b50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:22.529820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:22.530711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:22.531490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 137/274] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:22.539501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ea910-323f-487a-a543-ab74ddf145d3 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:22.542782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:22.654572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ea910-323f-487a-a543-ab74ddf145d3 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:22.691030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb1a3a-a43b-4806-8592-ac8b99f87b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:22.691640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1a3a-a43b-4806-8592-ac8b99f87b3d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:22.691924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1a3a-a43b-4806-8592-ac8b99f87b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:22.692197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1a3a-a43b-4806-8592-ac8b99f87b3d None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:22.692871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb1a3a-a43b-4806-8592-ac8b99f87b3d None admin] RBAC: Adding query filter params (name=member) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:22.693232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb1a3a-a43b-4806-8592-ac8b99f87b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:22.694698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb1a3a-a43b-4806-8592-ac8b99f87b3d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:22.703775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 138/275] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:22.712052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96de5e8-362d-4fa9-9118-f16038438b50 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:22.752306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb1a3a-a43b-4806-8592-ac8b99f87b3d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:22.832251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:22.832566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96de5e8-362d-4fa9-9118-f16038438b50 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:22.874200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd132d6-bd83-45ea-906b-5dd86f783e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:22.875242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd132d6-bd83-45ea-906b-5dd86f783e3f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:22.875690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd132d6-bd83-45ea-906b-5dd86f783e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:22.875965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd132d6-bd83-45ea-906b-5dd86f783e3f None admin] PATH_INFO: `/v3/users/a85c4e6602244208acdf2ba07f75fb93` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:22.882033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb1a3a-a43b-4806-8592-ac8b99f87b3d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:22.889499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd132d6-bd83-45ea-906b-5dd86f783e3f None admin] RBAC: Authorizing `identity:get_user(user_id=a85c4e6602244208acdf2ba07f75fb93)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:22.890990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd132d6-bd83-45ea-906b-5dd86f783e3f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:22.892630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 138/276] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:22 2022] GET /identity/v3/users/a85c4e6602244208acdf2ba07f75fb93 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:22.892630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fdc8c-7195-474b-bb93-86b77cadca41 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:22.892630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fdc8c-7195-474b-bb93-86b77cadca41 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:22.892630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fdc8c-7195-474b-bb93-86b77cadca41 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:22.892630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 139/277] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:22.899068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fdc8c-7195-474b-bb93-86b77cadca41 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:22.923885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1d33d-119e-46af-bf32-9c42c9e49d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:22.924519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d33d-119e-46af-bf32-9c42c9e49d29 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:22.924914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d33d-119e-46af-bf32-9c42c9e49d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:22.925197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1d33d-119e-46af-bf32-9c42c9e49d29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:22.926439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1d33d-119e-46af-bf32-9c42c9e49d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:22.928018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1d33d-119e-46af-bf32-9c42c9e49d29 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:22.934165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 139/278] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:22.934165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3384d-f83d-48de-ad4d-de6d1b450684 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:22.934165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3384d-f83d-48de-ad4d-de6d1b450684 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:22.934165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3384d-f83d-48de-ad4d-de6d1b450684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:22.951878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:22.953216 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-96c3384d-f83d-48de-ad4d-de6d1b450684 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:22.954381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-96c3384d-f83d-48de-ad4d-de6d1b450684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:23.016218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fdc8c-7195-474b-bb93-86b77cadca41 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:23.038242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 140/279] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:23.038242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3384d-f83d-48de-ad4d-de6d1b450684 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:23.063348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd085-5c7b-48a6-96f3-83d9f61a8ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:23.064406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd085-5c7b-48a6-96f3-83d9f61a8ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:23.064968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd085-5c7b-48a6-96f3-83d9f61a8ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:23.065254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd085-5c7b-48a6-96f3-83d9f61a8ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:23.066324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd085-5c7b-48a6-96f3-83d9f61a8ce8 None admin] RBAC: Adding query filter params (role.id=5fb006eca1744bd592b59b08b23ef7f2, user.id=a85c4e6602244208acdf2ba07f75fb93, scope.system=all) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:23.066643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd085-5c7b-48a6-96f3-83d9f61a8ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:23.069485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd085-5c7b-48a6-96f3-83d9f61a8ce8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:23.076686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 140/280] 10.222.0.77 () {56 vars in 1308 bytes} [Wed Sep 14 11:47:22 2022] GET /identity/v3/role_assignments?user.id=a85c4e6602244208acdf2ba07f75fb93&scope.system=all&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:23.140415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:23.154420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3384d-f83d-48de-ad4d-de6d1b450684 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:23.193876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c73e87-edd5-4243-81b2-af49f8cdef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:23.194546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c73e87-edd5-4243-81b2-af49f8cdef36 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:23.194833 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c73e87-edd5-4243-81b2-af49f8cdef36 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:23.195109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c73e87-edd5-4243-81b2-af49f8cdef36 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:23.195775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c73e87-edd5-4243-81b2-af49f8cdef36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:23.196240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a53672-a4e9-4e78-8449-eee1a8a56c4b None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:23.196524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a53672-a4e9-4e78-8449-eee1a8a56c4b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:23.196797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a53672-a4e9-4e78-8449-eee1a8a56c4b None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:23.197308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c73e87-edd5-4243-81b2-af49f8cdef36 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:23.198513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 141/281] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:47:23.205753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b1e0-50e3-4bd1-84f9-e829e2966990 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:23.206072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b1e0-50e3-4bd1-84f9-e829e2966990 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:23.206337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b1e0-50e3-4bd1-84f9-e829e2966990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:23.227169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-87e4b1e0-50e3-4bd1-84f9-e829e2966990 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:23.228393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-87e4b1e0-50e3-4bd1-84f9-e829e2966990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:23.303277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 142/282] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:47:23.317678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 141/283] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:47:23 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:47:23.319835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4b1e0-50e3-4bd1-84f9-e829e2966990 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:23.368197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:23.451099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4b1e0-50e3-4bd1-84f9-e829e2966990 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:23.489690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5189c9-f91d-44ff-afd5-f0ec5677293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:23.490436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5189c9-f91d-44ff-afd5-f0ec5677293b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:23.490769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5189c9-f91d-44ff-afd5-f0ec5677293b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:23.491051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5189c9-f91d-44ff-afd5-f0ec5677293b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:23.503035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5189c9-f91d-44ff-afd5-f0ec5677293b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-0d5189c9-f91d-44ff-afd5-f0ec5677293b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:23.508186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:23.509058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:23.509829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 143/284] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:23.517821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c73e87-edd5-4243-81b2-af49f8cdef36 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:23.611300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5189c9-f91d-44ff-afd5-f0ec5677293b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:23.640014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c73e87-edd5-4243-81b2-af49f8cdef36 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:23.661058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:23.680297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0911-b78f-4a74-be91-11571f606700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:23.681854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0911-b78f-4a74-be91-11571f606700 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:23.682410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0911-b78f-4a74-be91-11571f606700 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:23.682864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c0911-b78f-4a74-be91-11571f606700 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:23.683860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c0911-b78f-4a74-be91-11571f606700 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:23.685187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c0911-b78f-4a74-be91-11571f606700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:23.687429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c0911-b78f-4a74-be91-11571f606700 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:23.701754 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 142/285] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:23.707295 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0911-b78f-4a74-be91-11571f606700 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:23.729478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:23.739174 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5189c9-f91d-44ff-afd5-f0ec5677293b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:23.783335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c23afe-30ad-4b22-aed7-23464f3a5c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:23.784069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c23afe-30ad-4b22-aed7-23464f3a5c59 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:23.784465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c23afe-30ad-4b22-aed7-23464f3a5c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:23.784778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c23afe-30ad-4b22-aed7-23464f3a5c59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:23.796970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c23afe-30ad-4b22-aed7-23464f3a5c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-f0c23afe-30ad-4b22-aed7-23464f3a5c59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:23.802069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:23.803018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:23.803808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 144/286] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:23.810973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c23afe-30ad-4b22-aed7-23464f3a5c59 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:23.842481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c0911-b78f-4a74-be91-11571f606700 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:23.887044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e93cc6-ceb6-4ca5-96f2-960a66963843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:23.887854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e93cc6-ceb6-4ca5-96f2-960a66963843 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:23.888253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e93cc6-ceb6-4ca5-96f2-960a66963843 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:23.888694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e93cc6-ceb6-4ca5-96f2-960a66963843 None admin] PATH_INFO: `/v3/users/ce64cfa96bfa4c24a9cfd07500b03440` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:23.890370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e93cc6-ceb6-4ca5-96f2-960a66963843 None admin] RBAC: Authorizing `identity:get_user(user_id=ce64cfa96bfa4c24a9cfd07500b03440)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:23.892682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e93cc6-ceb6-4ca5-96f2-960a66963843 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:23.894594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 143/287] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:23 2022] GET /identity/v3/users/ce64cfa96bfa4c24a9cfd07500b03440 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:23.899593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e93cc6-ceb6-4ca5-96f2-960a66963843 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:23.942150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c23afe-30ad-4b22-aed7-23464f3a5c59 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:24.000584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af9660-49e2-4eb9-9249-460f69ec4421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:24.001955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af9660-49e2-4eb9-9249-460f69ec4421 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:24.002261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af9660-49e2-4eb9-9249-460f69ec4421 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:24.002546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af9660-49e2-4eb9-9249-460f69ec4421 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:24.007717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af9660-49e2-4eb9-9249-460f69ec4421 None admin] RBAC: Adding query filter params (name=member) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:24.008033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af9660-49e2-4eb9-9249-460f69ec4421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:24.011282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af9660-49e2-4eb9-9249-460f69ec4421 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:24.024460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:24.032669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 145/288] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:24.039168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af9660-49e2-4eb9-9249-460f69ec4421 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:24.070091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:24.119896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e93cc6-ceb6-4ca5-96f2-960a66963843 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:24.199485 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c38643-d87d-4582-b764-20f7e7ab4ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:24.200133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c38643-d87d-4582-b764-20f7e7ab4ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:24.200939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c38643-d87d-4582-b764-20f7e7ab4ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:24.201393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c38643-d87d-4582-b764-20f7e7ab4ca3 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:24.204782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af9660-49e2-4eb9-9249-460f69ec4421 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:24.206915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c38643-d87d-4582-b764-20f7e7ab4ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:24.208370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c38643-d87d-4582-b764-20f7e7ab4ca3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:24.210337 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 144/289] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:23 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:24.215836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c38643-d87d-4582-b764-20f7e7ab4ca3 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:24.244055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d79227-902f-421c-a639-35ba2500d076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:24.245618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d79227-902f-421c-a639-35ba2500d076 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:24.245907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d79227-902f-421c-a639-35ba2500d076 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:24.246183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d79227-902f-421c-a639-35ba2500d076 None admin] PATH_INFO: `/v3/users/d42521156fcb4ce581b77d44ea5d0287` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:24.248819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d79227-902f-421c-a639-35ba2500d076 None admin] RBAC: Authorizing `identity:get_user(user_id=d42521156fcb4ce581b77d44ea5d0287)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:24.250538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d79227-902f-421c-a639-35ba2500d076 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:24.252203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 146/290] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:24 2022] GET /identity/v3/users/d42521156fcb4ce581b77d44ea5d0287 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:24.259561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d79227-902f-421c-a639-35ba2500d076 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:24.407221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:24.412499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c38643-d87d-4582-b764-20f7e7ab4ca3 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:24.438749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d79227-902f-421c-a639-35ba2500d076 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:24.445235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:24.479649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40365fa9-cd24-47ef-8747-972175c815de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:24.480321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40365fa9-cd24-47ef-8747-972175c815de None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:24.482275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40365fa9-cd24-47ef-8747-972175c815de None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:24.482748 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40365fa9-cd24-47ef-8747-972175c815de None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7/users/ce64cfa96bfa4c24a9cfd07500b03440/roles/abe4ea559dbb48b7a4437bbab79636ab` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:24.487355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40365fa9-cd24-47ef-8747-972175c815de None admin] RBAC: Authorizing `identity:create_grant(project_id=9d227408446e4141a1dcab80c9df19f7, user_id=ce64cfa96bfa4c24a9cfd07500b03440, role_id=abe4ea559dbb48b7a4437bbab79636ab)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:24.492070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40365fa9-cd24-47ef-8747-972175c815de None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:24.510349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a38c-f93b-4de3-9e2c-07df94dccb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:24.510349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a38c-f93b-4de3-9e2c-07df94dccb35 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:24.510349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a38c-f93b-4de3-9e2c-07df94dccb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:24.510349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a38c-f93b-4de3-9e2c-07df94dccb35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:24.572593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 145/291] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:47:24 2022] PUT /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7/users/ce64cfa96bfa4c24a9cfd07500b03440/roles/abe4ea559dbb48b7a4437bbab79636ab => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 11:47:24.581506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032a38c-f93b-4de3-9e2c-07df94dccb35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:24.583179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032a38c-f93b-4de3-9e2c-07df94dccb35 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:24.680175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:24.700234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 147/292] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 11:47:24.706185 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40365fa9-cd24-47ef-8747-972175c815de None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:24.843636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40365fa9-cd24-47ef-8747-972175c815de None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:24.879816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dc32e-20d5-4110-9420-e45e1601fd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:24.880503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc32e-20d5-4110-9420-e45e1601fd57 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:24.880785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc32e-20d5-4110-9420-e45e1601fd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:24.881055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc32e-20d5-4110-9420-e45e1601fd57 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:24.882172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dc32e-20d5-4110-9420-e45e1601fd57 None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:24.883686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dc32e-20d5-4110-9420-e45e1601fd57 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:24.885581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 146/293] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:24 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:24.892237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a38c-f93b-4de3-9e2c-07df94dccb35 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:25.014937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a38c-f93b-4de3-9e2c-07df94dccb35 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:25.055885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13fdef-0fd8-41fd-b270-70ba94a93fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:25.056515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13fdef-0fd8-41fd-b270-70ba94a93fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:25.056798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13fdef-0fd8-41fd-b270-70ba94a93fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:25.057077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13fdef-0fd8-41fd-b270-70ba94a93fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:25.057822 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13fdef-0fd8-41fd-b270-70ba94a93fb9 None admin] RBAC: Adding query filter params (role.id=5fb006eca1744bd592b59b08b23ef7f2, scope.project.id=9d227408446e4141a1dcab80c9df19f7, user.id=d42521156fcb4ce581b77d44ea5d0287) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:25.058131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13fdef-0fd8-41fd-b270-70ba94a93fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:25.060149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13fdef-0fd8-41fd-b270-70ba94a93fb9 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:25.067273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 148/294] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:24 2022] GET /identity/v3/role_assignments?user.id=d42521156fcb4ce581b77d44ea5d0287&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:25.533445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd991-0f5b-457c-b84c-b547b74d2d84 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:25.533810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd991-0f5b-457c-b84c-b547b74d2d84 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:25.534002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd991-0f5b-457c-b84c-b547b74d2d84 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:25.535705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 147/295] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:25.540997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ae8b-d53f-425a-b0ee-9a1840b82944 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:25.541292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ae8b-d53f-425a-b0ee-9a1840b82944 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:25.541568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ae8b-d53f-425a-b0ee-9a1840b82944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:25.564106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-8154ae8b-d53f-425a-b0ee-9a1840b82944 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:25.565321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8154ae8b-d53f-425a-b0ee-9a1840b82944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:25.626768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:25.656751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 149/296] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:25.955560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd991-0f5b-457c-b84c-b547b74d2d84 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:26.005762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:26.064933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd991-0f5b-457c-b84c-b547b74d2d84 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:26.103740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca07038-5d2e-4ab7-89bd-f4c79b55cdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:26.104373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07038-5d2e-4ab7-89bd-f4c79b55cdab None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:26.104649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07038-5d2e-4ab7-89bd-f4c79b55cdab None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:26.104918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07038-5d2e-4ab7-89bd-f4c79b55cdab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:26.117265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca07038-5d2e-4ab7-89bd-f4c79b55cdab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-7ca07038-5d2e-4ab7-89bd-f4c79b55cdab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:26.123120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:26.124995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:26.126700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 148/297] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:26.130450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154ae8b-d53f-425a-b0ee-9a1840b82944 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:26.199259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc9a4-c668-41ec-8629-c09e17b52e58 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:26.199599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc9a4-c668-41ec-8629-c09e17b52e58 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:26.199801 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffc9a4-c668-41ec-8629-c09e17b52e58 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:26.201930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 149/298] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:47:26.207598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e6498-9ef0-45e3-90cc-ce42ec37915c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:26.207918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e6498-9ef0-45e3-90cc-ce42ec37915c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:26.208198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e6498-9ef0-45e3-90cc-ce42ec37915c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:26.228974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-301e6498-9ef0-45e3-90cc-ce42ec37915c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:26.230566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-301e6498-9ef0-45e3-90cc-ce42ec37915c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:26.240666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154ae8b-d53f-425a-b0ee-9a1840b82944 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:26.276257 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5fb93-89fd-42f9-b3c0-d3e8aa7f1e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:26.276861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5fb93-89fd-42f9-b3c0-d3e8aa7f1e86 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:26.277202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5fb93-89fd-42f9-b3c0-d3e8aa7f1e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:26.277484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5fb93-89fd-42f9-b3c0-d3e8aa7f1e86 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:26.278160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5fb93-89fd-42f9-b3c0-d3e8aa7f1e86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:26.279060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5fb93-89fd-42f9-b3c0-d3e8aa7f1e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:26.280442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5fb93-89fd-42f9-b3c0-d3e8aa7f1e86 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:26.293069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 150/299] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:26.293069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514be86-a4d3-4dc2-97ea-ddbb3b79f75e None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:26.293069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514be86-a4d3-4dc2-97ea-ddbb3b79f75e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:26.293069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514be86-a4d3-4dc2-97ea-ddbb3b79f75e None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:26.293069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 151/300] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:26.295396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514be86-a4d3-4dc2-97ea-ddbb3b79f75e None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:26.315317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 150/301] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:47:26.326410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543a0b-cffd-4bf0-95ed-5c3b710a2397 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:26.326410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543a0b-cffd-4bf0-95ed-5c3b710a2397 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:26.326410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e543a0b-cffd-4bf0-95ed-5c3b710a2397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:26.334575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5e543a0b-cffd-4bf0-95ed-5c3b710a2397 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:26.335753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5e543a0b-cffd-4bf0-95ed-5c3b710a2397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:26.354580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:26.364761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:26.416683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 151/302] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:26.428973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514be86-a4d3-4dc2-97ea-ddbb3b79f75e None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:26.465159 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f41f3c-38f8-4414-8529-7b4752a2f640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:26.466382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f41f3c-38f8-4414-8529-7b4752a2f640 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:26.466671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f41f3c-38f8-4414-8529-7b4752a2f640 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:26.466941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f41f3c-38f8-4414-8529-7b4752a2f640 None admin] PATH_INFO: `/v3/users/a85c4e6602244208acdf2ba07f75fb93` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:26.468122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f41f3c-38f8-4414-8529-7b4752a2f640 None admin] RBAC: Authorizing `identity:get_user(user_id=a85c4e6602244208acdf2ba07f75fb93)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:26.469715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f41f3c-38f8-4414-8529-7b4752a2f640 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:26.471676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 152/303] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:26 2022] GET /identity/v3/users/a85c4e6602244208acdf2ba07f75fb93 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:26.477370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543a0b-cffd-4bf0-95ed-5c3b710a2397 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:26.582659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e543a0b-cffd-4bf0-95ed-5c3b710a2397 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:26.601729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f41f3c-38f8-4414-8529-7b4752a2f640 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:26.618683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddfdc0-7c1a-4a9e-82ab-3227bc96c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:26.619510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddfdc0-7c1a-4a9e-82ab-3227bc96c6a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:26.619663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddfdc0-7c1a-4a9e-82ab-3227bc96c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:26.619881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddfdc0-7c1a-4a9e-82ab-3227bc96c6a5 None admin] PATH_INFO: `/v3/system/users/a85c4e6602244208acdf2ba07f75fb93/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:26.621308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddfdc0-7c1a-4a9e-82ab-3227bc96c6a5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a85c4e6602244208acdf2ba07f75fb93, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:26.622830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddfdc0-7c1a-4a9e-82ab-3227bc96c6a5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:26.709282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f41f3c-38f8-4414-8529-7b4752a2f640 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:26.718234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 152/304] 10.222.0.77 () {58 vars in 1334 bytes} [Wed Sep 14 11:47:26 2022] PUT /identity/v3/system/users/a85c4e6602244208acdf2ba07f75fb93/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:26.719051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddfdc0-7c1a-4a9e-82ab-3227bc96c6a5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:26.722915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:26.760838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97eaf6-8abc-48b4-99d4-0c4d9ee1adfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:26.761851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97eaf6-8abc-48b4-99d4-0c4d9ee1adfd None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:26.763402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97eaf6-8abc-48b4-99d4-0c4d9ee1adfd None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:26.764722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97eaf6-8abc-48b4-99d4-0c4d9ee1adfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:26.767046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97eaf6-8abc-48b4-99d4-0c4d9ee1adfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:26.768826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:26.770152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97eaf6-8abc-48b4-99d4-0c4d9ee1adfd None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:26.774351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 153/305] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:26.779582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97eaf6-8abc-48b4-99d4-0c4d9ee1adfd None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:26.943056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddfdc0-7c1a-4a9e-82ab-3227bc96c6a5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:26.978746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97eaf6-8abc-48b4-99d4-0c4d9ee1adfd None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:26.995829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75ddd6-42b2-4bb9-853a-d97203223730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:26.996462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75ddd6-42b2-4bb9-853a-d97203223730 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:26.996746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75ddd6-42b2-4bb9-853a-d97203223730 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:26.997072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75ddd6-42b2-4bb9-853a-d97203223730 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:27.013122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75ddd6-42b2-4bb9-853a-d97203223730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-ec75ddd6-42b2-4bb9-853a-d97203223730 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:27.018583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:27.019603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:27.020399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:27.022118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416fe3-6a16-418b-9006-6e0a233753cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:27.022785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416fe3-6a16-418b-9006-6e0a233753cd None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:27.023063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 153/306] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:27.027759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416fe3-6a16-418b-9006-6e0a233753cd None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:27.027759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416fe3-6a16-418b-9006-6e0a233753cd None admin] PATH_INFO: `/v3/groups` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:27.027759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416fe3-6a16-418b-9006-6e0a233753cd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:27.027759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416fe3-6a16-418b-9006-6e0a233753cd None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:27.029405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75ddd6-42b2-4bb9-853a-d97203223730 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:27.094544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 154/307] 10.222.0.77 () {60 vars in 1134 bytes} [Wed Sep 14 11:47:26 2022] POST /identity/v3/groups => generated 229 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:47:27.096055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f278-7922-48d6-ac8f-b73595271761 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:27.096417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f278-7922-48d6-ac8f-b73595271761 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:27.097083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f278-7922-48d6-ac8f-b73595271761 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:27.098492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 155/308] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:27.110527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230332a4-d8f4-4a92-b5a9-e2a7ec368bd3 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:27.110527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230332a4-d8f4-4a92-b5a9-e2a7ec368bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:27.110527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230332a4-d8f4-4a92-b5a9-e2a7ec368bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:27.129101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-230332a4-d8f4-4a92-b5a9-e2a7ec368bd3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:27.130489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-230332a4-d8f4-4a92-b5a9-e2a7ec368bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:27.133190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:27.141203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75ddd6-42b2-4bb9-853a-d97203223730 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:27.169564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:27.182758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336d2ba-13ce-4f59-8832-6d07810285d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:27.183883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336d2ba-13ce-4f59-8832-6d07810285d4 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:27.184296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336d2ba-13ce-4f59-8832-6d07810285d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:27.184646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336d2ba-13ce-4f59-8832-6d07810285d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:27.185858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336d2ba-13ce-4f59-8832-6d07810285d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:27.186167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336d2ba-13ce-4f59-8832-6d07810285d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:27.187633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336d2ba-13ce-4f59-8832-6d07810285d4 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:27.201428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 154/309] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:27.207743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336d2ba-13ce-4f59-8832-6d07810285d4 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:27.235593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 156/310] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:27.331376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336d2ba-13ce-4f59-8832-6d07810285d4 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:27.368016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbde6f-99c3-4a0e-8333-302090f03601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:27.368967 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbde6f-99c3-4a0e-8333-302090f03601 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:27.369422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbde6f-99c3-4a0e-8333-302090f03601 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:27.369868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbde6f-99c3-4a0e-8333-302090f03601 None admin] PATH_INFO: `/v3/users/f7ce8f56bf864b48a17c98b651a410d6` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:27.387528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbde6f-99c3-4a0e-8333-302090f03601 None admin] RBAC: Authorizing `identity:get_user(user_id=f7ce8f56bf864b48a17c98b651a410d6)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:27.391258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbde6f-99c3-4a0e-8333-302090f03601 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:27.395063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 155/311] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:27 2022] GET /identity/v3/users/f7ce8f56bf864b48a17c98b651a410d6 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:27.402232 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230332a4-d8f4-4a92-b5a9-e2a7ec368bd3 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:27.505894 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230332a4-d8f4-4a92-b5a9-e2a7ec368bd3 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:27.518680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbde6f-99c3-4a0e-8333-302090f03601 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:27.530552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:27.542577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2be1-0703-4372-b0c8-c25bff18ea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:27.543642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2be1-0703-4372-b0c8-c25bff18ea25 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:27.543642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2be1-0703-4372-b0c8-c25bff18ea25 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:27.543855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2be1-0703-4372-b0c8-c25bff18ea25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:27.544765 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2be1-0703-4372-b0c8-c25bff18ea25 None admin] RBAC: Adding query filter params (role.id=abe4ea559dbb48b7a4437bbab79636ab, user.id=f7ce8f56bf864b48a17c98b651a410d6, scope.system=all) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:27.545146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2be1-0703-4372-b0c8-c25bff18ea25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:27.546702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2be1-0703-4372-b0c8-c25bff18ea25 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:27.552410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 157/312] 10.222.0.77 () {56 vars in 1308 bytes} [Wed Sep 14 11:47:27 2022] GET /identity/v3/role_assignments?user.id=f7ce8f56bf864b48a17c98b651a410d6&scope.system=all&role.id=abe4ea559dbb48b7a4437bbab79636ab => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:27.637253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbde6f-99c3-4a0e-8333-302090f03601 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:27.678477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4575a61-aae3-4237-afc5-76edd0396dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:27.679197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4575a61-aae3-4237-afc5-76edd0396dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:27.679481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4575a61-aae3-4237-afc5-76edd0396dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:27.679751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4575a61-aae3-4237-afc5-76edd0396dd9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:27.692619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4575a61-aae3-4237-afc5-76edd0396dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-b4575a61-aae3-4237-afc5-76edd0396dd9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:27.697822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:27.698831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:27.700789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 156/313] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:27.709913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2be1-0703-4372-b0c8-c25bff18ea25 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:27.745579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:27.823514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2be1-0703-4372-b0c8-c25bff18ea25 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:27.861265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c6680-5c87-4ec5-80d4-caf69c740c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:27.861883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c6680-5c87-4ec5-80d4-caf69c740c97 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:27.862163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c6680-5c87-4ec5-80d4-caf69c740c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:27.862463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c6680-5c87-4ec5-80d4-caf69c740c97 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:27.863135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c6680-5c87-4ec5-80d4-caf69c740c97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:27.863439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c6680-5c87-4ec5-80d4-caf69c740c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:27.864814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c6680-5c87-4ec5-80d4-caf69c740c97 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:27.874033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 158/314] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:27.879691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4575a61-aae3-4237-afc5-76edd0396dd9 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:27.961545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:27.996873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4575a61-aae3-4237-afc5-76edd0396dd9 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:28.033360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c66ec-bb64-4840-9bb9-1c9ec633d57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:28.034061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c66ec-bb64-4840-9bb9-1c9ec633d57f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:28.034379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c66ec-bb64-4840-9bb9-1c9ec633d57f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:28.034654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c66ec-bb64-4840-9bb9-1c9ec633d57f None admin] PATH_INFO: `/v3/users/ce64cfa96bfa4c24a9cfd07500b03440` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:28.035807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c66ec-bb64-4840-9bb9-1c9ec633d57f None admin] RBAC: Authorizing `identity:get_user(user_id=ce64cfa96bfa4c24a9cfd07500b03440)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:28.037246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c66ec-bb64-4840-9bb9-1c9ec633d57f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:28.039178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 157/315] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:27 2022] GET /identity/v3/users/ce64cfa96bfa4c24a9cfd07500b03440 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:28.045082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c6680-5c87-4ec5-80d4-caf69c740c97 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:28.153407 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:28.162658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c6680-5c87-4ec5-80d4-caf69c740c97 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:28.197351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770271bf-8e9d-442a-8eeb-89786dd8f5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:28.197965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770271bf-8e9d-442a-8eeb-89786dd8f5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:28.198268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770271bf-8e9d-442a-8eeb-89786dd8f5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:28.198554 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770271bf-8e9d-442a-8eeb-89786dd8f5c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:28.267959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770271bf-8e9d-442a-8eeb-89786dd8f5c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:28.269499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770271bf-8e9d-442a-8eeb-89786dd8f5c4 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:28.361874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:28.371350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 159/316] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:28.379310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c66ec-bb64-4840-9bb9-1c9ec633d57f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:28.483824 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c66ec-bb64-4840-9bb9-1c9ec633d57f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:28.521933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642a738-aad6-4c9f-94de-94d807eae3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:28.522601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642a738-aad6-4c9f-94de-94d807eae3ed None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:28.522880 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642a738-aad6-4c9f-94de-94d807eae3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:28.523152 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642a738-aad6-4c9f-94de-94d807eae3ed None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:28.524296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642a738-aad6-4c9f-94de-94d807eae3ed None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:28.525730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642a738-aad6-4c9f-94de-94d807eae3ed None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:28.527700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 158/317] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:28 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:28.533625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770271bf-8e9d-442a-8eeb-89786dd8f5c4 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:28.657753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770271bf-8e9d-442a-8eeb-89786dd8f5c4 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:28.693561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59320b20-09e3-4bc7-b5ef-86024ce0cec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:28.694173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320b20-09e3-4bc7-b5ef-86024ce0cec6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:28.694483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320b20-09e3-4bc7-b5ef-86024ce0cec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:28.694757 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320b20-09e3-4bc7-b5ef-86024ce0cec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:28.695487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320b20-09e3-4bc7-b5ef-86024ce0cec6 None admin] RBAC: Adding query filter params (role.id=abe4ea559dbb48b7a4437bbab79636ab, scope.project.id=9d227408446e4141a1dcab80c9df19f7, user.id=ce64cfa96bfa4c24a9cfd07500b03440) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:28.695795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320b20-09e3-4bc7-b5ef-86024ce0cec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:28.697234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320b20-09e3-4bc7-b5ef-86024ce0cec6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:28.703169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 160/318] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:28 2022] GET /identity/v3/role_assignments?user.id=ce64cfa96bfa4c24a9cfd07500b03440&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=abe4ea559dbb48b7a4437bbab79636ab => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:29.093939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8069-e1f1-4ee1-a7f8-487b7ffb8fd1 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:29.094483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8069-e1f1-4ee1-a7f8-487b7ffb8fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:29.094483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8069-e1f1-4ee1-a7f8-487b7ffb8fd1 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:29.096018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 159/319] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:29.100937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509ab19-22db-4f2d-9626-d0d08531b262 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:29.101226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509ab19-22db-4f2d-9626-d0d08531b262 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:29.101494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509ab19-22db-4f2d-9626-d0d08531b262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:29.120080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-4509ab19-22db-4f2d-9626-d0d08531b262 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:29.121240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4509ab19-22db-4f2d-9626-d0d08531b262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:29.173933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:29.189847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 161/320] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:29.461233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0c382-bcbe-4c6c-84b0-104328580e18 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:29.461599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509ab19-22db-4f2d-9626-d0d08531b262 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:29.461704 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0c382-bcbe-4c6c-84b0-104328580e18 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:29.461776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0c382-bcbe-4c6c-84b0-104328580e18 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:29.463283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 160/321] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:29.468975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7d0bc-3442-4fed-88d6-8cc74e1ba5a9 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:29.469261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7d0bc-3442-4fed-88d6-8cc74e1ba5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:29.469535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7d0bc-3442-4fed-88d6-8cc74e1ba5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:29.476735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:29.488910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5ee7d0bc-3442-4fed-88d6-8cc74e1ba5a9 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:29.494854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5ee7d0bc-3442-4fed-88d6-8cc74e1ba5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:29.563613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509ab19-22db-4f2d-9626-d0d08531b262 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:29.566507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 161/322] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:47:29.600139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fe8d-baea-410c-b16f-d7d451e0bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:29.600813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fe8d-baea-410c-b16f-d7d451e0bbdf None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:29.601097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fe8d-baea-410c-b16f-d7d451e0bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:29.601371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047fe8d-baea-410c-b16f-d7d451e0bbdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:29.612933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047fe8d-baea-410c-b16f-d7d451e0bbdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-c047fe8d-baea-410c-b16f-d7d451e0bbdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:29.618309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:29.622605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:29.623413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 162/323] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:29.625318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7d0bc-3442-4fed-88d6-8cc74e1ba5a9 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:29.727745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7d0bc-3442-4fed-88d6-8cc74e1ba5a9 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:29.766235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3044329-c627-4384-9de9-ff8aa87b3e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:29.766886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3044329-c627-4384-9de9-ff8aa87b3e7d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:29.767161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3044329-c627-4384-9de9-ff8aa87b3e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:29.767426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3044329-c627-4384-9de9-ff8aa87b3e7d None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:29.768094 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3044329-c627-4384-9de9-ff8aa87b3e7d None admin] RBAC: Adding query filter params (name=member) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:29.768393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3044329-c627-4384-9de9-ff8aa87b3e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:29.769754 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3044329-c627-4384-9de9-ff8aa87b3e7d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:29.771304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:29.779825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 162/324] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:29.785375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fe8d-baea-410c-b16f-d7d451e0bbdf None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:29.838639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:29.852643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3044329-c627-4384-9de9-ff8aa87b3e7d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:29.893927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047fe8d-baea-410c-b16f-d7d451e0bbdf None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:29.928440 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306cf62-f0f7-4fef-b7b6-b5a61a9d6a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:29.929071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306cf62-f0f7-4fef-b7b6-b5a61a9d6a98 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:29.929351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306cf62-f0f7-4fef-b7b6-b5a61a9d6a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:29.929630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306cf62-f0f7-4fef-b7b6-b5a61a9d6a98 None admin] PATH_INFO: `/v3/users/a85c4e6602244208acdf2ba07f75fb93` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:29.930789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306cf62-f0f7-4fef-b7b6-b5a61a9d6a98 None admin] RBAC: Authorizing `identity:get_user(user_id=a85c4e6602244208acdf2ba07f75fb93)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:29.932253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306cf62-f0f7-4fef-b7b6-b5a61a9d6a98 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:29.933827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 163/325] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:29 2022] GET /identity/v3/users/a85c4e6602244208acdf2ba07f75fb93 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:29.935793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770390fa-b131-42a5-aaa2-b4f3bf679e2f None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:29.936078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770390fa-b131-42a5-aaa2-b4f3bf679e2f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:29.936352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770390fa-b131-42a5-aaa2-b4f3bf679e2f None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:29.937716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 164/326] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:29.942560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770390fa-b131-42a5-aaa2-b4f3bf679e2f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:29.960070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3044329-c627-4384-9de9-ff8aa87b3e7d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:29.999997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718b19-4e9a-43e4-8394-bd1fd865f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:30.000600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718b19-4e9a-43e4-8394-bd1fd865f3eb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:30.000888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718b19-4e9a-43e4-8394-bd1fd865f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:30.001150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718b19-4e9a-43e4-8394-bd1fd865f3eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:30.002268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718b19-4e9a-43e4-8394-bd1fd865f3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:30.003692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718b19-4e9a-43e4-8394-bd1fd865f3eb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:30.005251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 163/327] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:30.006388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393ddbb-f810-4bbe-acab-5cbb9b4b316b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:30.006665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393ddbb-f810-4bbe-acab-5cbb9b4b316b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:30.006930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393ddbb-f810-4bbe-acab-5cbb9b4b316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:30.025042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-1393ddbb-f810-4bbe-acab-5cbb9b4b316b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:30.026254 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1393ddbb-f810-4bbe-acab-5cbb9b4b316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:30.053353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770390fa-b131-42a5-aaa2-b4f3bf679e2f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:30.068231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:30.085627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:30.088371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ee2c7-fd25-4bcc-94f8-7c00bdfcdb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:30.088983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ee2c7-fd25-4bcc-94f8-7c00bdfcdb6e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:30.089260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ee2c7-fd25-4bcc-94f8-7c00bdfcdb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:30.089537 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ee2c7-fd25-4bcc-94f8-7c00bdfcdb6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:30.090282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ee2c7-fd25-4bcc-94f8-7c00bdfcdb6e None admin] RBAC: Adding query filter params (role.id=5fb006eca1744bd592b59b08b23ef7f2, user.id=a85c4e6602244208acdf2ba07f75fb93, scope.system=all) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:30.090617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ee2c7-fd25-4bcc-94f8-7c00bdfcdb6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:30.092064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ee2c7-fd25-4bcc-94f8-7c00bdfcdb6e None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:30.094135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 164/328] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:30.094993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393ddbb-f810-4bbe-acab-5cbb9b4b316b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:30.104362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 165/329] 10.222.0.77 () {56 vars in 1308 bytes} [Wed Sep 14 11:47:29 2022] GET /identity/v3/role_assignments?user.id=a85c4e6602244208acdf2ba07f75fb93&scope.system=all&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:30.206404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393ddbb-f810-4bbe-acab-5cbb9b4b316b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:30.244301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f1f9-0052-4381-8c3a-25eca68e0713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:30.244936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f1f9-0052-4381-8c3a-25eca68e0713 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:30.245215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f1f9-0052-4381-8c3a-25eca68e0713 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:30.245486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f1f9-0052-4381-8c3a-25eca68e0713 None admin] PATH_INFO: `/v3/groups` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:30.246135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027f1f9-0052-4381-8c3a-25eca68e0713 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:30.247682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027f1f9-0052-4381-8c3a-25eca68e0713 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:30.337021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 165/330] 10.222.0.77 () {60 vars in 1134 bytes} [Wed Sep 14 11:47:30 2022] POST /identity/v3/groups => generated 226 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:47:30.365751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ee2c7-fd25-4bcc-94f8-7c00bdfcdb6e None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:30.470783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ee2c7-fd25-4bcc-94f8-7c00bdfcdb6e None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:30.505177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9cd22-f1b0-4f1a-b672-176ca48743db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:30.505812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9cd22-f1b0-4f1a-b672-176ca48743db None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:30.506089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9cd22-f1b0-4f1a-b672-176ca48743db None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:30.506388 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9cd22-f1b0-4f1a-b672-176ca48743db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:30.516414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9cd22-f1b0-4f1a-b672-176ca48743db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-c3d9cd22-f1b0-4f1a-b672-176ca48743db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:30.522016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:30.522915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:30.524247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 166/331] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:30.529428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f1f9-0052-4381-8c3a-25eca68e0713 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:30.585828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:30.634150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f1f9-0052-4381-8c3a-25eca68e0713 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:30.669443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d9abc-f67d-4d88-a2b0-f07f984feb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:30.670038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d9abc-f67d-4d88-a2b0-f07f984feb05 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:30.670350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d9abc-f67d-4d88-a2b0-f07f984feb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:30.670622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d9abc-f67d-4d88-a2b0-f07f984feb05 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:30.671291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d9abc-f67d-4d88-a2b0-f07f984feb05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:30.671594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d9abc-f67d-4d88-a2b0-f07f984feb05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:30.672970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d9abc-f67d-4d88-a2b0-f07f984feb05 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:30.682274 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 166/332] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:30.688313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9cd22-f1b0-4f1a-b672-176ca48743db None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:30.724827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:30.805028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9cd22-f1b0-4f1a-b672-176ca48743db None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:30.844141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de447be-5df2-4698-a4f9-3d75e70251fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:30.844791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de447be-5df2-4698-a4f9-3d75e70251fc None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:30.845071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de447be-5df2-4698-a4f9-3d75e70251fc None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:30.845346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de447be-5df2-4698-a4f9-3d75e70251fc None admin] PATH_INFO: `/v3/users/f7ce8f56bf864b48a17c98b651a410d6` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:30.846521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de447be-5df2-4698-a4f9-3d75e70251fc None admin] RBAC: Authorizing `identity:get_user(user_id=f7ce8f56bf864b48a17c98b651a410d6)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:30.847966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de447be-5df2-4698-a4f9-3d75e70251fc None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:30.849913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 167/333] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:30 2022] GET /identity/v3/users/f7ce8f56bf864b48a17c98b651a410d6 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:30.855692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d9abc-f67d-4d88-a2b0-f07f984feb05 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:30.969548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d9abc-f67d-4d88-a2b0-f07f984feb05 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:30.987765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:31.007136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08d4ff-f0d4-498c-9c5e-c3b8b6891503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:31.007848 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d4ff-f0d4-498c-9c5e-c3b8b6891503 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:31.008081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d4ff-f0d4-498c-9c5e-c3b8b6891503 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:31.008343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d4ff-f0d4-498c-9c5e-c3b8b6891503 None admin] PATH_INFO: `/v3/system/users/f7ce8f56bf864b48a17c98b651a410d6/roles/abe4ea559dbb48b7a4437bbab79636ab` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:31.009827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08d4ff-f0d4-498c-9c5e-c3b8b6891503 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f7ce8f56bf864b48a17c98b651a410d6, role_id=abe4ea559dbb48b7a4437bbab79636ab)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:31.012330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08d4ff-f0d4-498c-9c5e-c3b8b6891503 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:31.074732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 167/334] 10.222.0.77 () {58 vars in 1334 bytes} [Wed Sep 14 11:47:30 2022] PUT /identity/v3/system/users/f7ce8f56bf864b48a17c98b651a410d6/roles/abe4ea559dbb48b7a4437bbab79636ab => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 11:47:33.031716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea53c3-2268-44bf-9b75-926690803b33 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:33.032253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea53c3-2268-44bf-9b75-926690803b33 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:33.032253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea53c3-2268-44bf-9b75-926690803b33 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:33.033881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 168/335] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:33.039580 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc4245-af1d-4f45-99c2-f83c42b5ee2f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:33.040003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc4245-af1d-4f45-99c2-f83c42b5ee2f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:33.040179 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc4245-af1d-4f45-99c2-f83c42b5ee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:33.062712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-80fc4245-af1d-4f45-99c2-f83c42b5ee2f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:33.063936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-80fc4245-af1d-4f45-99c2-f83c42b5ee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:33.156851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 168/336] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:47:33.402482 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911ce8-0ab6-4f36-983a-a52ec97dfd06 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:33.402778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911ce8-0ab6-4f36-983a-a52ec97dfd06 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:33.403186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c911ce8-0ab6-4f36-983a-a52ec97dfd06 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:33.404863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 169/337] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:33.410091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb4128-9912-47dd-b6de-9f7da44337da None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:33.410412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb4128-9912-47dd-b6de-9f7da44337da None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:33.410695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb4128-9912-47dd-b6de-9f7da44337da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:33.435942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-40cb4128-9912-47dd-b6de-9f7da44337da None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:33.437181 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-40cb4128-9912-47dd-b6de-9f7da44337da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:33.537175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 169/338] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:33.803498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c911ce8-0ab6-4f36-983a-a52ec97dfd06 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:33.925313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:33.930235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c911ce8-0ab6-4f36-983a-a52ec97dfd06 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:33.974945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7715c7-6e14-47dc-be37-dded54c1f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:33.975608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7715c7-6e14-47dc-be37-dded54c1f756 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:33.975888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7715c7-6e14-47dc-be37-dded54c1f756 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:33.976162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7715c7-6e14-47dc-be37-dded54c1f756 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:33.988238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7715c7-6e14-47dc-be37-dded54c1f756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-2c7715c7-6e14-47dc-be37-dded54c1f756 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:33.993301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:33.994157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:33.994961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 170/339] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:34.000827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb4128-9912-47dd-b6de-9f7da44337da None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:34.045311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:34.077596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7715c7-6e14-47dc-be37-dded54c1f756 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:34.146221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb4128-9912-47dd-b6de-9f7da44337da None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:34.207523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee4a45-8d91-4e82-aad1-6f9c4c61ff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:34.208201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee4a45-8d91-4e82-aad1-6f9c4c61ff64 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:34.208487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee4a45-8d91-4e82-aad1-6f9c4c61ff64 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:34.208762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee4a45-8d91-4e82-aad1-6f9c4c61ff64 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:34.209466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee4a45-8d91-4e82-aad1-6f9c4c61ff64 None admin] RBAC: Adding query filter params (name=member) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:34.209774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee4a45-8d91-4e82-aad1-6f9c4c61ff64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:34.211248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee4a45-8d91-4e82-aad1-6f9c4c61ff64 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:34.228761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 170/340] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:34.235554 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee4a45-8d91-4e82-aad1-6f9c4c61ff64 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:34.328492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7715c7-6e14-47dc-be37-dded54c1f756 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:34.364312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee4a45-8d91-4e82-aad1-6f9c4c61ff64 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:34.366517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:34.396624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819535f-d9b6-4b8f-8746-2e79b732fa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:34.397284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819535f-d9b6-4b8f-8746-2e79b732fa85 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:34.397566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819535f-d9b6-4b8f-8746-2e79b732fa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:34.397841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819535f-d9b6-4b8f-8746-2e79b732fa85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:34.414510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819535f-d9b6-4b8f-8746-2e79b732fa85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:34.414698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005fb22-3442-470b-bba4-a5e93635e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:34.415263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fb22-3442-470b-bba4-a5e93635e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:34.415546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fb22-3442-470b-bba4-a5e93635e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:34.415883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fb22-3442-470b-bba4-a5e93635e5b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-9819535f-d9b6-4b8f-8746-2e79b732fa85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:34.421825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:34.422754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:34.423546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:34.426516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 171/341] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:34.428015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09d18-8383-475d-bd0f-b1f0776f0e72 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:34.428509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09d18-8383-475d-bd0f-b1f0776f0e72 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:34.429333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09d18-8383-475d-bd0f-b1f0776f0e72 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:34.431391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 172/342] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:34.432935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a7f1c-64c5-4c33-b686-44aa2f0c6288 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:34.433392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a7f1c-64c5-4c33-b686-44aa2f0c6288 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:34.433836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a7f1c-64c5-4c33-b686-44aa2f0c6288 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:34.436078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 173/343] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:34.441789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a7f1c-64c5-4c33-b686-44aa2f0c6288 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:34.468555 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:34.520939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005fb22-3442-470b-bba4-a5e93635e5b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:34.522679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005fb22-3442-470b-bba4-a5e93635e5b0 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:34.583124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a7f1c-64c5-4c33-b686-44aa2f0c6288 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:34.630567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc5fc0-ef28-4f31-a1c9-39387b997d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:34.631550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5fc0-ef28-4f31-a1c9-39387b997d23 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:34.632025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5fc0-ef28-4f31-a1c9-39387b997d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:34.632594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc5fc0-ef28-4f31-a1c9-39387b997d23 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:34.633451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc5fc0-ef28-4f31-a1c9-39387b997d23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:34.633955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc5fc0-ef28-4f31-a1c9-39387b997d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:34.635800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc5fc0-ef28-4f31-a1c9-39387b997d23 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:34.646644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 174/344] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:34.649170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab5269-b081-4a49-accb-17219e29bef4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:34.649770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab5269-b081-4a49-accb-17219e29bef4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:34.650247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab5269-b081-4a49-accb-17219e29bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:34.656186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 171/345] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 11:47:34.659973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde3fae-6224-48d0-a5a1-9cdd62bfcccb None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:34.660250 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde3fae-6224-48d0-a5a1-9cdd62bfcccb None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:34.660525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde3fae-6224-48d0-a5a1-9cdd62bfcccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:34.671882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:34.677634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f0ab5269-b081-4a49-accb-17219e29bef4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:34.679197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f0ab5269-b081-4a49-accb-17219e29bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:34.687860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-7dde3fae-6224-48d0-a5a1-9cdd62bfcccb None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:34.689204 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7dde3fae-6224-48d0-a5a1-9cdd62bfcccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:34.768554 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 172/346] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:34.769827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde3fae-6224-48d0-a5a1-9cdd62bfcccb None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:34.774233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 175/347] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:34.774233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab5269-b081-4a49-accb-17219e29bef4 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:34.790781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:34.890599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab5269-b081-4a49-accb-17219e29bef4 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:34.927851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585e569-4430-49b5-be19-0cc53accda35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:34.929841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585e569-4430-49b5-be19-0cc53accda35 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:34.929841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585e569-4430-49b5-be19-0cc53accda35 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:34.929841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585e569-4430-49b5-be19-0cc53accda35 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:34.930842 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585e569-4430-49b5-be19-0cc53accda35 None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:34.932522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585e569-4430-49b5-be19-0cc53accda35 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:34.938231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 176/348] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:34 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:34.938231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173823ab-9656-4268-b741-7870afcfdf65 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:34.938231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173823ab-9656-4268-b741-7870afcfdf65 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:34.938231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173823ab-9656-4268-b741-7870afcfdf65 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:34.942786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 177/349] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:34.944483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173823ab-9656-4268-b741-7870afcfdf65 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:34.980164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde3fae-6224-48d0-a5a1-9cdd62bfcccb None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:35.039882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:35.050411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb476-6d30-47fe-ada8-7ff10266b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:35.052376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb476-6d30-47fe-ada8-7ff10266b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.052666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb476-6d30-47fe-ada8-7ff10266b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.052939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb476-6d30-47fe-ada8-7ff10266b6a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.070594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:35.111852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173823ab-9656-4268-b741-7870afcfdf65 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:35.154950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a22b4-b42e-4e0d-bba9-01eb48c4402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:35.155720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a22b4-b42e-4e0d-bba9-01eb48c4402f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.156050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a22b4-b42e-4e0d-bba9-01eb48c4402f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.156432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a22b4-b42e-4e0d-bba9-01eb48c4402f None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.163978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a22b4-b42e-4e0d-bba9-01eb48c4402f None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:35.165548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a22b4-b42e-4e0d-bba9-01eb48c4402f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:35.167715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 178/350] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:34 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:35.169020 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7518f6-ed5e-4334-892b-c1debdacb5ce None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.169306 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7518f6-ed5e-4334-892b-c1debdacb5ce None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.169580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7518f6-ed5e-4334-892b-c1debdacb5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.175460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fb476-6d30-47fe-ada8-7ff10266b6a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:35.178152 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fb476-6d30-47fe-ada8-7ff10266b6a2 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:35.189521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2b7518f6-ed5e-4334-892b-c1debdacb5ce None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:35.191133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2b7518f6-ed5e-4334-892b-c1debdacb5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:35.274022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 179/351] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:35.275091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7518f6-ed5e-4334-892b-c1debdacb5ce None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:35.315732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 173/352] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:35.317587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb476-6d30-47fe-ada8-7ff10266b6a2 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:35.357054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:35.373189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:35.401265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7518f6-ed5e-4334-892b-c1debdacb5ce None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:35.446044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58a5ab-b50d-4ca2-941e-59715a419632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:35.446636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58a5ab-b50d-4ca2-941e-59715a419632 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.446912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58a5ab-b50d-4ca2-941e-59715a419632 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.447997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58a5ab-b50d-4ca2-941e-59715a419632 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.456768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb476-6d30-47fe-ada8-7ff10266b6a2 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:35.463113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58a5ab-b50d-4ca2-941e-59715a419632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-5f58a5ab-b50d-4ca2-941e-59715a419632 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:35.469110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:35.470021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:35.470860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 180/353] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:35.471549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58a5ab-b50d-4ca2-941e-59715a419632 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:35.513955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65969081-aea1-43ec-9ab4-c05cff59d8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:35.514637 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969081-aea1-43ec-9ab4-c05cff59d8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.514916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969081-aea1-43ec-9ab4-c05cff59d8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.515192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969081-aea1-43ec-9ab4-c05cff59d8b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.515928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65969081-aea1-43ec-9ab4-c05cff59d8b2 None admin] RBAC: Adding query filter params (group.id=839ee28818b84c0f9cc8a9a521d5dfd2, role.id=5fb006eca1744bd592b59b08b23ef7f2, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:35.516236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65969081-aea1-43ec-9ab4-c05cff59d8b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:35.517681 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65969081-aea1-43ec-9ab4-c05cff59d8b2 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:35.525153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 174/354] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Sep 14 11:47:35 2022] GET /identity/v3/role_assignments?group.id=839ee28818b84c0f9cc8a9a521d5dfd2&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:35.527065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65969081-aea1-43ec-9ab4-c05cff59d8b2 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:35.602615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58a5ab-b50d-4ca2-941e-59715a419632 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:35.656099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c55a0-b769-461e-9985-6f4216ed6a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:35.656756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c55a0-b769-461e-9985-6f4216ed6a7f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.657033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c55a0-b769-461e-9985-6f4216ed6a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.657332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c55a0-b769-461e-9985-6f4216ed6a7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.660478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:35.669356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:35.676238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c55a0-b769-461e-9985-6f4216ed6a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:35.680170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65969081-aea1-43ec-9ab4-c05cff59d8b2 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-916c55a0-b769-461e-9985-6f4216ed6a7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:35.681393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:35.682290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:35.683513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 181/355] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:35.684406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794dbb-d91e-462e-aa71-f0cfec2b4f1d None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.684642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794dbb-d91e-462e-aa71-f0cfec2b4f1d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.684792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794dbb-d91e-462e-aa71-f0cfec2b4f1d None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.686608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 182/356] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:35.687411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794dbb-d91e-462e-aa71-f0cfec2b4f1d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:35.735660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af459a3-021c-49f3-8e0d-6e9b1ae4f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:35.736264 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af459a3-021c-49f3-8e0d-6e9b1ae4f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.737125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af459a3-021c-49f3-8e0d-6e9b1ae4f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.737125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af459a3-021c-49f3-8e0d-6e9b1ae4f4e2 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.740662 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af459a3-021c-49f3-8e0d-6e9b1ae4f4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:35.742104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af459a3-021c-49f3-8e0d-6e9b1ae4f4e2 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:35.748608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 175/357] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:35 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:35.749527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af459a3-021c-49f3-8e0d-6e9b1ae4f4e2 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:35.821186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794dbb-d91e-462e-aa71-f0cfec2b4f1d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:35.863097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314f8b0-6bdc-4271-9f89-2a4ae08572a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:35.864005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314f8b0-6bdc-4271-9f89-2a4ae08572a2 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.864430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314f8b0-6bdc-4271-9f89-2a4ae08572a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.864843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314f8b0-6bdc-4271-9f89-2a4ae08572a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.865801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314f8b0-6bdc-4271-9f89-2a4ae08572a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:35.866109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314f8b0-6bdc-4271-9f89-2a4ae08572a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:35.867502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314f8b0-6bdc-4271-9f89-2a4ae08572a2 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:35.877802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 183/358] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:35.879404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f17c8d-46a6-4dec-9f7a-c1a949c80f24 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.879695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f17c8d-46a6-4dec-9f7a-c1a949c80f24 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.879971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f17c8d-46a6-4dec-9f7a-c1a949c80f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.883760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af459a3-021c-49f3-8e0d-6e9b1ae4f4e2 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:35.901486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-49f17c8d-46a6-4dec-9f7a-c1a949c80f24 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:35.902713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-49f17c8d-46a6-4dec-9f7a-c1a949c80f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:35.927153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc9025-4c17-4313-9a7c-907d707a7b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:35.927791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc9025-4c17-4313-9a7c-907d707a7b05 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:35.928076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc9025-4c17-4313-9a7c-907d707a7b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:35.928348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc9025-4c17-4313-9a7c-907d707a7b05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:35.944887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc9025-4c17-4313-9a7c-907d707a7b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-fffc9025-4c17-4313-9a7c-907d707a7b05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:35.950005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:35.951183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:35.951981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 176/359] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:35.952626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc9025-4c17-4313-9a7c-907d707a7b05 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:35.986542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:35.989701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:36.013509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 184/360] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:36.014707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f17c8d-46a6-4dec-9f7a-c1a949c80f24 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:36.093771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc9025-4c17-4313-9a7c-907d707a7b05 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:36.143379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b499-cfc9-4bb6-b326-e39525fca801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:36.144042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b499-cfc9-4bb6-b326-e39525fca801 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:36.144409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b499-cfc9-4bb6-b326-e39525fca801 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:36.144657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b499-cfc9-4bb6-b326-e39525fca801 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:36.145339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b499-cfc9-4bb6-b326-e39525fca801 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:36.145647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b499-cfc9-4bb6-b326-e39525fca801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:36.147562 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b499-cfc9-4bb6-b326-e39525fca801 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:36.153493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f17c8d-46a6-4dec-9f7a-c1a949c80f24 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:36.156501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 177/361] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:36.157040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b499-cfc9-4bb6-b326-e39525fca801 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:36.198081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23372005-cd76-4304-9bed-0c4c130009b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:36.198756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23372005-cd76-4304-9bed-0c4c130009b6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:36.199037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23372005-cd76-4304-9bed-0c4c130009b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:36.199312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23372005-cd76-4304-9bed-0c4c130009b6 None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:36.200499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23372005-cd76-4304-9bed-0c4c130009b6 None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:36.202143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23372005-cd76-4304-9bed-0c4c130009b6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:36.204733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 185/362] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:36 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:36.205547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23372005-cd76-4304-9bed-0c4c130009b6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:36.266825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:36.282003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:36.284060 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b499-cfc9-4bb6-b326-e39525fca801 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:36.322369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060621-f417-40ab-b0c3-156af3eeb49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:36.322989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060621-f417-40ab-b0c3-156af3eeb49d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:36.324005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060621-f417-40ab-b0c3-156af3eeb49d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:36.324277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060621-f417-40ab-b0c3-156af3eeb49d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:36.348957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23372005-cd76-4304-9bed-0c4c130009b6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:36.398133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99615d-c795-4bf2-85e9-661710c207fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:36.398935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99615d-c795-4bf2-85e9-661710c207fa None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:36.399224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99615d-c795-4bf2-85e9-661710c207fa None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:36.399500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99615d-c795-4bf2-85e9-661710c207fa None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:36.400180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99615d-c795-4bf2-85e9-661710c207fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:36.400485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99615d-c795-4bf2-85e9-661710c207fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:36.401850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99615d-c795-4bf2-85e9-661710c207fa None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:36.407252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d060621-f417-40ab-b0c3-156af3eeb49d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:36.409518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d060621-f417-40ab-b0c3-156af3eeb49d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:36.415870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 186/363] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:36.416735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99615d-c795-4bf2-85e9-661710c207fa None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:36.520544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:36.545718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 178/364] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:36.546171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060621-f417-40ab-b0c3-156af3eeb49d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:36.569258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99615d-c795-4bf2-85e9-661710c207fa None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:36.588437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:36.619628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d28538-d557-474d-9f41-fe8d1f43b570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:36.620240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d28538-d557-474d-9f41-fe8d1f43b570 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:36.621102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d28538-d557-474d-9f41-fe8d1f43b570 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:36.621102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d28538-d557-474d-9f41-fe8d1f43b570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:36.684943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060621-f417-40ab-b0c3-156af3eeb49d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:36.715137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d28538-d557-474d-9f41-fe8d1f43b570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:36.716734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d28538-d557-474d-9f41-fe8d1f43b570 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:36.732176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca93f-4040-45f3-bfe5-da8398a4db1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:36.733029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca93f-4040-45f3-bfe5-da8398a4db1b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:36.733495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca93f-4040-45f3-bfe5-da8398a4db1b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:36.733785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca93f-4040-45f3-bfe5-da8398a4db1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:36.735438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca93f-4040-45f3-bfe5-da8398a4db1b None admin] RBAC: Adding query filter params (group.id=839ee28818b84c0f9cc8a9a521d5dfd2, role.id=08735f4fc39148328610ad98ba651850, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:36.735754 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca93f-4040-45f3-bfe5-da8398a4db1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:36.737191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca93f-4040-45f3-bfe5-da8398a4db1b None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:36.743109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 179/365] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Sep 14 11:47:36 2022] GET /identity/v3/role_assignments?group.id=839ee28818b84c0f9cc8a9a521d5dfd2&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=08735f4fc39148328610ad98ba651850 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:36.743749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca93f-4040-45f3-bfe5-da8398a4db1b None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:36.805414 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:36.858236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 187/366] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:36.858236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d28538-d557-474d-9f41-fe8d1f43b570 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:36.881156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca93f-4040-45f3-bfe5-da8398a4db1b None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:36.882722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:36.929289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1147dab-8fb8-41c9-8674-efab26afe3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:36.929939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1147dab-8fb8-41c9-8674-efab26afe3cf None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:36.930242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1147dab-8fb8-41c9-8674-efab26afe3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:36.930540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1147dab-8fb8-41c9-8674-efab26afe3cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:36.945387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1147dab-8fb8-41c9-8674-efab26afe3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-e1147dab-8fb8-41c9-8674-efab26afe3cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:36.952300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:36.953227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:36.954007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:36.957008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 180/367] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:47:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:36.958219 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1147dab-8fb8-41c9-8674-efab26afe3cf None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:36.994839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d28538-d557-474d-9f41-fe8d1f43b570 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:37.036550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9578e43-1c6a-43b0-ac47-a5bbbb96b23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:37.037343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9578e43-1c6a-43b0-ac47-a5bbbb96b23a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:37.037597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9578e43-1c6a-43b0-ac47-a5bbbb96b23a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:37.037875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9578e43-1c6a-43b0-ac47-a5bbbb96b23a None admin] PATH_INFO: `/v3/users/f7ce8f56bf864b48a17c98b651a410d6` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:37.039068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9578e43-1c6a-43b0-ac47-a5bbbb96b23a None admin] RBAC: Authorizing `identity:get_user(user_id=f7ce8f56bf864b48a17c98b651a410d6)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:37.041053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9578e43-1c6a-43b0-ac47-a5bbbb96b23a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:37.042542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 188/368] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:47:36 2022] GET /identity/v3/users/f7ce8f56bf864b48a17c98b651a410d6 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:37.047686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9578e43-1c6a-43b0-ac47-a5bbbb96b23a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:37.075105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1147dab-8fb8-41c9-8674-efab26afe3cf None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:37.086806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:37.113788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4655e2-74f0-4233-99f2-2ab1ece8860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:37.114607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4655e2-74f0-4233-99f2-2ab1ece8860b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:37.115003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4655e2-74f0-4233-99f2-2ab1ece8860b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:37.115458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4655e2-74f0-4233-99f2-2ab1ece8860b None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:37.116809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4655e2-74f0-4233-99f2-2ab1ece8860b None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:37.118438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4655e2-74f0-4233-99f2-2ab1ece8860b None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:37.125583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 181/369] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:36 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:37.125583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4655e2-74f0-4233-99f2-2ab1ece8860b None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:37.155197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:37.176564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9578e43-1c6a-43b0-ac47-a5bbbb96b23a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:37.226322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce847-fa23-481d-b0e6-c7041f2ba2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:37.227185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce847-fa23-481d-b0e6-c7041f2ba2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:37.227814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce847-fa23-481d-b0e6-c7041f2ba2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:37.228098 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ce847-fa23-481d-b0e6-c7041f2ba2b1 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:37.229538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ce847-fa23-481d-b0e6-c7041f2ba2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:37.231149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ce847-fa23-481d-b0e6-c7041f2ba2b1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:37.233452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 189/370] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:37 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:37.234290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce847-fa23-481d-b0e6-c7041f2ba2b1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:37.241575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4655e2-74f0-4233-99f2-2ab1ece8860b None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:37.281742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1acf-8687-4af0-944f-d9d7bec93aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:37.282499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1acf-8687-4af0-944f-d9d7bec93aed None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:37.282781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1acf-8687-4af0-944f-d9d7bec93aed None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:37.283051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1acf-8687-4af0-944f-d9d7bec93aed None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:37.283717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b1acf-8687-4af0-944f-d9d7bec93aed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:37.284018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b1acf-8687-4af0-944f-d9d7bec93aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:37.285486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b1acf-8687-4af0-944f-d9d7bec93aed None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:37.295136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 182/371] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:37.296101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1acf-8687-4af0-944f-d9d7bec93aed None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:37.362741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:37.370325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ce847-fa23-481d-b0e6-c7041f2ba2b1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:37.413637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd2a6c-0637-41a4-898e-360e524b9c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:37.414626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd2a6c-0637-41a4-898e-360e524b9c73 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:37.415056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd2a6c-0637-41a4-898e-360e524b9c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:37.415482 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd2a6c-0637-41a4-898e-360e524b9c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:37.416436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd2a6c-0637-41a4-898e-360e524b9c73 None admin] RBAC: Adding query filter params (role.id=abe4ea559dbb48b7a4437bbab79636ab, user.id=f7ce8f56bf864b48a17c98b651a410d6, scope.system=all) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:37.416916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd2a6c-0637-41a4-898e-360e524b9c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:37.419361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd2a6c-0637-41a4-898e-360e524b9c73 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:37.436497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 190/372] 10.222.0.77 () {56 vars in 1308 bytes} [Wed Sep 14 11:47:37 2022] GET /identity/v3/role_assignments?user.id=f7ce8f56bf864b48a17c98b651a410d6&scope.system=all&role.id=abe4ea559dbb48b7a4437bbab79636ab => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:37.437688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd2a6c-0637-41a4-898e-360e524b9c73 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:37.438481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1acf-8687-4af0-944f-d9d7bec93aed None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:37.454603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:37.486331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb696dfa-15d6-4381-8385-2bff183c9b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:37.487004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb696dfa-15d6-4381-8385-2bff183c9b84 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:37.487278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb696dfa-15d6-4381-8385-2bff183c9b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:37.487572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb696dfa-15d6-4381-8385-2bff183c9b84 None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:37.489735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb696dfa-15d6-4381-8385-2bff183c9b84 None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:37.492420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb696dfa-15d6-4381-8385-2bff183c9b84 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:37.494359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 183/373] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:37 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:37.497971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb696dfa-15d6-4381-8385-2bff183c9b84 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:37.578923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd2a6c-0637-41a4-898e-360e524b9c73 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:37.623509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb696dfa-15d6-4381-8385-2bff183c9b84 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:37.624798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e017c4-ab91-4050-a3a9-749e792087e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:37.625736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e017c4-ab91-4050-a3a9-749e792087e6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:37.626195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e017c4-ab91-4050-a3a9-749e792087e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:37.626788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e017c4-ab91-4050-a3a9-749e792087e6 None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:37.628215 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e017c4-ab91-4050-a3a9-749e792087e6 None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:37.630284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e017c4-ab91-4050-a3a9-749e792087e6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:37.632724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 191/374] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:37 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:37.634192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:37.635429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e017c4-ab91-4050-a3a9-749e792087e6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:37.669646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a950468-b472-4889-bead-e5d69709e49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:37.670726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a950468-b472-4889-bead-e5d69709e49d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:37.671211 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a950468-b472-4889-bead-e5d69709e49d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:37.671734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a950468-b472-4889-bead-e5d69709e49d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:37.739713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:37.749654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a950468-b472-4889-bead-e5d69709e49d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:37.751248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a950468-b472-4889-bead-e5d69709e49d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:37.766931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e017c4-ab91-4050-a3a9-749e792087e6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:37.806358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a5a1e-c1f5-4689-b762-d6d55a049e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:37.807435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5a1e-c1f5-4689-b762-d6d55a049e6d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:37.807999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5a1e-c1f5-4689-b762-d6d55a049e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:37.808474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5a1e-c1f5-4689-b762-d6d55a049e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:37.810033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a5a1e-c1f5-4689-b762-d6d55a049e6d None admin] RBAC: Adding query filter params (group.id=839ee28818b84c0f9cc8a9a521d5dfd2, role.id=5fb006eca1744bd592b59b08b23ef7f2, scope.project.id=9d227408446e4141a1dcab80c9df19f7) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:37.810573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a5a1e-c1f5-4689-b762-d6d55a049e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:37.812509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a5a1e-c1f5-4689-b762-d6d55a049e6d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:37.819465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 192/375] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Sep 14 11:47:37 2022] GET /identity/v3/role_assignments?group.id=839ee28818b84c0f9cc8a9a521d5dfd2&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:37.820740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a5a1e-c1f5-4689-b762-d6d55a049e6d None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:37.885782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 184/376] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:37.892036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a950468-b472-4889-bead-e5d69709e49d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:37.907303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:37.942249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a5a1e-c1f5-4689-b762-d6d55a049e6d None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:37.987305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d228d94-8be4-4187-9163-2c94bcdb317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:37.988661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d228d94-8be4-4187-9163-2c94bcdb317d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:37.990030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d228d94-8be4-4187-9163-2c94bcdb317d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:37.990784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d228d94-8be4-4187-9163-2c94bcdb317d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:37.993245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d228d94-8be4-4187-9163-2c94bcdb317d None admin] RBAC: Adding query filter params (group.id=839ee28818b84c0f9cc8a9a521d5dfd2, role.id=08735f4fc39148328610ad98ba651850, scope.project.id=9d227408446e4141a1dcab80c9df19f7) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:37.994189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d228d94-8be4-4187-9163-2c94bcdb317d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:37.999079 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d228d94-8be4-4187-9163-2c94bcdb317d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:38.010635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 193/377] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Sep 14 11:47:37 2022] GET /identity/v3/role_assignments?group.id=839ee28818b84c0f9cc8a9a521d5dfd2&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=08735f4fc39148328610ad98ba651850 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:38.060187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a950468-b472-4889-bead-e5d69709e49d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:38.109217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad64e5-0554-4c17-8464-ead53cde95aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:38.110345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad64e5-0554-4c17-8464-ead53cde95aa None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:38.110829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad64e5-0554-4c17-8464-ead53cde95aa None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:38.111302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad64e5-0554-4c17-8464-ead53cde95aa None admin] PATH_INFO: `/v3/projects/44214f6312fa43ec8a83e2996bf5a5af` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:38.112863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad64e5-0554-4c17-8464-ead53cde95aa None admin] RBAC: Authorizing `identity:get_project(project_id=44214f6312fa43ec8a83e2996bf5a5af)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:38.114637 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad64e5-0554-4c17-8464-ead53cde95aa None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:38.119392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 185/378] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:37 2022] GET /identity/v3/projects/44214f6312fa43ec8a83e2996bf5a5af => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:38.122754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080281c-a986-442b-8af1-4f57d3a76948 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:38.123203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad64e5-0554-4c17-8464-ead53cde95aa None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:38.123544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080281c-a986-442b-8af1-4f57d3a76948 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:38.124163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080281c-a986-442b-8af1-4f57d3a76948 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:38.125838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 194/379] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:38.131742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04550194-7906-4cd7-a855-cf244b9015c6 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:38.132028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04550194-7906-4cd7-a855-cf244b9015c6 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:38.132307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04550194-7906-4cd7-a855-cf244b9015c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:38.157200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:38.169323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-04550194-7906-4cd7-a855-cf244b9015c6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:38.170621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-04550194-7906-4cd7-a855-cf244b9015c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:38.223107 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:38.256562 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad64e5-0554-4c17-8464-ead53cde95aa None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:38.306194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd4a49-636f-45b4-8e6c-93431e05e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:38.307222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd4a49-636f-45b4-8e6c-93431e05e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:38.307715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd4a49-636f-45b4-8e6c-93431e05e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:38.308166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd4a49-636f-45b4-8e6c-93431e05e9a2 None admin] PATH_INFO: `/v3/groups/0632dd0570c44328b8042701c19c3b02` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:38.309865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 195/380] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:38.320816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd4a49-636f-45b4-8e6c-93431e05e9a2 None admin] RBAC: Authorizing `identity:get_group(group_id=0632dd0570c44328b8042701c19c3b02)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:38.322305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd4a49-636f-45b4-8e6c-93431e05e9a2 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:38.324279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 186/381] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:38 2022] GET /identity/v3/groups/0632dd0570c44328b8042701c19c3b02 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:38.330817 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04550194-7906-4cd7-a855-cf244b9015c6 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:38.432718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04550194-7906-4cd7-a855-cf244b9015c6 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:38.477651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dce94-2320-4dd7-a252-20905a77c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:38.478298 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dce94-2320-4dd7-a252-20905a77c1ba None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:38.478580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dce94-2320-4dd7-a252-20905a77c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:38.478848 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dce94-2320-4dd7-a252-20905a77c1ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:38.479580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dce94-2320-4dd7-a252-20905a77c1ba None admin] RBAC: Adding query filter params (group.id=0632dd0570c44328b8042701c19c3b02, role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=44214f6312fa43ec8a83e2996bf5a5af) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:38.479875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dce94-2320-4dd7-a252-20905a77c1ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:38.481655 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dce94-2320-4dd7-a252-20905a77c1ba None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:38.484955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:38.490540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 196/382] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Sep 14 11:47:38 2022] GET /identity/v3/role_assignments?group.id=0632dd0570c44328b8042701c19c3b02&scope.project.id=44214f6312fa43ec8a83e2996bf5a5af&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:38.767313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd4a49-636f-45b4-8e6c-93431e05e9a2 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:38.879853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd4a49-636f-45b4-8e6c-93431e05e9a2 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:38.917049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe316013-604c-4b2f-81fb-3f10ce67313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:38.918061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe316013-604c-4b2f-81fb-3f10ce67313b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:38.918769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe316013-604c-4b2f-81fb-3f10ce67313b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:38.919446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe316013-604c-4b2f-81fb-3f10ce67313b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:38.931624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe316013-604c-4b2f-81fb-3f10ce67313b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-fe316013-604c-4b2f-81fb-3f10ce67313b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:38.937757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:38.938734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:38.939559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:38.942475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 187/383] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:38.946434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:38.948849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dce94-2320-4dd7-a252-20905a77c1ba None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:39.077097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dce94-2320-4dd7-a252-20905a77c1ba None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:39.120203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e525-afa7-4184-bd07-31e00f764b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:39.121252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e525-afa7-4184-bd07-31e00f764b35 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:39.122365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e525-afa7-4184-bd07-31e00f764b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:39.122944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353e525-afa7-4184-bd07-31e00f764b35 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:39.123932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e525-afa7-4184-bd07-31e00f764b35 None admin] RBAC: Adding query filter params (name=member) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:39.124447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e525-afa7-4184-bd07-31e00f764b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:39.126010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353e525-afa7-4184-bd07-31e00f764b35 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:39.138427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 197/384] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:39.144388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe316013-604c-4b2f-81fb-3f10ce67313b None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:39.263950 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe316013-604c-4b2f-81fb-3f10ce67313b None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:39.301678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98875c-bcc5-4d3b-b226-f7937bc392c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:39.302718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98875c-bcc5-4d3b-b226-f7937bc392c5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:39.303222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98875c-bcc5-4d3b-b226-f7937bc392c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:39.303716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98875c-bcc5-4d3b-b226-f7937bc392c5 None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:39.305051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98875c-bcc5-4d3b-b226-f7937bc392c5 None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:39.306732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98875c-bcc5-4d3b-b226-f7937bc392c5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:39.308533 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 188/385] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:39 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:39.314350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e525-afa7-4184-bd07-31e00f764b35 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:39.318307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ad22a-96cc-47ed-ab94-ed95e08799be None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:39.318600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ad22a-96cc-47ed-ab94-ed95e08799be None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:39.318874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ad22a-96cc-47ed-ab94-ed95e08799be None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:39.320325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 189/386] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:39.335638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad882f-ba5e-4c62-a581-bf19f6a68286 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:39.335887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad882f-ba5e-4c62-a581-bf19f6a68286 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:39.336112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad882f-ba5e-4c62-a581-bf19f6a68286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:39.371210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-15ad882f-ba5e-4c62-a581-bf19f6a68286 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:39.373175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-15ad882f-ba5e-4c62-a581-bf19f6a68286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:39.385645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:39.444391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353e525-afa7-4184-bd07-31e00f764b35 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:39.500583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:39.507806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb27ba-ff91-45c3-b465-2e8e29c0a240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:39.508508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb27ba-ff91-45c3-b465-2e8e29c0a240 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:39.508790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb27ba-ff91-45c3-b465-2e8e29c0a240 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:39.509062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb27ba-ff91-45c3-b465-2e8e29c0a240 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:39.511137 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 190/387] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:47:39.513095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb27ba-ff91-45c3-b465-2e8e29c0a240 None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:39.513928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb27ba-ff91-45c3-b465-2e8e29c0a240 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:39.515866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 198/388] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:39 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:39.529852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad882f-ba5e-4c62-a581-bf19f6a68286 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:39.709869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad882f-ba5e-4c62-a581-bf19f6a68286 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:39.758817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0e242-c04b-4491-acfb-625f653484be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:39.759482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e242-c04b-4491-acfb-625f653484be None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:39.759761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e242-c04b-4491-acfb-625f653484be None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:39.760037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e242-c04b-4491-acfb-625f653484be None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/groups/839ee28818b84c0f9cc8a9a521d5dfd2/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:39.767546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0e242-c04b-4491-acfb-625f653484be None admin] RBAC: Authorizing `identity:create_grant(project_id=7d5dbb2d887b42bfb6786e6517b28784, group_id=839ee28818b84c0f9cc8a9a521d5dfd2, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:39.768979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0e242-c04b-4491-acfb-625f653484be None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:39.786576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb27ba-ff91-45c3-b465-2e8e29c0a240 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:39.838807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 191/389] 10.222.0.77 () {58 vars in 1442 bytes} [Wed Sep 14 11:47:39 2022] PUT /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/groups/839ee28818b84c0f9cc8a9a521d5dfd2/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:39.907861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb27ba-ff91-45c3-b465-2e8e29c0a240 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:39.942919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:39.953859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c53d4-de5c-4d8b-a9ea-b6d122fca4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:39.954878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c53d4-de5c-4d8b-a9ea-b6d122fca4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:39.957702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c53d4-de5c-4d8b-a9ea-b6d122fca4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:39.957702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c53d4-de5c-4d8b-a9ea-b6d122fca4f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:39.974946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c53d4-de5c-4d8b-a9ea-b6d122fca4f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-a32c53d4-de5c-4d8b-a9ea-b6d122fca4f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:39.980890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:39.981942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:39.982808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 199/390] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:39.995366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0e242-c04b-4491-acfb-625f653484be None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:40.084631 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:40.135090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0e242-c04b-4491-acfb-625f653484be None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:40.171280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db44e8-791b-46db-aefe-cdde35b26c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:40.172678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db44e8-791b-46db-aefe-cdde35b26c8e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:40.173635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db44e8-791b-46db-aefe-cdde35b26c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:40.173908 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db44e8-791b-46db-aefe-cdde35b26c8e None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:40.174607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db44e8-791b-46db-aefe-cdde35b26c8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:40.174908 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db44e8-791b-46db-aefe-cdde35b26c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:40.176270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db44e8-791b-46db-aefe-cdde35b26c8e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:40.185975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 192/391] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:40.191895 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c53d4-de5c-4d8b-a9ea-b6d122fca4f9 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:40.328493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c53d4-de5c-4d8b-a9ea-b6d122fca4f9 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:40.379038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424e45b-4782-42a3-a2b4-c85e850acb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:40.380146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e45b-4782-42a3-a2b4-c85e850acb06 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:40.380623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e45b-4782-42a3-a2b4-c85e850acb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:40.381096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e45b-4782-42a3-a2b4-c85e850acb06 None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:40.382461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e45b-4782-42a3-a2b4-c85e850acb06 None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:40.384184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e45b-4782-42a3-a2b4-c85e850acb06 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:40.386333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 200/392] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:40 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:40.392803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db44e8-791b-46db-aefe-cdde35b26c8e None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:40.539966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db44e8-791b-46db-aefe-cdde35b26c8e None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:40.565793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:40.583463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356405-f7d5-495b-963e-c18197f01628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:40.584112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356405-f7d5-495b-963e-c18197f01628 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:40.584395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356405-f7d5-495b-963e-c18197f01628 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:40.584674 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356405-f7d5-495b-963e-c18197f01628 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:40.585827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356405-f7d5-495b-963e-c18197f01628 None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:40.587316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356405-f7d5-495b-963e-c18197f01628 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:40.589411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 193/393] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:40 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:40.596808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424e45b-4782-42a3-a2b4-c85e850acb06 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:40.696279 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:40.747158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424e45b-4782-42a3-a2b4-c85e850acb06 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:40.803162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f966c-2b6b-4b0d-a04d-8e10e2abcc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:40.803776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f966c-2b6b-4b0d-a04d-8e10e2abcc9c None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:40.804055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f966c-2b6b-4b0d-a04d-8e10e2abcc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:40.804398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f966c-2b6b-4b0d-a04d-8e10e2abcc9c None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/groups/839ee28818b84c0f9cc8a9a521d5dfd2/roles/08735f4fc39148328610ad98ba651850` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:40.806920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f966c-2b6b-4b0d-a04d-8e10e2abcc9c None admin] RBAC: Authorizing `identity:create_grant(project_id=7d5dbb2d887b42bfb6786e6517b28784, group_id=839ee28818b84c0f9cc8a9a521d5dfd2, role_id=08735f4fc39148328610ad98ba651850)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:40.808382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f966c-2b6b-4b0d-a04d-8e10e2abcc9c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:40.898516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf5613-8bfa-4f72-b9d8-2fadc1a7dfc9 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:40.898875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf5613-8bfa-4f72-b9d8-2fadc1a7dfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:40.899127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf5613-8bfa-4f72-b9d8-2fadc1a7dfc9 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:40.900711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 194/394] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:40.901670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60f5fd-f53a-48d1-90a7-2b7f6017df0c None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:40.901958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60f5fd-f53a-48d1-90a7-2b7f6017df0c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:40.902258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60f5fd-f53a-48d1-90a7-2b7f6017df0c None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:40.904858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 195/395] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:40.910669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586993c-f951-436f-b333-7303ffce077f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:40.911072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586993c-f951-436f-b333-7303ffce077f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:40.911447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586993c-f951-436f-b333-7303ffce077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:40.913171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 201/396] 10.222.0.77 () {58 vars in 1442 bytes} [Wed Sep 14 11:47:40 2022] PUT /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784/groups/839ee28818b84c0f9cc8a9a521d5dfd2/roles/08735f4fc39148328610ad98ba651850 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:40.914673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583880c1-7774-43ff-89ad-7a0006353e38 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:40.915349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583880c1-7774-43ff-89ad-7a0006353e38 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:40.915915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583880c1-7774-43ff-89ad-7a0006353e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:40.932700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-9586993c-f951-436f-b333-7303ffce077f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:40.934665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9586993c-f951-436f-b333-7303ffce077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:40.941572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-583880c1-7774-43ff-89ad-7a0006353e38 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:40.943146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-583880c1-7774-43ff-89ad-7a0006353e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:41.031480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 202/397] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:41.060531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 196/398] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:41.323691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583880c1-7774-43ff-89ad-7a0006353e38 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:41.381609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:41.437995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586993c-f951-436f-b333-7303ffce077f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:41.456256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583880c1-7774-43ff-89ad-7a0006353e38 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:41.501411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dabd3-6664-45c2-a3d5-71d4202622c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:41.502061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dabd3-6664-45c2-a3d5-71d4202622c8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:41.502374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dabd3-6664-45c2-a3d5-71d4202622c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:41.502648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dabd3-6664-45c2-a3d5-71d4202622c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:41.526001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dabd3-6664-45c2-a3d5-71d4202622c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-3b8dabd3-6664-45c2-a3d5-71d4202622c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:41.532751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:41.533620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:41.534455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:41.537093 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 203/399] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:41.546078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dabd3-6664-45c2-a3d5-71d4202622c8 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:41.607629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586993c-f951-436f-b333-7303ffce077f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:41.643294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:41.688148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165b81-dbf9-43a0-9f6b-716002524737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:41.688796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165b81-dbf9-43a0-9f6b-716002524737 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:41.689076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165b81-dbf9-43a0-9f6b-716002524737 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:41.689347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc165b81-dbf9-43a0-9f6b-716002524737 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:41.708874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc165b81-dbf9-43a0-9f6b-716002524737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-cc165b81-dbf9-43a0-9f6b-716002524737 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:41.713796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:41.714702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:41.716101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:41.722365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 197/400] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:41.723877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165b81-dbf9-43a0-9f6b-716002524737 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:41.749348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dabd3-6664-45c2-a3d5-71d4202622c8 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:41.759714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:41.788143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f3036-c769-487e-aad0-8108353a32af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:41.788750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f3036-c769-487e-aad0-8108353a32af None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:41.789072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f3036-c769-487e-aad0-8108353a32af None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:41.789345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f3036-c769-487e-aad0-8108353a32af None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:41.790036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f3036-c769-487e-aad0-8108353a32af None admin] RBAC: Adding query filter params (name=member) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:41.790595 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f3036-c769-487e-aad0-8108353a32af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:41.796248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f3036-c769-487e-aad0-8108353a32af None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:41.802755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 204/401] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:41.804064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7a08-cc8a-4a5b-9319-82620dc113d8 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:41.804347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7a08-cc8a-4a5b-9319-82620dc113d8 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:41.804666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7a08-cc8a-4a5b-9319-82620dc113d8 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:41.810312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 205/402] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:41.811158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7a08-cc8a-4a5b-9319-82620dc113d8 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:41.862270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc165b81-dbf9-43a0-9f6b-716002524737 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:41.901197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aee3cf-dc4e-4a66-bf81-0ed731a2b9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:41.901810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aee3cf-dc4e-4a66-bf81-0ed731a2b9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:41.902091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aee3cf-dc4e-4a66-bf81-0ed731a2b9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:41.902415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aee3cf-dc4e-4a66-bf81-0ed731a2b9e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:41.903164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aee3cf-dc4e-4a66-bf81-0ed731a2b9e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:41.903527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aee3cf-dc4e-4a66-bf81-0ed731a2b9e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:41.904993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aee3cf-dc4e-4a66-bf81-0ed731a2b9e1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:41.919040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 198/403] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:41.920575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb58c-247c-4920-ab6b-9c8eedc600a3 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:41.920864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb58c-247c-4920-ab6b-9c8eedc600a3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:41.921140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb58c-247c-4920-ab6b-9c8eedc600a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:41.936976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7a08-cc8a-4a5b-9319-82620dc113d8 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:41.941685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-cf3bb58c-247c-4920-ab6b-9c8eedc600a3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:41.942979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-cf3bb58c-247c-4920-ab6b-9c8eedc600a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:41.979608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b397d57-d39c-4d88-8f5c-9c8eef18276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:41.980834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b397d57-d39c-4d88-8f5c-9c8eef18276b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:41.981311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b397d57-d39c-4d88-8f5c-9c8eef18276b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:41.981828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b397d57-d39c-4d88-8f5c-9c8eef18276b None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:41.983212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:41.983872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b397d57-d39c-4d88-8f5c-9c8eef18276b None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:41.987110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b397d57-d39c-4d88-8f5c-9c8eef18276b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:41.988895 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 206/404] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:41 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:41.989894 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b397d57-d39c-4d88-8f5c-9c8eef18276b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:42.025441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 199/405] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:42.026490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bb58c-247c-4920-ab6b-9c8eedc600a3 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:42.039243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:42.158821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bb58c-247c-4920-ab6b-9c8eedc600a3 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:42.160956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b397d57-d39c-4d88-8f5c-9c8eef18276b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:42.198039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30c82-3754-49b7-96c8-d73c5957fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:42.198714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30c82-3754-49b7-96c8-d73c5957fb49 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:42.198998 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30c82-3754-49b7-96c8-d73c5957fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:42.199276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f30c82-3754-49b7-96c8-d73c5957fb49 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:42.201007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f30c82-3754-49b7-96c8-d73c5957fb49 None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:42.202611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f30c82-3754-49b7-96c8-d73c5957fb49 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:42.204803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 200/406] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:42 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:42.210642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30c82-3754-49b7-96c8-d73c5957fb49 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:42.251374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9811ebc-7376-4446-bb3f-05dd62753163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:42.252011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9811ebc-7376-4446-bb3f-05dd62753163 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:42.252292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9811ebc-7376-4446-bb3f-05dd62753163 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:42.252568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9811ebc-7376-4446-bb3f-05dd62753163 None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:42.255616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9811ebc-7376-4446-bb3f-05dd62753163 None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:42.257045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9811ebc-7376-4446-bb3f-05dd62753163 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:42.260234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 207/407] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:41 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:42.266326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9811ebc-7376-4446-bb3f-05dd62753163 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:42.280260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:42.366554 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f30c82-3754-49b7-96c8-d73c5957fb49 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:42.403285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ed70-4a3c-4e9e-b0be-f64c118bff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:42.404307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ed70-4a3c-4e9e-b0be-f64c118bff35 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:42.404788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ed70-4a3c-4e9e-b0be-f64c118bff35 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:42.405262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ed70-4a3c-4e9e-b0be-f64c118bff35 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7/groups/839ee28818b84c0f9cc8a9a521d5dfd2/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:42.407471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765ed70-4a3c-4e9e-b0be-f64c118bff35 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d227408446e4141a1dcab80c9df19f7, group_id=839ee28818b84c0f9cc8a9a521d5dfd2, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:42.409301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765ed70-4a3c-4e9e-b0be-f64c118bff35 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:42.428400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9811ebc-7376-4446-bb3f-05dd62753163 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:42.436216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:42.463577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe448c-3a3c-432a-aa96-61299fe72ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:42.464218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe448c-3a3c-432a-aa96-61299fe72ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:42.464504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe448c-3a3c-432a-aa96-61299fe72ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:42.464783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe448c-3a3c-432a-aa96-61299fe72ff9 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:42.466520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe448c-3a3c-432a-aa96-61299fe72ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:42.467957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe448c-3a3c-432a-aa96-61299fe72ff9 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:42.469590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 208/408] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:42 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:42.474170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe448c-3a3c-432a-aa96-61299fe72ff9 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:42.493662 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 201/409] 10.222.0.77 () {58 vars in 1442 bytes} [Wed Sep 14 11:47:42 2022] PUT /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7/groups/839ee28818b84c0f9cc8a9a521d5dfd2/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:42.497041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22f2d-26d0-4343-a0c1-b582c0d75754 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:42.497041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22f2d-26d0-4343-a0c1-b582c0d75754 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:42.497041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22f2d-26d0-4343-a0c1-b582c0d75754 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:42.497652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 202/410] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:42.501452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22f2d-26d0-4343-a0c1-b582c0d75754 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:42.612933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe448c-3a3c-432a-aa96-61299fe72ff9 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:42.630642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:42.635856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22f2d-26d0-4343-a0c1-b582c0d75754 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:42.663156 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c989dc-a7f4-4147-a0e9-31a745c58540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:42.663726 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c989dc-a7f4-4147-a0e9-31a745c58540 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:42.664398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c989dc-a7f4-4147-a0e9-31a745c58540 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:42.664673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c989dc-a7f4-4147-a0e9-31a745c58540 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:42.676982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd964e1-9d0f-4025-91bb-652e0e74ea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:42.685255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd964e1-9d0f-4025-91bb-652e0e74ea47 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:42.685255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd964e1-9d0f-4025-91bb-652e0e74ea47 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:42.685255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd964e1-9d0f-4025-91bb-652e0e74ea47 None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7/groups/839ee28818b84c0f9cc8a9a521d5dfd2/roles/08735f4fc39148328610ad98ba651850` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:42.685542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c989dc-a7f4-4147-a0e9-31a745c58540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:42.685661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd964e1-9d0f-4025-91bb-652e0e74ea47 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d227408446e4141a1dcab80c9df19f7, group_id=839ee28818b84c0f9cc8a9a521d5dfd2, role_id=08735f4fc39148328610ad98ba651850)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:42.685661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd964e1-9d0f-4025-91bb-652e0e74ea47 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-43c989dc-a7f4-4147-a0e9-31a745c58540 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:42.687046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:42.688060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:42.688859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:42.690540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 209/411] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:47:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:42.691939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51181a25-6cd6-4df0-af28-afd7326d3d9d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:42.692265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51181a25-6cd6-4df0-af28-afd7326d3d9d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:42.692564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51181a25-6cd6-4df0-af28-afd7326d3d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:42.711993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-51181a25-6cd6-4df0-af28-afd7326d3d9d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:42.713245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-51181a25-6cd6-4df0-af28-afd7326d3d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:42.742267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:42.769607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 203/412] 10.222.0.77 () {58 vars in 1442 bytes} [Wed Sep 14 11:47:42 2022] PUT /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7/groups/839ee28818b84c0f9cc8a9a521d5dfd2/roles/08735f4fc39148328610ad98ba651850 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:42.778836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd964e1-9d0f-4025-91bb-652e0e74ea47 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:42.789662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 210/413] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:42.927378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd964e1-9d0f-4025-91bb-652e0e74ea47 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:42.975466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8e12b-357a-47f5-83af-8cc0e4d8683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:42.976533 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8e12b-357a-47f5-83af-8cc0e4d8683b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:42.976984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8e12b-357a-47f5-83af-8cc0e4d8683b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:42.977422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8e12b-357a-47f5-83af-8cc0e4d8683b None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:42.978423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8e12b-357a-47f5-83af-8cc0e4d8683b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:42.978907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8e12b-357a-47f5-83af-8cc0e4d8683b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:42.980475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8e12b-357a-47f5-83af-8cc0e4d8683b None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:42.990085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 204/414] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:42.996189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51181a25-6cd6-4df0-af28-afd7326d3d9d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:43.115714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51181a25-6cd6-4df0-af28-afd7326d3d9d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:43.133539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8e12b-357a-47f5-83af-8cc0e4d8683b None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:43.161654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa459554-c1ba-4f45-a091-56fdacc99ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:43.162336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa459554-c1ba-4f45-a091-56fdacc99ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:43.162620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa459554-c1ba-4f45-a091-56fdacc99ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:43.162894 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa459554-c1ba-4f45-a091-56fdacc99ea6 None admin] PATH_INFO: `/v3/groups/0632dd0570c44328b8042701c19c3b02` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:43.166430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:43.167592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa459554-c1ba-4f45-a091-56fdacc99ea6 None admin] RBAC: Authorizing `identity:get_group(group_id=0632dd0570c44328b8042701c19c3b02)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:43.169089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa459554-c1ba-4f45-a091-56fdacc99ea6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:43.171045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 211/415] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:42 2022] GET /identity/v3/groups/0632dd0570c44328b8042701c19c3b02 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:43.182464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa459554-c1ba-4f45-a091-56fdacc99ea6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:43.245064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:43.303632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8e12b-357a-47f5-83af-8cc0e4d8683b None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:43.344332 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65ba7c-d741-4240-bab7-b6250c70e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:43.345004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65ba7c-d741-4240-bab7-b6250c70e9ce None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:43.345291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65ba7c-d741-4240-bab7-b6250c70e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:43.345566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65ba7c-d741-4240-bab7-b6250c70e9ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:43.361234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65ba7c-d741-4240-bab7-b6250c70e9ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-ef65ba7c-d741-4240-bab7-b6250c70e9ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:43.366688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:43.367645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:43.368425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 205/416] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:43.374840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65ba7c-d741-4240-bab7-b6250c70e9ce None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:43.415657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa459554-c1ba-4f45-a091-56fdacc99ea6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:43.479439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ea786-d9e5-467d-b7da-4df5799a7fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:43.480052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ea786-d9e5-467d-b7da-4df5799a7fcc None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:43.480279 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ea786-d9e5-467d-b7da-4df5799a7fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:43.480541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ea786-d9e5-467d-b7da-4df5799a7fcc None admin] PATH_INFO: `/v3/projects/44214f6312fa43ec8a83e2996bf5a5af` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:43.482342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ea786-d9e5-467d-b7da-4df5799a7fcc None admin] RBAC: Authorizing `identity:get_project(project_id=44214f6312fa43ec8a83e2996bf5a5af)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:43.485092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ea786-d9e5-467d-b7da-4df5799a7fcc None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:43.486815 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 212/417] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:43 2022] GET /identity/v3/projects/44214f6312fa43ec8a83e2996bf5a5af => generated 344 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:43.488094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9455645-cd77-4647-9fd7-86ed3412fc66 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:43.488386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9455645-cd77-4647-9fd7-86ed3412fc66 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:43.488660 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9455645-cd77-4647-9fd7-86ed3412fc66 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:43.490896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 213/418] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:43.495194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9455645-cd77-4647-9fd7-86ed3412fc66 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:43.501205 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:43.525799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65ba7c-d741-4240-bab7-b6250c70e9ce None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:43.572832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d559d-4670-4fc7-999c-92263db4f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:43.574822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d559d-4670-4fc7-999c-92263db4f3fb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:43.575641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d559d-4670-4fc7-999c-92263db4f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:43.576463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d559d-4670-4fc7-999c-92263db4f3fb None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:43.578251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d559d-4670-4fc7-999c-92263db4f3fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:43.578968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d559d-4670-4fc7-999c-92263db4f3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:43.580703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d559d-4670-4fc7-999c-92263db4f3fb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:43.596018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 206/419] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:43.597608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca1a5-3eb4-405c-9f56-7f305ca678f0 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:43.598195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca1a5-3eb4-405c-9f56-7f305ca678f0 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:43.598711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca1a5-3eb4-405c-9f56-7f305ca678f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:43.611671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:43.619065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9455645-cd77-4647-9fd7-86ed3412fc66 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:43.626581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ac7ca1a5-3eb4-405c-9f56-7f305ca678f0 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:43.627777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ac7ca1a5-3eb4-405c-9f56-7f305ca678f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:43.659368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80547c7-2288-42bf-b5fb-db0d5c86a880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:43.660463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80547c7-2288-42bf-b5fb-db0d5c86a880 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:43.660953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80547c7-2288-42bf-b5fb-db0d5c86a880 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:43.661426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80547c7-2288-42bf-b5fb-db0d5c86a880 None admin] PATH_INFO: `/v3/projects/44214f6312fa43ec8a83e2996bf5a5af/groups/0632dd0570c44328b8042701c19c3b02/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:43.664713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80547c7-2288-42bf-b5fb-db0d5c86a880 None admin] RBAC: Authorizing `identity:create_grant(project_id=44214f6312fa43ec8a83e2996bf5a5af, group_id=0632dd0570c44328b8042701c19c3b02, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:43.666791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80547c7-2288-42bf-b5fb-db0d5c86a880 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:43.710241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 207/420] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:43.710241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ca1a5-3eb4-405c-9f56-7f305ca678f0 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:43.750773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 214/421] 10.222.0.77 () {58 vars in 1442 bytes} [Wed Sep 14 11:47:43 2022] PUT /identity/v3/projects/44214f6312fa43ec8a83e2996bf5a5af/groups/0632dd0570c44328b8042701c19c3b02/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:47:43.798253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:43.832735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ca1a5-3eb4-405c-9f56-7f305ca678f0 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:43.870015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86400872-88dd-49f2-9b45-0e2c8e88b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:43.870661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86400872-88dd-49f2-9b45-0e2c8e88b6aa None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:43.870937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86400872-88dd-49f2-9b45-0e2c8e88b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:43.871924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86400872-88dd-49f2-9b45-0e2c8e88b6aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:43.946255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86400872-88dd-49f2-9b45-0e2c8e88b6aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:43.947789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86400872-88dd-49f2-9b45-0e2c8e88b6aa None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:44.018100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80547c7-2288-42bf-b5fb-db0d5c86a880 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:44.025736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:44.066455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 208/422] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:44.072007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86400872-88dd-49f2-9b45-0e2c8e88b6aa None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:44.139837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80547c7-2288-42bf-b5fb-db0d5c86a880 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:44.175352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86400872-88dd-49f2-9b45-0e2c8e88b6aa None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:44.179570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94f77-b0d4-490f-933c-b10720d1b6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:44.180473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94f77-b0d4-490f-933c-b10720d1b6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:44.180965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94f77-b0d4-490f-933c-b10720d1b6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:44.181463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94f77-b0d4-490f-933c-b10720d1b6e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:44.193391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d94f77-b0d4-490f-933c-b10720d1b6e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-98d94f77-b0d4-490f-933c-b10720d1b6e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:44.199014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:44.200424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:44.201312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:44.203927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 215/423] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:44.210261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a8e55-fd7f-436a-ad38-0cbdaf6a224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:44.210889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8e55-fd7f-436a-ad38-0cbdaf6a224d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:44.211114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94f77-b0d4-490f-933c-b10720d1b6e7 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:44.211213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8e55-fd7f-436a-ad38-0cbdaf6a224d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:44.211417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8e55-fd7f-436a-ad38-0cbdaf6a224d None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:44.213556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a8e55-fd7f-436a-ad38-0cbdaf6a224d None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:44.215814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a8e55-fd7f-436a-ad38-0cbdaf6a224d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:44.217719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 209/424] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:44 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:44.222885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a8e55-fd7f-436a-ad38-0cbdaf6a224d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:44.237811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:44.265073 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:44.325926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a8e55-fd7f-436a-ad38-0cbdaf6a224d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:44.328799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94f77-b0d4-490f-933c-b10720d1b6e7 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:44.360499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e6304-79f0-4163-927f-ee6130a350b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:44.361130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6304-79f0-4163-927f-ee6130a350b7 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:44.361411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6304-79f0-4163-927f-ee6130a350b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:44.361685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6304-79f0-4163-927f-ee6130a350b7 None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:44.362909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e6304-79f0-4163-927f-ee6130a350b7 None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:44.364336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e6304-79f0-4163-927f-ee6130a350b7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:44.366198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 210/425] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:44 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:44.370784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba61d04-95d4-4261-af59-a022a8ca720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:44.371711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba61d04-95d4-4261-af59-a022a8ca720a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:44.372175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba61d04-95d4-4261-af59-a022a8ca720a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:44.372278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e6304-79f0-4163-927f-ee6130a350b7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:44.372862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba61d04-95d4-4261-af59-a022a8ca720a None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:44.373759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba61d04-95d4-4261-af59-a022a8ca720a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:44.374288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba61d04-95d4-4261-af59-a022a8ca720a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:44.376152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba61d04-95d4-4261-af59-a022a8ca720a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:44.385972 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 216/426] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:44.392770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba61d04-95d4-4261-af59-a022a8ca720a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:44.486655 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:44.498141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e6304-79f0-4163-927f-ee6130a350b7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:44.509712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:44.511522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba61d04-95d4-4261-af59-a022a8ca720a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:44.541000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f759e-dbe1-4f99-b909-da69632852e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:44.541611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f759e-dbe1-4f99-b909-da69632852e8 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:44.541888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f759e-dbe1-4f99-b909-da69632852e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:44.542162 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f759e-dbe1-4f99-b909-da69632852e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:44.543314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f759e-dbe1-4f99-b909-da69632852e8 None admin] RBAC: Adding query filter params (group.id=839ee28818b84c0f9cc8a9a521d5dfd2, role.id=5fb006eca1744bd592b59b08b23ef7f2, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:44.543987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f759e-dbe1-4f99-b909-da69632852e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:44.545625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f759e-dbe1-4f99-b909-da69632852e8 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:44.551997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606e7ba-0e6c-4bcf-ade4-da8632a8ba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:44.552804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 211/427] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Sep 14 11:47:44 2022] GET /identity/v3/role_assignments?group.id=839ee28818b84c0f9cc8a9a521d5dfd2&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:44.553130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e7ba-0e6c-4bcf-ade4-da8632a8ba56 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:44.553607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e7ba-0e6c-4bcf-ade4-da8632a8ba56 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:44.554114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e7ba-0e6c-4bcf-ade4-da8632a8ba56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:44.685955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606e7ba-0e6c-4bcf-ade4-da8632a8ba56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:44.687530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606e7ba-0e6c-4bcf-ade4-da8632a8ba56 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:44.772802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:44.791265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 217/428] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 11:47:44.797271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f759e-dbe1-4f99-b909-da69632852e8 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:44.923996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f759e-dbe1-4f99-b909-da69632852e8 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:44.963755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a22827-37cd-43cd-87db-2c7e041a4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:44.964412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22827-37cd-43cd-87db-2c7e041a4799 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:44.964689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22827-37cd-43cd-87db-2c7e041a4799 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:44.965324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22827-37cd-43cd-87db-2c7e041a4799 None admin] PATH_INFO: `/v3/projects/7d5dbb2d887b42bfb6786e6517b28784` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:44.966633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a22827-37cd-43cd-87db-2c7e041a4799 None admin] RBAC: Authorizing `identity:get_project(project_id=7d5dbb2d887b42bfb6786e6517b28784)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:44.968185 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a22827-37cd-43cd-87db-2c7e041a4799 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:44.969979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 212/429] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:44 2022] GET /identity/v3/projects/7d5dbb2d887b42bfb6786e6517b28784 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:44.976056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606e7ba-0e6c-4bcf-ade4-da8632a8ba56 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:45.093462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606e7ba-0e6c-4bcf-ade4-da8632a8ba56 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:45.133383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431da76d-8b48-4074-9278-5143c2f5c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:45.135184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c85f9-0534-4462-9a38-4550f8ab7f8c None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:45.135565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c85f9-0534-4462-9a38-4550f8ab7f8c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:45.135742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c85f9-0534-4462-9a38-4550f8ab7f8c None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:45.137361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 213/430] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:47:45.137850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da76d-8b48-4074-9278-5143c2f5c9ab None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:45.138129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da76d-8b48-4074-9278-5143c2f5c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:45.138421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da76d-8b48-4074-9278-5143c2f5c9ab None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:45.139668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431da76d-8b48-4074-9278-5143c2f5c9ab None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:45.141117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431da76d-8b48-4074-9278-5143c2f5c9ab None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:45.144428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 218/431] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:44 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:45.144557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3978b-61d2-4352-9c67-300182575604 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:45.144557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3978b-61d2-4352-9c67-300182575604 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:45.144557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3978b-61d2-4352-9c67-300182575604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:45.150719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431da76d-8b48-4074-9278-5143c2f5c9ab None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:45.166367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-a1c3978b-61d2-4352-9c67-300182575604 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:45.167936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a1c3978b-61d2-4352-9c67-300182575604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:45.217512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:45.234592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:45.271343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 214/432] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:47:45.295244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431da76d-8b48-4074-9278-5143c2f5c9ab None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:45.333911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cf7ae-bb62-4d53-8b6b-32bbca0475aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:45.334647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cf7ae-bb62-4d53-8b6b-32bbca0475aa None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:45.335019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cf7ae-bb62-4d53-8b6b-32bbca0475aa None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:45.335366 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cf7ae-bb62-4d53-8b6b-32bbca0475aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:45.336164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cf7ae-bb62-4d53-8b6b-32bbca0475aa None admin] RBAC: Adding query filter params (group.id=839ee28818b84c0f9cc8a9a521d5dfd2, role.id=08735f4fc39148328610ad98ba651850, scope.project.id=7d5dbb2d887b42bfb6786e6517b28784) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:45.336541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cf7ae-bb62-4d53-8b6b-32bbca0475aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:45.338046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cf7ae-bb62-4d53-8b6b-32bbca0475aa None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:45.345396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 219/433] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Sep 14 11:47:45 2022] GET /identity/v3/role_assignments?group.id=839ee28818b84c0f9cc8a9a521d5dfd2&scope.project.id=7d5dbb2d887b42bfb6786e6517b28784&role.id=08735f4fc39148328610ad98ba651850 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:45.586528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3978b-61d2-4352-9c67-300182575604 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:45.658839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369136d-1c53-4487-a995-cfbac771d70a None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:45.659346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369136d-1c53-4487-a995-cfbac771d70a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:45.659629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369136d-1c53-4487-a995-cfbac771d70a None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:45.661202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 220/434] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:45.666109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88eaf4-156e-4677-ae5f-3934ef95d673 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:45.666423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88eaf4-156e-4677-ae5f-3934ef95d673 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:45.666702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88eaf4-156e-4677-ae5f-3934ef95d673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:45.690677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-7c88eaf4-156e-4677-ae5f-3934ef95d673 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:45.691907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7c88eaf4-156e-4677-ae5f-3934ef95d673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:45.707739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3978b-61d2-4352-9c67-300182575604 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:45.743134 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadb109-2656-4711-847c-c1cb5d8b56db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:45.743775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadb109-2656-4711-847c-c1cb5d8b56db None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:45.744054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadb109-2656-4711-847c-c1cb5d8b56db None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:45.744328 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadb109-2656-4711-847c-c1cb5d8b56db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:45.763195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadb109-2656-4711-847c-c1cb5d8b56db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-7dadb109-2656-4711-847c-c1cb5d8b56db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:45.770089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:45.771007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 11:47:45.771816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:45.772437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 215/435] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:45.779986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 221/436] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:47:45.783301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadb109-2656-4711-847c-c1cb5d8b56db None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:45.819342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:45.900505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadb109-2656-4711-847c-c1cb5d8b56db None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:45.935830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc015b74-de44-4ab5-bc61-300b9965f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:45.936435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc015b74-de44-4ab5-bc61-300b9965f1ea None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:45.936710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc015b74-de44-4ab5-bc61-300b9965f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:45.936979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc015b74-de44-4ab5-bc61-300b9965f1ea None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:45.937657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc015b74-de44-4ab5-bc61-300b9965f1ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:45.937936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc015b74-de44-4ab5-bc61-300b9965f1ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:45.939316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc015b74-de44-4ab5-bc61-300b9965f1ea None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:45.948025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 216/437] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:47:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:45.954952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88eaf4-156e-4677-ae5f-3934ef95d673 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:46.001769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:46.055349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88eaf4-156e-4677-ae5f-3934ef95d673 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:46.056889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc015b74-de44-4ab5-bc61-300b9965f1ea None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:46.092017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9affbb-a95b-4bff-bb01-f2032b95ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:46.092628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9affbb-a95b-4bff-bb01-f2032b95ddbf None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:46.092910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9affbb-a95b-4bff-bb01-f2032b95ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:46.093183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9affbb-a95b-4bff-bb01-f2032b95ddbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:46.151694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:46.161039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc015b74-de44-4ab5-bc61-300b9965f1ea None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:46.165932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9affbb-a95b-4bff-bb01-f2032b95ddbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:46.167413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9affbb-a95b-4bff-bb01-f2032b95ddbf None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:46.195543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a31061-d3c6-4af3-add8-1b59d9f000f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:46.196175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a31061-d3c6-4af3-add8-1b59d9f000f7 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:46.196475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a31061-d3c6-4af3-add8-1b59d9f000f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:46.196728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a31061-d3c6-4af3-add8-1b59d9f000f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:46.208913 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a31061-d3c6-4af3-add8-1b59d9f000f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:46.214413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-34a31061-d3c6-4af3-add8-1b59d9f000f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:46.214579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:46.215729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:46.216577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 217/438] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:46.221568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a31061-d3c6-4af3-add8-1b59d9f000f7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:46.284184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 222/439] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:46.285353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9affbb-a95b-4bff-bb01-f2032b95ddbf None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:46.331535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a31061-d3c6-4af3-add8-1b59d9f000f7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:46.368621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cb0c1-5958-4f7a-a634-29d8ae1070d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:46.369260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cb0c1-5958-4f7a-a634-29d8ae1070d6 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:46.369540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cb0c1-5958-4f7a-a634-29d8ae1070d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:46.369812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cb0c1-5958-4f7a-a634-29d8ae1070d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:46.370555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cb0c1-5958-4f7a-a634-29d8ae1070d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:46.370833 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cb0c1-5958-4f7a-a634-29d8ae1070d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:46.372370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cb0c1-5958-4f7a-a634-29d8ae1070d6 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:46.381186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 218/440] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:46.388212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cb0c1-5958-4f7a-a634-29d8ae1070d6 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:46.401109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9affbb-a95b-4bff-bb01-f2032b95ddbf None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:46.407646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:46.437042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113318ac-4ae4-4054-b162-09c5ebb9950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:46.437673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113318ac-4ae4-4054-b162-09c5ebb9950f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:46.437961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113318ac-4ae4-4054-b162-09c5ebb9950f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:46.438258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113318ac-4ae4-4054-b162-09c5ebb9950f None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:46.439401 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113318ac-4ae4-4054-b162-09c5ebb9950f None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:46.441097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113318ac-4ae4-4054-b162-09c5ebb9950f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:46.442777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 223/441] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:46 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:46.448022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113318ac-4ae4-4054-b162-09c5ebb9950f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:46.464191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:46.500021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cb0c1-5958-4f7a-a634-29d8ae1070d6 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:46.533949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e41c1a-5979-49b6-baa4-fcafab087793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:46.534581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e41c1a-5979-49b6-baa4-fcafab087793 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:46.534864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e41c1a-5979-49b6-baa4-fcafab087793 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:46.535139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e41c1a-5979-49b6-baa4-fcafab087793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:46.551854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113318ac-4ae4-4054-b162-09c5ebb9950f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:46.585839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb1b9c-06e6-4b41-a8a7-6c4a67ed96a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:46.586488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb1b9c-06e6-4b41-a8a7-6c4a67ed96a4 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:46.586765 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb1b9c-06e6-4b41-a8a7-6c4a67ed96a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:46.587034 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb1b9c-06e6-4b41-a8a7-6c4a67ed96a4 None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:46.588137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb1b9c-06e6-4b41-a8a7-6c4a67ed96a4 None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:46.589574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb1b9c-06e6-4b41-a8a7-6c4a67ed96a4 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:46.596839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 224/442] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:46 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:46.596839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdedd3f-ef0f-432c-b409-6bce685a99de None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:46.596839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdedd3f-ef0f-432c-b409-6bce685a99de None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:46.596839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdedd3f-ef0f-432c-b409-6bce685a99de None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:46.596839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 225/443] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:46.599148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdedd3f-ef0f-432c-b409-6bce685a99de None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:46.606190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e41c1a-5979-49b6-baa4-fcafab087793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:46.607712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e41c1a-5979-49b6-baa4-fcafab087793 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:46.621971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:46.680797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:46.700699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdedd3f-ef0f-432c-b409-6bce685a99de None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:46.705629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 219/444] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 11:47:46.707634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990f114-9c84-4678-9a55-ab2c90b14fbe None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:46.707924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990f114-9c84-4678-9a55-ab2c90b14fbe None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:46.708195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990f114-9c84-4678-9a55-ab2c90b14fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:46.726265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2990f114-9c84-4678-9a55-ab2c90b14fbe None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:46.727443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2990f114-9c84-4678-9a55-ab2c90b14fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:46.735575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf4c37-94ef-487f-bba5-0b55ed7b836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:46.736181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4c37-94ef-487f-bba5-0b55ed7b836b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:46.736463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4c37-94ef-487f-bba5-0b55ed7b836b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:46.736733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4c37-94ef-487f-bba5-0b55ed7b836b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:46.737454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf4c37-94ef-487f-bba5-0b55ed7b836b None admin] RBAC: Adding query filter params (group.id=839ee28818b84c0f9cc8a9a521d5dfd2, role.id=5fb006eca1744bd592b59b08b23ef7f2, scope.project.id=9d227408446e4141a1dcab80c9df19f7) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:46.737761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf4c37-94ef-487f-bba5-0b55ed7b836b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:46.739204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf4c37-94ef-487f-bba5-0b55ed7b836b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:46.744841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 226/445] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Sep 14 11:47:46 2022] GET /identity/v3/role_assignments?group.id=839ee28818b84c0f9cc8a9a521d5dfd2&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=5fb006eca1744bd592b59b08b23ef7f2 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:46.745608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf4c37-94ef-487f-bba5-0b55ed7b836b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:46.799746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 220/446] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:46.867860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf4c37-94ef-487f-bba5-0b55ed7b836b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:46.906835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a6cce-9413-40af-ac4c-101409570efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:46.907492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a6cce-9413-40af-ac4c-101409570efd None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:46.907774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a6cce-9413-40af-ac4c-101409570efd None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:46.908047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a6cce-9413-40af-ac4c-101409570efd None admin] PATH_INFO: `/v3/projects/9d227408446e4141a1dcab80c9df19f7` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:46.909200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a6cce-9413-40af-ac4c-101409570efd None admin] RBAC: Authorizing `identity:get_project(project_id=9d227408446e4141a1dcab80c9df19f7)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:46.911586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a6cce-9413-40af-ac4c-101409570efd None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:46.914092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 227/447] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:46 2022] GET /identity/v3/projects/9d227408446e4141a1dcab80c9df19f7 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:46.919888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990f114-9c84-4678-9a55-ab2c90b14fbe None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:46.973146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:47.027957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990f114-9c84-4678-9a55-ab2c90b14fbe None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:47.063808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f1f50-2689-4ca9-962a-6ceb1e916418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:47.064441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1f50-2689-4ca9-962a-6ceb1e916418 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:47.064720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1f50-2689-4ca9-962a-6ceb1e916418 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:47.064992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f1f50-2689-4ca9-962a-6ceb1e916418 None admin] PATH_INFO: `/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:47.066413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f1f50-2689-4ca9-962a-6ceb1e916418 None admin] RBAC: Authorizing `identity:get_group(group_id=839ee28818b84c0f9cc8a9a521d5dfd2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:47.067863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f1f50-2689-4ca9-962a-6ceb1e916418 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:47.069608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 221/448] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:46 2022] GET /identity/v3/groups/839ee28818b84c0f9cc8a9a521d5dfd2 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:47:47.075904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a6cce-9413-40af-ac4c-101409570efd None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:47.091635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:47.096710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f1f50-2689-4ca9-962a-6ceb1e916418 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:47.186742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a6cce-9413-40af-ac4c-101409570efd None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:47.215987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f1f50-2689-4ca9-962a-6ceb1e916418 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:47.221662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423bc02-2f58-425a-8a11-ff831fcd6b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:47.222293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423bc02-2f58-425a-8a11-ff831fcd6b7b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:47.222576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423bc02-2f58-425a-8a11-ff831fcd6b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:47.222848 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423bc02-2f58-425a-8a11-ff831fcd6b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:47.223634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423bc02-2f58-425a-8a11-ff831fcd6b7b None admin] RBAC: Adding query filter params (group.id=839ee28818b84c0f9cc8a9a521d5dfd2, role.id=08735f4fc39148328610ad98ba651850, scope.project.id=9d227408446e4141a1dcab80c9df19f7) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:47.223878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423bc02-2f58-425a-8a11-ff831fcd6b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:47.225301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423bc02-2f58-425a-8a11-ff831fcd6b7b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:47.228758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:47.231457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 228/449] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Sep 14 11:47:47 2022] GET /identity/v3/role_assignments?group.id=839ee28818b84c0f9cc8a9a521d5dfd2&scope.project.id=9d227408446e4141a1dcab80c9df19f7&role.id=08735f4fc39148328610ad98ba651850 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:47.252044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcd11d-fd05-4a1f-a386-ae3b205f4df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:47.252693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcd11d-fd05-4a1f-a386-ae3b205f4df4 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:47.252977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcd11d-fd05-4a1f-a386-ae3b205f4df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:47.253252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcd11d-fd05-4a1f-a386-ae3b205f4df4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:47.265903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcd11d-fd05-4a1f-a386-ae3b205f4df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-80fcd11d-fd05-4a1f-a386-ae3b205f4df4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:47.271457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:47.272597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:47.275065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 222/450] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:47:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:47.278726 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423bc02-2f58-425a-8a11-ff831fcd6b7b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:47.361414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:47.384887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423bc02-2f58-425a-8a11-ff831fcd6b7b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:47.422420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d6cee-e520-490a-b193-fc3145b5a450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:47.423033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d6cee-e520-490a-b193-fc3145b5a450 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:47.423314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d6cee-e520-490a-b193-fc3145b5a450 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:47.423585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d6cee-e520-490a-b193-fc3145b5a450 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:47.424246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d6cee-e520-490a-b193-fc3145b5a450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:47.424545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d6cee-e520-490a-b193-fc3145b5a450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:47.425901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d6cee-e520-490a-b193-fc3145b5a450 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:47.434310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 229/451] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:47.440605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcd11d-fd05-4a1f-a386-ae3b205f4df4 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:47.540885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcd11d-fd05-4a1f-a386-ae3b205f4df4 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:47.576843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a64030-15ff-4696-a377-d48a80ba03a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:47.577456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64030-15ff-4696-a377-d48a80ba03a5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:47.577732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64030-15ff-4696-a377-d48a80ba03a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:47.578000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64030-15ff-4696-a377-d48a80ba03a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:47.626882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:47.655712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a64030-15ff-4696-a377-d48a80ba03a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:47.657173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a64030-15ff-4696-a377-d48a80ba03a5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:47.751889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 223/452] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:47.757541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d6cee-e520-490a-b193-fc3145b5a450 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:47.855538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d6cee-e520-490a-b193-fc3145b5a450 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:47.888152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd3753-4c63-4d55-a294-66e7a7e57c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:47.888774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd3753-4c63-4d55-a294-66e7a7e57c0e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:47.889054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd3753-4c63-4d55-a294-66e7a7e57c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:47.889325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd3753-4c63-4d55-a294-66e7a7e57c0e None admin] PATH_INFO: `/v3/projects/44214f6312fa43ec8a83e2996bf5a5af` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:47.890467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd3753-4c63-4d55-a294-66e7a7e57c0e None admin] RBAC: Authorizing `identity:get_project(project_id=44214f6312fa43ec8a83e2996bf5a5af)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:47.891903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd3753-4c63-4d55-a294-66e7a7e57c0e None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:47.893500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 230/453] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:47:47 2022] GET /identity/v3/projects/44214f6312fa43ec8a83e2996bf5a5af => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:47.899014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a64030-15ff-4696-a377-d48a80ba03a5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:47.967395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:47.995577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a64030-15ff-4696-a377-d48a80ba03a5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:48.028826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803859-920e-48df-a8b7-05f56ddee5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:48.029437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803859-920e-48df-a8b7-05f56ddee5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:48.029718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803859-920e-48df-a8b7-05f56ddee5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:48.029990 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803859-920e-48df-a8b7-05f56ddee5a9 None admin] PATH_INFO: `/v3/groups/0632dd0570c44328b8042701c19c3b02` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:48.031118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803859-920e-48df-a8b7-05f56ddee5a9 None admin] RBAC: Authorizing `identity:get_group(group_id=0632dd0570c44328b8042701c19c3b02)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:48.032548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803859-920e-48df-a8b7-05f56ddee5a9 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:48.034096 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 224/454] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Sep 14 11:47:47 2022] GET /identity/v3/groups/0632dd0570c44328b8042701c19c3b02 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:48.039929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd3753-4c63-4d55-a294-66e7a7e57c0e None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:48.048938 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:48.136534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd3753-4c63-4d55-a294-66e7a7e57c0e None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:48.169450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74230bf1-4189-4d50-b618-bb5062765cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:48.170038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74230bf1-4189-4d50-b618-bb5062765cee None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:48.170345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74230bf1-4189-4d50-b618-bb5062765cee None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:48.170618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74230bf1-4189-4d50-b618-bb5062765cee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:48.171330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74230bf1-4189-4d50-b618-bb5062765cee None admin] RBAC: Adding query filter params (group.id=0632dd0570c44328b8042701c19c3b02, role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=44214f6312fa43ec8a83e2996bf5a5af) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:48.171632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74230bf1-4189-4d50-b618-bb5062765cee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:48.173050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74230bf1-4189-4d50-b618-bb5062765cee None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:48.178559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 231/455] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Sep 14 11:47:48 2022] GET /identity/v3/role_assignments?group.id=0632dd0570c44328b8042701c19c3b02&scope.project.id=44214f6312fa43ec8a83e2996bf5a5af&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:50.817563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fa33e-8777-4349-a4b6-9af7d7f8c6a1 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:50.818099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fa33e-8777-4349-a4b6-9af7d7f8c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:50.818378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fa33e-8777-4349-a4b6-9af7d7f8c6a1 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:50.819837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 225/456] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:50.830236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44663f-9363-4d7e-89db-3af9c5f2d144 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:50.830688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44663f-9363-4d7e-89db-3af9c5f2d144 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:50.830788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44663f-9363-4d7e-89db-3af9c5f2d144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:50.853453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2b44663f-9363-4d7e-89db-3af9c5f2d144 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:50.854716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2b44663f-9363-4d7e-89db-3af9c5f2d144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:50.932137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:50.943236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 232/457] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:51.264035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84453a6c-cf80-4d96-9a78-1d44810ff2af None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:51.264224 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84453a6c-cf80-4d96-9a78-1d44810ff2af None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:51.264484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84453a6c-cf80-4d96-9a78-1d44810ff2af None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:51.265867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 226/458] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:51.280132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7f9d6-9a70-492e-b159-77b60748656b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:51.280433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7f9d6-9a70-492e-b159-77b60748656b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:51.280688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7f9d6-9a70-492e-b159-77b60748656b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:51.307249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-a6a7f9d6-9a70-492e-b159-77b60748656b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:51.308508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a6a7f9d6-9a70-492e-b159-77b60748656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:51.337010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84453a6c-cf80-4d96-9a78-1d44810ff2af None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:51.431760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 233/459] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:51.438235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ec25d-e314-470b-9f35-b2e859b0ea54 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:51.438235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ec25d-e314-470b-9f35-b2e859b0ea54 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:51.438235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ec25d-e314-470b-9f35-b2e859b0ea54 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:51.438235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 234/460] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:51.442598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90288f1f-3497-4c3c-a5f0-d1805c5144d6 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:51.442881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90288f1f-3497-4c3c-a5f0-d1805c5144d6 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:51.443156 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90288f1f-3497-4c3c-a5f0-d1805c5144d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:51.482627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-90288f1f-3497-4c3c-a5f0-d1805c5144d6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:51.483834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-90288f1f-3497-4c3c-a5f0-d1805c5144d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:51.511642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84453a6c-cf80-4d96-9a78-1d44810ff2af None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:51.548219 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e042ab-1fd7-463d-b7a6-5ab9d3732765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:51.549052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e042ab-1fd7-463d-b7a6-5ab9d3732765 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:51.549495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e042ab-1fd7-463d-b7a6-5ab9d3732765 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:51.549920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e042ab-1fd7-463d-b7a6-5ab9d3732765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:51.558319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:51.561180 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e042ab-1fd7-463d-b7a6-5ab9d3732765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:51.562856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e042ab-1fd7-463d-b7a6-5ab9d3732765 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:51.566606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 235/461] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:51.568069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b034403-07f4-493c-8e42-384779d7707c None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:51.568535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b034403-07f4-493c-8e42-384779d7707c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:51.568985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b034403-07f4-493c-8e42-384779d7707c None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:51.575391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 236/462] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:51.580316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08b7bb-d579-476b-b5a5-078838793593 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:51.583998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08b7bb-d579-476b-b5a5-078838793593 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:51.583998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08b7bb-d579-476b-b5a5-078838793593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-c0e042ab-1fd7-463d-b7a6-5ab9d3732765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:51.592760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:51.593840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:51.594808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:51.594808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:51.594808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:51.595945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 227/463] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:51.606691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e042ab-1fd7-463d-b7a6-5ab9d3732765 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:51.632392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-fe08b7bb-d579-476b-b5a5-078838793593 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:51.633590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fe08b7bb-d579-476b-b5a5-078838793593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:51.756585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:51.779289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 237/464] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:51.780886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08b7bb-d579-476b-b5a5-078838793593 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:51.783438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e042ab-1fd7-463d-b7a6-5ab9d3732765 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:51.883092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1ba08-2e21-4e50-8e46-cd292c4510a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:51.883722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1ba08-2e21-4e50-8e46-cd292c4510a3 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:51.883963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1ba08-2e21-4e50-8e46-cd292c4510a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:51.884155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1ba08-2e21-4e50-8e46-cd292c4510a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:51.884792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1ba08-2e21-4e50-8e46-cd292c4510a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:51.885089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1ba08-2e21-4e50-8e46-cd292c4510a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:51.886564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1ba08-2e21-4e50-8e46-cd292c4510a3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:51.887939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08b7bb-d579-476b-b5a5-078838793593 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:51.905602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 228/465] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:51.906611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1ba08-2e21-4e50-8e46-cd292c4510a3 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:51.935513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b229-8c8e-43ec-9a62-0476f2328d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:51.936301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b229-8c8e-43ec-9a62-0476f2328d89 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:51.936587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b229-8c8e-43ec-9a62-0476f2328d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:51.936867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b229-8c8e-43ec-9a62-0476f2328d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:51.948340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6b229-8c8e-43ec-9a62-0476f2328d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:51.950147 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6b229-8c8e-43ec-9a62-0476f2328d89 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-b7f6b229-8c8e-43ec-9a62-0476f2328d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:51.966767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:51.967672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:51.968505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:51.968505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:51.968505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:51.968505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 238/466] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:51.973482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:51.974199 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b229-8c8e-43ec-9a62-0476f2328d89 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:52.020875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1ba08-2e21-4e50-8e46-cd292c4510a3 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:52.024237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:52.056617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a261103-8413-4518-b0c3-b115e02278e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:52.057476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261103-8413-4518-b0c3-b115e02278e1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:52.059446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261103-8413-4518-b0c3-b115e02278e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:52.059869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261103-8413-4518-b0c3-b115e02278e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:52.071851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a261103-8413-4518-b0c3-b115e02278e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:52.073632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a261103-8413-4518-b0c3-b115e02278e1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:52.085977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b229-8c8e-43ec-9a62-0476f2328d89 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-6a261103-8413-4518-b0c3-b115e02278e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:52.090063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:52.091126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:52.092125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:52.092125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:52.092125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:52.093755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 229/467] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:52.094839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a261103-8413-4518-b0c3-b115e02278e1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:52.125946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7af4e-f035-4d90-9571-97b63d2ba853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:52.126616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7af4e-f035-4d90-9571-97b63d2ba853 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:52.126901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7af4e-f035-4d90-9571-97b63d2ba853 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:52.127176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7af4e-f035-4d90-9571-97b63d2ba853 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:52.127822 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7af4e-f035-4d90-9571-97b63d2ba853 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:52.129251 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7af4e-f035-4d90-9571-97b63d2ba853 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:52.200963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a261103-8413-4518-b0c3-b115e02278e1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:52.203413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:52.242784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 239/468] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:47:51 2022] POST /identity/v3/users => generated 246 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:47:52.243893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7af4e-f035-4d90-9571-97b63d2ba853 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:52.244217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f51051-c075-4614-9591-996ac5349bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:52.244844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f51051-c075-4614-9591-996ac5349bae None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:52.245193 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f51051-c075-4614-9591-996ac5349bae None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:52.245501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f51051-c075-4614-9591-996ac5349bae None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:52.246727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f51051-c075-4614-9591-996ac5349bae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:52.247033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f51051-c075-4614-9591-996ac5349bae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:52.248533 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f51051-c075-4614-9591-996ac5349bae None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:52.267279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 230/469] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:52.267279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f51051-c075-4614-9591-996ac5349bae None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:52.366344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:52.370578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7af4e-f035-4d90-9571-97b63d2ba853 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:52.386511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f51051-c075-4614-9591-996ac5349bae None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:52.412416 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ed0e0-d76e-4034-82b4-447fed284d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:52.413411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed0e0-d76e-4034-82b4-447fed284d7c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:52.413702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed0e0-d76e-4034-82b4-447fed284d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:52.413980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ed0e0-d76e-4034-82b4-447fed284d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:52.426497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5618d-64c7-427b-9072-303b62116d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:52.426813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ed0e0-d76e-4034-82b4-447fed284d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:52.427114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5618d-64c7-427b-9072-303b62116d27 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:52.427395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5618d-64c7-427b-9072-303b62116d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:52.427668 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5618d-64c7-427b-9072-303b62116d27 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:52.428319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5618d-64c7-427b-9072-303b62116d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:52.428623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5618d-64c7-427b-9072-303b62116d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:52.429142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ed0e0-d76e-4034-82b4-447fed284d7c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:52.430942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5618d-64c7-427b-9072-303b62116d27 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:52.444639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 231/470] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-da5ed0e0-d76e-4034-82b4-447fed284d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:52.445304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:52.446201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:52.447140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:52.447140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:52.447140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:52.447140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 240/471] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:52.447350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5618d-64c7-427b-9072-303b62116d27 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:52.447916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed143a-1862-4e4b-bfd1-da4f42d70ea3 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:52.448192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed143a-1862-4e4b-bfd1-da4f42d70ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:52.448458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed143a-1862-4e4b-bfd1-da4f42d70ea3 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:52.450782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 241/472] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:52.451485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed143a-1862-4e4b-bfd1-da4f42d70ea3 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:52.474434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:52.557287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5618d-64c7-427b-9072-303b62116d27 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:52.566147 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed143a-1862-4e4b-bfd1-da4f42d70ea3 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:52.593623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9090ab-e1eb-4b9c-97a0-641e53cfad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:52.594659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9090ab-e1eb-4b9c-97a0-641e53cfad1a None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:52.595329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9090ab-e1eb-4b9c-97a0-641e53cfad1a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:52.595677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9090ab-e1eb-4b9c-97a0-641e53cfad1a None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:52.596421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9090ab-e1eb-4b9c-97a0-641e53cfad1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:52.597869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9090ab-e1eb-4b9c-97a0-641e53cfad1a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:52.606535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c8bd3-e022-4f79-9f13-a3574c422de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:52.607377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c8bd3-e022-4f79-9f13-a3574c422de9 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:52.607652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c8bd3-e022-4f79-9f13-a3574c422de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:52.607922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c8bd3-e022-4f79-9f13-a3574c422de9 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:52.608782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c8bd3-e022-4f79-9f13-a3574c422de9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:52.610007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c8bd3-e022-4f79-9f13-a3574c422de9 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:52.707088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 232/473] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:47:52 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:47:52.708350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3252a3-bed8-4e7e-b598-b0794b7f748d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:52.708637 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3252a3-bed8-4e7e-b598-b0794b7f748d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:52.708910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3252a3-bed8-4e7e-b598-b0794b7f748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:52.729071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-eb3252a3-bed8-4e7e-b598-b0794b7f748d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:52.730344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-eb3252a3-bed8-4e7e-b598-b0794b7f748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:52.747690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 242/474] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:47:52 2022] POST /identity/v3/users => generated 249 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:47:52.748643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c8bd3-e022-4f79-9f13-a3574c422de9 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:52.759558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:52.833380 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 233/475] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:52.906756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c8bd3-e022-4f79-9f13-a3574c422de9 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:52.948587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820e8a-b3ae-4f13-8464-4f997707c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:52.950236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820e8a-b3ae-4f13-8464-4f997707c656 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:52.950719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820e8a-b3ae-4f13-8464-4f997707c656 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:52.951184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e820e8a-b3ae-4f13-8464-4f997707c656 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:52.952065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e820e8a-b3ae-4f13-8464-4f997707c656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:52.952581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e820e8a-b3ae-4f13-8464-4f997707c656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:52.954169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e820e8a-b3ae-4f13-8464-4f997707c656 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:52.969007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 243/476] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:52.974687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3252a3-bed8-4e7e-b598-b0794b7f748d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:52.988422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:53.083663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3252a3-bed8-4e7e-b598-b0794b7f748d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:53.125696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539942-bc95-4a8b-837c-af05ff26a278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:53.126341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539942-bc95-4a8b-837c-af05ff26a278 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:53.126614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539942-bc95-4a8b-837c-af05ff26a278 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:53.126878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539942-bc95-4a8b-837c-af05ff26a278 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:53.127536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539942-bc95-4a8b-837c-af05ff26a278 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:53.128967 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539942-bc95-4a8b-837c-af05ff26a278 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:53.168157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820e8a-b3ae-4f13-8464-4f997707c656 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:53.216176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 234/477] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:47:52 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:47:53.251219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:53.290601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e820e8a-b3ae-4f13-8464-4f997707c656 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:53.331245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1e630-e431-4e6e-a14b-45284a469256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:53.331855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1e630-e431-4e6e-a14b-45284a469256 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:53.332134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1e630-e431-4e6e-a14b-45284a469256 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:53.332441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1e630-e431-4e6e-a14b-45284a469256 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:53.333091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1e630-e431-4e6e-a14b-45284a469256 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:53.334561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1e630-e431-4e6e-a14b-45284a469256 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:53.364094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.sql.core [None req-47f1e630-e431-4e6e-a14b-45284a469256 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 11:47:53.364094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 11:47:53.364094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [parameters: {'id': 'c42512510ef7438e87f75ab9622f74aa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 11:47:53.364094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81556) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-47f1e630-e431-4e6e-a14b-45284a469256 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application conn.query(q) Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result.read() Sep 14 11:47:53.386762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return ref.to_dict() Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 11:47:53.387677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application next(self.gen) Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application yield resource Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application next(self.gen) Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise self.value Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application session.commit() Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 11:47:53.388690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.session.flush() Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application compat.raise_( Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 11:47:53.389567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 11:47:53.392935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application conn.query(q) Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result.read() Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 11:47:53.395041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [parameters: {'id': 'c42512510ef7438e87f75ab9622f74aa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:53.396986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 11:47:53.398955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:53.400927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 244/478] 10.222.0.77 () {60 vars in 1131 bytes} [Wed Sep 14 11:47:53 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:53.401063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539942-bc95-4a8b-837c-af05ff26a278 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:53.490939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:53.540490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539942-bc95-4a8b-837c-af05ff26a278 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:53.577258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406a83-0678-4989-b228-20bdaaca4386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:53.577894 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406a83-0678-4989-b228-20bdaaca4386 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:53.578171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406a83-0678-4989-b228-20bdaaca4386 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:53.578481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406a83-0678-4989-b228-20bdaaca4386 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:53.589328 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406a83-0678-4989-b228-20bdaaca4386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-5b406a83-0678-4989-b228-20bdaaca4386 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:53.597968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:53.598912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 11:47:53.599694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:53.601497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 235/479] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:47:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:53.602538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1e630-e431-4e6e-a14b-45284a469256 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:53.711212 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1e630-e431-4e6e-a14b-45284a469256 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:53.740540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:53.747287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f02d3-2f23-4f24-8d99-fd47411f8bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:53.747891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f02d3-2f23-4f24-8d99-fd47411f8bed None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:53.748180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f02d3-2f23-4f24-8d99-fd47411f8bed None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:53.748533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f02d3-2f23-4f24-8d99-fd47411f8bed None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:53.749197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f02d3-2f23-4f24-8d99-fd47411f8bed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:53.749494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f02d3-2f23-4f24-8d99-fd47411f8bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:53.750888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f02d3-2f23-4f24-8d99-fd47411f8bed None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:53.766366 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 245/480] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:54.649241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab0186-1457-4e86-a964-02784c6d74f9 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:54.649777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab0186-1457-4e86-a964-02784c6d74f9 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:54.649777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab0186-1457-4e86-a964-02784c6d74f9 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:54.651122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 236/481] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:54.657453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f8c39-f152-45c3-88f4-3c4b50086fbb None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:54.657869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f8c39-f152-45c3-88f4-3c4b50086fbb None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:54.658032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f8c39-f152-45c3-88f4-3c4b50086fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:54.683252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b62f8c39-f152-45c3-88f4-3c4b50086fbb None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:54.685003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b62f8c39-f152-45c3-88f4-3c4b50086fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:54.770820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 246/482] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:55.076258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab0186-1457-4e86-a964-02784c6d74f9 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:55.204438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab0186-1457-4e86-a964-02784c6d74f9 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:55.237581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:55.246815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64602e6-9957-4522-895b-2174140ec11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:55.247440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64602e6-9957-4522-895b-2174140ec11e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:55.247715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64602e6-9957-4522-895b-2174140ec11e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:55.249899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64602e6-9957-4522-895b-2174140ec11e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:55.258198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64602e6-9957-4522-895b-2174140ec11e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-a64602e6-9957-4522-895b-2174140ec11e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:55.263851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:55.265919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:55.268045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 237/483] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:47:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:55.275531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f8c39-f152-45c3-88f4-3c4b50086fbb None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:55.408648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f8c39-f152-45c3-88f4-3c4b50086fbb None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:55.437778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:55.454955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445d1f1-f92e-4720-96a9-5647ee67d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:55.455637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d1f1-f92e-4720-96a9-5647ee67d7ee None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:55.455917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d1f1-f92e-4720-96a9-5647ee67d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:55.456187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445d1f1-f92e-4720-96a9-5647ee67d7ee None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:55.456855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445d1f1-f92e-4720-96a9-5647ee67d7ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:55.457152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445d1f1-f92e-4720-96a9-5647ee67d7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:55.458599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445d1f1-f92e-4720-96a9-5647ee67d7ee None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:55.470191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 247/484] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:47:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:55.475909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64602e6-9957-4522-895b-2174140ec11e None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:55.612800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64602e6-9957-4522-895b-2174140ec11e None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:55.664718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2a389-3353-4cb1-96b1-a4db28d1c58d None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:55.665324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2a389-3353-4cb1-96b1-a4db28d1c58d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:55.665324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2a389-3353-4cb1-96b1-a4db28d1c58d None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:55.666810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 248/485] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:47:55.669808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609076d-f256-40fe-a039-db01bde6b294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:55.670547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609076d-f256-40fe-a039-db01bde6b294 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:55.670826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609076d-f256-40fe-a039-db01bde6b294 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:55.671099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609076d-f256-40fe-a039-db01bde6b294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:55.682342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609076d-f256-40fe-a039-db01bde6b294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:55.684581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609076d-f256-40fe-a039-db01bde6b294 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-6609076d-f256-40fe-a039-db01bde6b294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:55.705450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:55.708128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:55.710172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:55.710172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:55.710172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:55.710584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a715-8ee5-4e19-9447-39a3150e7bc0 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:55.710584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a715-8ee5-4e19-9447-39a3150e7bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:55.710584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a715-8ee5-4e19-9447-39a3150e7bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:55.712591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 238/486] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:55.715469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609076d-f256-40fe-a039-db01bde6b294 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:55.748432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-bb74a715-8ee5-4e19-9447-39a3150e7bc0 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:55.748432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-bb74a715-8ee5-4e19-9447-39a3150e7bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:55.786583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:55.834327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 249/487] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:55.835880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d0a34-0cd2-42c1-b128-df9aac2836db None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:55.836329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d0a34-0cd2-42c1-b128-df9aac2836db None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:55.836754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d0a34-0cd2-42c1-b128-df9aac2836db None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:55.838150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 250/488] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:55.843646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609076d-f256-40fe-a039-db01bde6b294 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:55.849570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cea8e4-312a-4690-96dd-f232503ede78 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:55.850035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cea8e4-312a-4690-96dd-f232503ede78 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:55.850467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cea8e4-312a-4690-96dd-f232503ede78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:55.883211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-92cea8e4-312a-4690-96dd-f232503ede78 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:55.884405 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-92cea8e4-312a-4690-96dd-f232503ede78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:55.891016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db30a76-7691-4c2d-ac65-67013382dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:55.891560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db30a76-7691-4c2d-ac65-67013382dd87 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:55.891841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db30a76-7691-4c2d-ac65-67013382dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:55.892110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db30a76-7691-4c2d-ac65-67013382dd87 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:55.892809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db30a76-7691-4c2d-ac65-67013382dd87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:55.893113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db30a76-7691-4c2d-ac65-67013382dd87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:55.896221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db30a76-7691-4c2d-ac65-67013382dd87 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:55.919215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 239/489] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:55.923335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db30a76-7691-4c2d-ac65-67013382dd87 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:56.031154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 251/490] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:47:56.090709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:56.095147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db30a76-7691-4c2d-ac65-67013382dd87 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:56.132801 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d575b-6351-41c2-82bf-4b2f4485aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:56.133439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d575b-6351-41c2-82bf-4b2f4485aa06 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.133716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d575b-6351-41c2-82bf-4b2f4485aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.133989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d575b-6351-41c2-82bf-4b2f4485aa06 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.142586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d575b-6351-41c2-82bf-4b2f4485aa06 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:56.144076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d575b-6351-41c2-82bf-4b2f4485aa06 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:56.159332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cea8e4-312a-4690-96dd-f232503ede78 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-a83d575b-6351-41c2-82bf-4b2f4485aa06 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:47:56.160440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:56.161283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:56.162852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 240/491] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Sep 14 11:47:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:56.167363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d575b-6351-41c2-82bf-4b2f4485aa06 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:56.215596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:56.278108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cea8e4-312a-4690-96dd-f232503ede78 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:56.289193 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d575b-6351-41c2-82bf-4b2f4485aa06 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:56.318531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fea64d-9406-4000-8cc2-93a6bbfc2fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:56.319627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fea64d-9406-4000-8cc2-93a6bbfc2fbe None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.320097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fea64d-9406-4000-8cc2-93a6bbfc2fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.320565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fea64d-9406-4000-8cc2-93a6bbfc2fbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.324757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac061db-c930-4755-95ba-1b177ddb59c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:56.325364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac061db-c930-4755-95ba-1b177ddb59c2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.325644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac061db-c930-4755-95ba-1b177ddb59c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.325919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac061db-c930-4755-95ba-1b177ddb59c2 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.326687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac061db-c930-4755-95ba-1b177ddb59c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:56.326994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac061db-c930-4755-95ba-1b177ddb59c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:56.328431 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac061db-c930-4755-95ba-1b177ddb59c2 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:56.334235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fea64d-9406-4000-8cc2-93a6bbfc2fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-17fea64d-9406-4000-8cc2-93a6bbfc2fbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:56.340043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:56.340932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:47:56.341710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:56.348782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 252/492] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:47:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:47:56.350918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51b236-92f5-4e7c-9a29-bcc3725871d0 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.351400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51b236-92f5-4e7c-9a29-bcc3725871d0 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.351862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51b236-92f5-4e7c-9a29-bcc3725871d0 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.353769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 253/493] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:56.355030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51b236-92f5-4e7c-9a29-bcc3725871d0 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:56.367009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 241/494] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Sep 14 11:47:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:56.368329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d2ee-bd89-4377-9d1b-d0c490fce4da None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.368617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d2ee-bd89-4377-9d1b-d0c490fce4da None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.368889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d2ee-bd89-4377-9d1b-d0c490fce4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.388613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-07c5d2ee-bd89-4377-9d1b-d0c490fce4da None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:56.389820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-07c5d2ee-bd89-4377-9d1b-d0c490fce4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:56.401390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:56.462963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 242/495] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:56.464076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5d2ee-bd89-4377-9d1b-d0c490fce4da None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:56.471986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51b236-92f5-4e7c-9a29-bcc3725871d0 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:56.475826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:56.513463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff0f56-e1a7-4057-80ff-061445aa5c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:56.514601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff0f56-e1a7-4057-80ff-061445aa5c6c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.515032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff0f56-e1a7-4057-80ff-061445aa5c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.515477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff0f56-e1a7-4057-80ff-061445aa5c6c None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.516161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff0f56-e1a7-4057-80ff-061445aa5c6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:56.516767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff0f56-e1a7-4057-80ff-061445aa5c6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:56.518558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff0f56-e1a7-4057-80ff-061445aa5c6c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:56.534368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 254/496] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:47:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:56.535224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff0f56-e1a7-4057-80ff-061445aa5c6c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:56.578354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5d2ee-bd89-4377-9d1b-d0c490fce4da None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:56.627271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f17b64-2243-40cc-aef4-f6c28405854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:56.628775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f17b64-2243-40cc-aef4-f6c28405854f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.629059 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f17b64-2243-40cc-aef4-f6c28405854f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.629330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f17b64-2243-40cc-aef4-f6c28405854f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.649256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:56.666874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff0f56-e1a7-4057-80ff-061445aa5c6c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:56.710830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d107c-a45a-4b4c-bef7-2ad086a5b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:56.711465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d107c-a45a-4b4c-bef7-2ad086a5b587 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.711738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d107c-a45a-4b4c-bef7-2ad086a5b587 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.712078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d107c-a45a-4b4c-bef7-2ad086a5b587 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.716313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f17b64-2243-40cc-aef4-f6c28405854f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:56.717792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f17b64-2243-40cc-aef4-f6c28405854f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:56.723955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d107c-a45a-4b4c-bef7-2ad086a5b587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-987d107c-a45a-4b4c-bef7-2ad086a5b587 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:56.729090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:56.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:56.731770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 255/497] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:47:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:56.736248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d107c-a45a-4b4c-bef7-2ad086a5b587 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:56.763488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:56.819509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 243/498] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:56.820805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301e3f3-2b2d-4b4e-9e2a-5dad39fdd0ae None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.821049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301e3f3-2b2d-4b4e-9e2a-5dad39fdd0ae None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.821322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301e3f3-2b2d-4b4e-9e2a-5dad39fdd0ae None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.826245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 244/499] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:47:56.826245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301e3f3-2b2d-4b4e-9e2a-5dad39fdd0ae None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:56.838110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d107c-a45a-4b4c-bef7-2ad086a5b587 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:56.872589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:56.872782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db646-eeff-47cd-8db6-2605c5874b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:56.873218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db646-eeff-47cd-8db6-2605c5874b16 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.873498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db646-eeff-47cd-8db6-2605c5874b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.873770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db646-eeff-47cd-8db6-2605c5874b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.883692 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5db646-eeff-47cd-8db6-2605c5874b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:56.888234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5db646-eeff-47cd-8db6-2605c5874b16 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-7e5db646-eeff-47cd-8db6-2605c5874b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:56.900768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:56.901789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:56.903530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:56.903530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:56.903530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:56.903530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 256/500] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:56.903749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db646-eeff-47cd-8db6-2605c5874b16 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:56.927210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301e3f3-2b2d-4b4e-9e2a-5dad39fdd0ae None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:56.960356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7966e-baca-4fb2-9319-bf121df16bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:56.960948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7966e-baca-4fb2-9319-bf121df16bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:56.961222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7966e-baca-4fb2-9319-bf121df16bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:56.961492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7966e-baca-4fb2-9319-bf121df16bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:56.962139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7966e-baca-4fb2-9319-bf121df16bd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:56.962467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7966e-baca-4fb2-9319-bf121df16bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:56.963817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7966e-baca-4fb2-9319-bf121df16bd4 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:56.972827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 245/501] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:47:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:56.973629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7966e-baca-4fb2-9319-bf121df16bd4 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:56.990091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:57.010536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db646-eeff-47cd-8db6-2605c5874b16 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.045651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d7300-cf7a-480d-afc0-3b8e972c361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.046349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d7300-cf7a-480d-afc0-3b8e972c361f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.046629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d7300-cf7a-480d-afc0-3b8e972c361f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.046901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d7300-cf7a-480d-afc0-3b8e972c361f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.056693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d7300-cf7a-480d-afc0-3b8e972c361f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-b13d7300-cf7a-480d-afc0-3b8e972c361f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:47:57.061953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:57.062882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:57.063661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 257/502] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:47:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:57.064304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810743-2e0e-4fba-bacb-1fc2d6adbd84 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.064979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810743-2e0e-4fba-bacb-1fc2d6adbd84 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.064979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a810743-2e0e-4fba-bacb-1fc2d6adbd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.071744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7966e-baca-4fb2-9319-bf121df16bd4 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.081433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:57.083113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-8a810743-2e0e-4fba-bacb-1fc2d6adbd84 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:47:57.084305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8a810743-2e0e-4fba-bacb-1fc2d6adbd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:47:57.106915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6b472-9fd8-498f-b48e-13f3acca48b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.108055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6b472-9fd8-498f-b48e-13f3acca48b4 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.108568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6b472-9fd8-498f-b48e-13f3acca48b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.109125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6b472-9fd8-498f-b48e-13f3acca48b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.119575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6b472-9fd8-498f-b48e-13f3acca48b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.121445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6b472-9fd8-498f-b48e-13f3acca48b4 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-fdc6b472-9fd8-498f-b48e-13f3acca48b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:57.137138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:57.138203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:57.139238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:57.139238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:57.139238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:57.139238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 246/503] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:57.139238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6b472-9fd8-498f-b48e-13f3acca48b4 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.166242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 258/504] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:47:57.166242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a810743-2e0e-4fba-bacb-1fc2d6adbd84 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.225443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:57.248430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6b472-9fd8-498f-b48e-13f3acca48b4 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.262956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a810743-2e0e-4fba-bacb-1fc2d6adbd84 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.285868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abe7f0-d2e2-4805-b73f-8251f471a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.286575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abe7f0-d2e2-4805-b73f-8251f471a58d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.287068 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abe7f0-d2e2-4805-b73f-8251f471a58d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.287340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abe7f0-d2e2-4805-b73f-8251f471a58d None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.288512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abe7f0-d2e2-4805-b73f-8251f471a58d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:57.288934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abe7f0-d2e2-4805-b73f-8251f471a58d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.291022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abe7f0-d2e2-4805-b73f-8251f471a58d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.298853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1d561-acf7-4ef2-9486-1867ee1f65dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.299492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1d561-acf7-4ef2-9486-1867ee1f65dc None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.299771 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1d561-acf7-4ef2-9486-1867ee1f65dc None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.300519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1d561-acf7-4ef2-9486-1867ee1f65dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.303579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 247/505] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:57.308959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abe7f0-d2e2-4805-b73f-8251f471a58d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.311950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1d561-acf7-4ef2-9486-1867ee1f65dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.314201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1d561-acf7-4ef2-9486-1867ee1f65dc None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-13a1d561-acf7-4ef2-9486-1867ee1f65dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:57.331545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:57.332488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:57.333334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:57.333334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:57.333334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:57.333507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:57.333585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 259/506] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:57.333585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1d561-acf7-4ef2-9486-1867ee1f65dc None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.420409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abe7f0-d2e2-4805-b73f-8251f471a58d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.438822 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1d561-acf7-4ef2-9486-1867ee1f65dc None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.453994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebbd81-d923-4232-8f5a-d3289b6e6e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.454627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbd81-d923-4232-8f5a-d3289b6e6e29 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.454909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbd81-d923-4232-8f5a-d3289b6e6e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.455181 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbd81-d923-4232-8f5a-d3289b6e6e29 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.455841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebbd81-d923-4232-8f5a-d3289b6e6e29 None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:57.456142 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebbd81-d923-4232-8f5a-d3289b6e6e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.457505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebbd81-d923-4232-8f5a-d3289b6e6e29 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.458189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:57.465742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 248/507] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:57.466681 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebbd81-d923-4232-8f5a-d3289b6e6e29 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.472619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561730d-ed9e-475b-b191-e9cfe166ac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.473788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561730d-ed9e-475b-b191-e9cfe166ac80 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.473788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561730d-ed9e-475b-b191-e9cfe166ac80 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.473788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561730d-ed9e-475b-b191-e9cfe166ac80 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.474399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561730d-ed9e-475b-b191-e9cfe166ac80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:57.474700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561730d-ed9e-475b-b191-e9cfe166ac80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.476060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561730d-ed9e-475b-b191-e9cfe166ac80 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.488585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 260/508] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:57.489402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561730d-ed9e-475b-b191-e9cfe166ac80 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.551948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:57.569731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebbd81-d923-4232-8f5a-d3289b6e6e29 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.586013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561730d-ed9e-475b-b191-e9cfe166ac80 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.607079 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9bd1e-a77a-418f-b9d1-26e7a66f206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.607699 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9bd1e-a77a-418f-b9d1-26e7a66f206c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.607974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9bd1e-a77a-418f-b9d1-26e7a66f206c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.608242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9bd1e-a77a-418f-b9d1-26e7a66f206c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.615159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9bd1e-a77a-418f-b9d1-26e7a66f206c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.616593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9bd1e-a77a-418f-b9d1-26e7a66f206c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.620576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24f287-3018-4281-b2fd-6bff8d88ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.621190 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f287-3018-4281-b2fd-6bff8d88ac12 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.621464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f287-3018-4281-b2fd-6bff8d88ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.621737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24f287-3018-4281-b2fd-6bff8d88ac12 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.622421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24f287-3018-4281-b2fd-6bff8d88ac12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:57.622729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24f287-3018-4281-b2fd-6bff8d88ac12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.624096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24f287-3018-4281-b2fd-6bff8d88ac12 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-64b9bd1e-a77a-418f-b9d1-26e7a66f206c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:47:57.629075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:57.629926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:57.630840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 249/509] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:57.631757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9bd1e-a77a-418f-b9d1-26e7a66f206c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.635928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 261/510] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:57.636664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24f287-3018-4281-b2fd-6bff8d88ac12 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.680262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:57.733645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9bd1e-a77a-418f-b9d1-26e7a66f206c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.740534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24f287-3018-4281-b2fd-6bff8d88ac12 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.769375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa7cef-b2af-4a20-9b6d-452d16fd7484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.770003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa7cef-b2af-4a20-9b6d-452d16fd7484 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.770330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa7cef-b2af-4a20-9b6d-452d16fd7484 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.770589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa7cef-b2af-4a20-9b6d-452d16fd7484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.773958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75b30d-4a1d-4dd8-a909-b14bb96333b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.774638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75b30d-4a1d-4dd8-a909-b14bb96333b1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.774915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75b30d-4a1d-4dd8-a909-b14bb96333b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.775186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75b30d-4a1d-4dd8-a909-b14bb96333b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.781252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa7cef-b2af-4a20-9b6d-452d16fd7484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.782752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa7cef-b2af-4a20-9b6d-452d16fd7484 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.784510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:57.786745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75b30d-4a1d-4dd8-a909-b14bb96333b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.788182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75b30d-4a1d-4dd8-a909-b14bb96333b1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-6eaa7cef-b2af-4a20-9b6d-452d16fd7484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:57.797918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:57.798869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:57.799713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:57.799713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:57.799713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:57.799713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 250/511] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:57.799936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa7cef-b2af-4a20-9b6d-452d16fd7484 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-7b75b30d-4a1d-4dd8-a909-b14bb96333b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:57.802548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:57.803418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:57.804230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:57.804230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:57.804230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:57.804230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 262/512] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:57.804462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75b30d-4a1d-4dd8-a909-b14bb96333b1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.897732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:57.903557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa7cef-b2af-4a20-9b6d-452d16fd7484 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.906413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75b30d-4a1d-4dd8-a909-b14bb96333b1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:57.936914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19ddff-8ec9-410f-8be8-57add9ac733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.937534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19ddff-8ec9-410f-8be8-57add9ac733a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.937816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19ddff-8ec9-410f-8be8-57add9ac733a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.938092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19ddff-8ec9-410f-8be8-57add9ac733a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.941244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96145e03-108a-4bac-9ee4-26749ff70986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:57.941840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145e03-108a-4bac-9ee4-26749ff70986 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:57.942115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145e03-108a-4bac-9ee4-26749ff70986 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:57.942412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145e03-108a-4bac-9ee4-26749ff70986 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:57.943129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96145e03-108a-4bac-9ee4-26749ff70986 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:57.943430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96145e03-108a-4bac-9ee4-26749ff70986 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.944828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19ddff-8ec9-410f-8be8-57add9ac733a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:57.944932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96145e03-108a-4bac-9ee4-26749ff70986 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.946278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19ddff-8ec9-410f-8be8-57add9ac733a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-9a19ddff-8ec9-410f-8be8-57add9ac733a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:47:57.958127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:57.959166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:57.960025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:47:57.960025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:47:57.960025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:47:57.960025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:47:57.960025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:47:57.960025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:47:57.960025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:47:57.960025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:57.962360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 251/513] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:57.963355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19ddff-8ec9-410f-8be8-57add9ac733a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:57.981738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 263/514] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:57.982442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96145e03-108a-4bac-9ee4-26749ff70986 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:58.024550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:58.071337 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19ddff-8ec9-410f-8be8-57add9ac733a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:58.084508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96145e03-108a-4bac-9ee4-26749ff70986 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:58.104150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b091a-c893-4303-a390-432229bc55b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:58.104781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b091a-c893-4303-a390-432229bc55b2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:58.105088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b091a-c893-4303-a390-432229bc55b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:58.105426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b091a-c893-4303-a390-432229bc55b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:58.112618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b091a-c893-4303-a390-432229bc55b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:58.114060 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b091a-c893-4303-a390-432229bc55b2 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:58.117362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23d286-1458-49ec-b325-42335962f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:58.117969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d286-1458-49ec-b325-42335962f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:58.118273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d286-1458-49ec-b325-42335962f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:58.118551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d286-1458-49ec-b325-42335962f2e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:58.119190 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d286-1458-49ec-b325-42335962f2e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:58.119494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d286-1458-49ec-b325-42335962f2e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:58.121393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d286-1458-49ec-b325-42335962f2e1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-7a3b091a-c893-4303-a390-432229bc55b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:47:58.125778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:58.126814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 252/515] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:58.132675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b091a-c893-4303-a390-432229bc55b2 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:58.143492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 264/516] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:58.143492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23d286-1458-49ec-b325-42335962f2e1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:58.152139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:58.228999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b091a-c893-4303-a390-432229bc55b2 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:58.238447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23d286-1458-49ec-b325-42335962f2e1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:58.242313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:58.262985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a62363-7f4f-4f26-ac38-ccda68cf4c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:58.263617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a62363-7f4f-4f26-ac38-ccda68cf4c51 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:58.263902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a62363-7f4f-4f26-ac38-ccda68cf4c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:58.264178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a62363-7f4f-4f26-ac38-ccda68cf4c51 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:58.264825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a62363-7f4f-4f26-ac38-ccda68cf4c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:58.265133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a62363-7f4f-4f26-ac38-ccda68cf4c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:58.266529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a62363-7f4f-4f26-ac38-ccda68cf4c51 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:58.272422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e7d4-eb43-482a-aaea-3566c2880fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:58.273021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e7d4-eb43-482a-aaea-3566c2880fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:58.273296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e7d4-eb43-482a-aaea-3566c2880fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:58.273564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e7d4-eb43-482a-aaea-3566c2880fc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:58.274268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e7d4-eb43-482a-aaea-3566c2880fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:58.274579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e7d4-eb43-482a-aaea-3566c2880fc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:58.275983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e7d4-eb43-482a-aaea-3566c2880fc8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:58.278530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 253/517] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:58.279410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a62363-7f4f-4f26-ac38-ccda68cf4c51 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:58.297544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 265/518] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:58.298515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e7d4-eb43-482a-aaea-3566c2880fc8 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:58.374239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:58.377347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a62363-7f4f-4f26-ac38-ccda68cf4c51 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:58.403598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e7d4-eb43-482a-aaea-3566c2880fc8 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:58.410280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a1d1a-a408-47fc-87fc-038ae9223dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:58.410883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a1d1a-a408-47fc-87fc-038ae9223dbf None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:58.411170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a1d1a-a408-47fc-87fc-038ae9223dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:58.411443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a1d1a-a408-47fc-87fc-038ae9223dbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:58.438848 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eae17d-365d-4725-83b0-ffecd6f38091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:58.439444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eae17d-365d-4725-83b0-ffecd6f38091 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:58.439725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eae17d-365d-4725-83b0-ffecd6f38091 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:58.439995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eae17d-365d-4725-83b0-ffecd6f38091 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:58.440973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eae17d-365d-4725-83b0-ffecd6f38091 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:58.441279 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eae17d-365d-4725-83b0-ffecd6f38091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:58.442750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eae17d-365d-4725-83b0-ffecd6f38091 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:58.454144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:58.459587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 266/519] 10.222.0.77 () {56 vars in 1139 bytes} [Wed Sep 14 11:47:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:58.465066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eae17d-365d-4725-83b0-ffecd6f38091 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:58.478593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a1d1a-a408-47fc-87fc-038ae9223dbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:58.480206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a1d1a-a408-47fc-87fc-038ae9223dbf None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:58.560319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eae17d-365d-4725-83b0-ffecd6f38091 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:58.577205 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 254/520] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:58.578025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a1d1a-a408-47fc-87fc-038ae9223dbf None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:58.586907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:58.597735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9f22e-a7b5-49d7-8d4c-4e0fe7c0280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:58.605806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9f22e-a7b5-49d7-8d4c-4e0fe7c0280e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:58.605806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9f22e-a7b5-49d7-8d4c-4e0fe7c0280e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:58.605806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9f22e-a7b5-49d7-8d4c-4e0fe7c0280e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:58.606362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9f22e-a7b5-49d7-8d4c-4e0fe7c0280e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:58.607874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9f22e-a7b5-49d7-8d4c-4e0fe7c0280e None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-feb9f22e-a7b5-49d7-8d4c-4e0fe7c0280e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:47:58.621111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:58.622145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 267/521] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:47:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:58.623381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9f22e-a7b5-49d7-8d4c-4e0fe7c0280e None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:58.655447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:58.680168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a1d1a-a408-47fc-87fc-038ae9223dbf None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:58.714315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314510-44d3-4f4a-9d61-5c4a6c879777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:58.715507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314510-44d3-4f4a-9d61-5c4a6c879777 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:58.715782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314510-44d3-4f4a-9d61-5c4a6c879777 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:58.716056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314510-44d3-4f4a-9d61-5c4a6c879777 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:58.716698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1314510-44d3-4f4a-9d61-5c4a6c879777 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:58.718127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1314510-44d3-4f4a-9d61-5c4a6c879777 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:58.725159 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9f22e-a7b5-49d7-8d4c-4e0fe7c0280e None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:58.759031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a092e-69b8-447e-adef-fbd6162c8813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:58.759641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a092e-69b8-447e-adef-fbd6162c8813 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:58.759919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a092e-69b8-447e-adef-fbd6162c8813 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:58.760188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a092e-69b8-447e-adef-fbd6162c8813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:58.761041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a092e-69b8-447e-adef-fbd6162c8813 None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=8882a9f2764648be9bfe4606144660d1) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:58.762152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a092e-69b8-447e-adef-fbd6162c8813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:58.763683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a092e-69b8-447e-adef-fbd6162c8813 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:58.768873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 268/522] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:47:58 2022] GET /identity/v3/role_assignments?user.id=8882a9f2764648be9bfe4606144660d1&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:58.769820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a092e-69b8-447e-adef-fbd6162c8813 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:58.799371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 255/523] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:47:58 2022] POST /identity/v3/users => generated 247 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:47:58.800151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314510-44d3-4f4a-9d61-5c4a6c879777 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:58.848087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:58.911010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a092e-69b8-447e-adef-fbd6162c8813 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:58.964264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adfe75-899f-4ed0-8a40-197ad8daa2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:58.965309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adfe75-899f-4ed0-8a40-197ad8daa2cd None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:58.965609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adfe75-899f-4ed0-8a40-197ad8daa2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:58.965888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adfe75-899f-4ed0-8a40-197ad8daa2cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:58.970506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314510-44d3-4f4a-9d61-5c4a6c879777 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:59.005104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:59.013875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0da01-2522-4e7d-87bc-02980b237520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:59.014551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0da01-2522-4e7d-87bc-02980b237520 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:59.018236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0da01-2522-4e7d-87bc-02980b237520 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:59.018236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0da01-2522-4e7d-87bc-02980b237520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:59.029306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0da01-2522-4e7d-87bc-02980b237520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:59.031355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0da01-2522-4e7d-87bc-02980b237520 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-45d0da01-2522-4e7d-87bc-02980b237520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:59.047394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:59.050855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:59.051715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:59.051715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:59.051715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:59.051715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 256/524] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:59.051715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0da01-2522-4e7d-87bc-02980b237520 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:59.068175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adfe75-899f-4ed0-8a40-197ad8daa2cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:59.069647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adfe75-899f-4ed0-8a40-197ad8daa2cd None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:59.132327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:59.169769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0da01-2522-4e7d-87bc-02980b237520 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:59.185463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 269/525] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:59.186353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adfe75-899f-4ed0-8a40-197ad8daa2cd None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:59.211749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acafab-19e0-4034-8a8d-ce045e49d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:59.212356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acafab-19e0-4034-8a8d-ce045e49d185 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:59.212632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acafab-19e0-4034-8a8d-ce045e49d185 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:59.212901 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acafab-19e0-4034-8a8d-ce045e49d185 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:59.213742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acafab-19e0-4034-8a8d-ce045e49d185 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:59.214046 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acafab-19e0-4034-8a8d-ce045e49d185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:59.216198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acafab-19e0-4034-8a8d-ce045e49d185 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:59.238867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 257/526] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Sep 14 11:47:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:59.239855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acafab-19e0-4034-8a8d-ce045e49d185 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:59.284586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:59.306931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adfe75-899f-4ed0-8a40-197ad8daa2cd None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:59.348458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec464d-e5d8-4077-9ca3-206327f3a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:59.348458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec464d-e5d8-4077-9ca3-206327f3a86a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:59.348458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec464d-e5d8-4077-9ca3-206327f3a86a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:59.348458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec464d-e5d8-4077-9ca3-206327f3a86a None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:59.348911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec464d-e5d8-4077-9ca3-206327f3a86a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:59.349210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec464d-e5d8-4077-9ca3-206327f3a86a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:59.351287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec464d-e5d8-4077-9ca3-206327f3a86a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:59.353849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acafab-19e0-4034-8a8d-ce045e49d185 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:59.364253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 270/527] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:59.365073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec464d-e5d8-4077-9ca3-206327f3a86a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:59.382755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:59.391141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732fc14-52ca-431b-8a4c-2def69302885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:59.392007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732fc14-52ca-431b-8a4c-2def69302885 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:59.392443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732fc14-52ca-431b-8a4c-2def69302885 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:59.392850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732fc14-52ca-431b-8a4c-2def69302885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:59.404529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732fc14-52ca-431b-8a4c-2def69302885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:59.406304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732fc14-52ca-431b-8a4c-2def69302885 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-e732fc14-52ca-431b-8a4c-2def69302885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:59.422671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:59.423790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:59.424723 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:59.424723 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:59.424723 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:59.426705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 258/528] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:59.427610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732fc14-52ca-431b-8a4c-2def69302885 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:59.488171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec464d-e5d8-4077-9ca3-206327f3a86a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:59.528635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:59.532325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a139-7b56-42a7-9d8a-3784705abfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:59.533384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a139-7b56-42a7-9d8a-3784705abfde None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:59.533808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a139-7b56-42a7-9d8a-3784705abfde None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:59.534241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a139-7b56-42a7-9d8a-3784705abfde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:59.537677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732fc14-52ca-431b-8a4c-2def69302885 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:59.575289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78a427-7008-43f8-b3f6-3cbb65babca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:59.575915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a427-7008-43f8-b3f6-3cbb65babca7 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:59.576193 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a427-7008-43f8-b3f6-3cbb65babca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:59.576463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a427-7008-43f8-b3f6-3cbb65babca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:59.583327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78a427-7008-43f8-b3f6-3cbb65babca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:59.584765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78a427-7008-43f8-b3f6-3cbb65babca7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-0e78a427-7008-43f8-b3f6-3cbb65babca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:47:59.599176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:59.600247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:59.601357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:47:59.601357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:47:59.601357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:47:59.601357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:47:59.601357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:47:59.601357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:47:59.601357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:47:59.601357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:59.601357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 259/529] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:59.601357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78a427-7008-43f8-b3f6-3cbb65babca7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:59.626031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309a139-7b56-42a7-9d8a-3784705abfde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:59.628468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309a139-7b56-42a7-9d8a-3784705abfde None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:59.647016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:59.724522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78a427-7008-43f8-b3f6-3cbb65babca7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:59.760918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 271/530] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:47:59.763093 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a139-7b56-42a7-9d8a-3784705abfde None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:59.770442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32686438-6d00-4b4d-9536-5659424dd983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:59.771189 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32686438-6d00-4b4d-9536-5659424dd983 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:59.771568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32686438-6d00-4b4d-9536-5659424dd983 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:59.771968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32686438-6d00-4b4d-9536-5659424dd983 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:59.772712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32686438-6d00-4b4d-9536-5659424dd983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:59.773109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32686438-6d00-4b4d-9536-5659424dd983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:59.774598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32686438-6d00-4b4d-9536-5659424dd983 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:59.791986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 260/531] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:59.791986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32686438-6d00-4b4d-9536-5659424dd983 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:59.805380 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:59.895955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32686438-6d00-4b4d-9536-5659424dd983 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:59.909129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a139-7b56-42a7-9d8a-3784705abfde None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:47:59.927772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:47:59.933240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d708d-6de2-4109-a24c-dc043881f1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:59.934006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d708d-6de2-4109-a24c-dc043881f1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:59.934438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d708d-6de2-4109-a24c-dc043881f1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:59.934805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d708d-6de2-4109-a24c-dc043881f1e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:59.947385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d708d-6de2-4109-a24c-dc043881f1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:59.949378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d708d-6de2-4109-a24c-dc043881f1e5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:59.959224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd3419-9d30-4589-8f71-96bd2fcadbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:47:59.960217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd3419-9d30-4589-8f71-96bd2fcadbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:47:59.961117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd3419-9d30-4589-8f71-96bd2fcadbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:47:59.961799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd3419-9d30-4589-8f71-96bd2fcadbe9 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:47:59.962735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd3419-9d30-4589-8f71-96bd2fcadbe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:47:59.963247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd3419-9d30-4589-8f71-96bd2fcadbe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-f27d708d-6de2-4109-a24c-dc043881f1e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:47:59.965716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:47:59.966632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:47:59.967876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:47:59.967876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:47:59.967876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:47:59.967876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 261/532] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:47:59.968318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d708d-6de2-4109-a24c-dc043881f1e5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:47:59.968461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd3419-9d30-4589-8f71-96bd2fcadbe9 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:47:59.985294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 272/533] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:47:59.986850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd3419-9d30-4589-8f71-96bd2fcadbe9 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:00.043117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:00.101548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d708d-6de2-4109-a24c-dc043881f1e5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:00.113020 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd3419-9d30-4589-8f71-96bd2fcadbe9 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:00.148843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9933cf-2678-4f53-809b-a625b4d30987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:00.149486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9933cf-2678-4f53-809b-a625b4d30987 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:00.149769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9933cf-2678-4f53-809b-a625b4d30987 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:00.150043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9933cf-2678-4f53-809b-a625b4d30987 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:00.150337 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716ed46-9691-4e94-ba9e-17020eecd953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:00.150740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9933cf-2678-4f53-809b-a625b4d30987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:00.151046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9933cf-2678-4f53-809b-a625b4d30987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:00.151611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716ed46-9691-4e94-ba9e-17020eecd953 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:00.152137 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716ed46-9691-4e94-ba9e-17020eecd953 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:00.152506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9933cf-2678-4f53-809b-a625b4d30987 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:00.152830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716ed46-9691-4e94-ba9e-17020eecd953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:00.161470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716ed46-9691-4e94-ba9e-17020eecd953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:00.163997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716ed46-9691-4e94-ba9e-17020eecd953 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:00.165731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 273/534] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:00.170512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9933cf-2678-4f53-809b-a625b4d30987 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-2716ed46-9691-4e94-ba9e-17020eecd953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:00.178342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:00.179151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:00.180049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:00.180049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:00.180049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:00.180049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:00.180049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:00.180049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:00.180049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:00.180049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:00.187405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 262/535] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:00.187405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716ed46-9691-4e94-ba9e-17020eecd953 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:00.215657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:00.290778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716ed46-9691-4e94-ba9e-17020eecd953 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:00.304814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9933cf-2678-4f53-809b-a625b4d30987 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:00.314602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:00.326663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c954445-6dda-4392-afe3-2cdd87065fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:00.327296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c954445-6dda-4392-afe3-2cdd87065fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:00.328849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c954445-6dda-4392-afe3-2cdd87065fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:00.328849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c954445-6dda-4392-afe3-2cdd87065fb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:00.334676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c954445-6dda-4392-afe3-2cdd87065fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:00.336114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c954445-6dda-4392-afe3-2cdd87065fb6 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:00.348766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2743af7-3a8a-437c-976b-507a14086a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:00.349516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2743af7-3a8a-437c-976b-507a14086a6a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:00.349867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2743af7-3a8a-437c-976b-507a14086a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:00.350226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2743af7-3a8a-437c-976b-507a14086a6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-1c954445-6dda-4392-afe3-2cdd87065fb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:00.350781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:00.351581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:00.352427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:00.352427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:00.352427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:00.352427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:00.352427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:00.352427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:00.352427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:00.352427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:00.352835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2743af7-3a8a-437c-976b-507a14086a6a None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=47bdd5f0b3bc4c099c0d34b3b7c3f3b9) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:00.352835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2743af7-3a8a-437c-976b-507a14086a6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:00.352957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 263/536] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:00.353021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2743af7-3a8a-437c-976b-507a14086a6a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:00.353086 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c954445-6dda-4392-afe3-2cdd87065fb6 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:00.361832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 274/537] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:00 2022] GET /identity/v3/role_assignments?user.id=47bdd5f0b3bc4c099c0d34b3b7c3f3b9&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:00.362825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2743af7-3a8a-437c-976b-507a14086a6a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:00.483144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:00.490406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2743af7-3a8a-437c-976b-507a14086a6a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:00.532571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f88bc-0d4f-4008-8848-9d936328b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:00.533226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f88bc-0d4f-4008-8848-9d936328b52d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:00.533508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f88bc-0d4f-4008-8848-9d936328b52d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:00.533780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f88bc-0d4f-4008-8848-9d936328b52d None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:00.534589 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f88bc-0d4f-4008-8848-9d936328b52d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:00.534899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f88bc-0d4f-4008-8848-9d936328b52d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:00.536785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f88bc-0d4f-4008-8848-9d936328b52d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:00.551515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 275/538] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:00.559673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f88bc-0d4f-4008-8848-9d936328b52d None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:00.598798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c954445-6dda-4392-afe3-2cdd87065fb6 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:00.662367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad41942-7ec4-45af-b9ab-a6a2324bb210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:00.663572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41942-7ec4-45af-b9ab-a6a2324bb210 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:00.664840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41942-7ec4-45af-b9ab-a6a2324bb210 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:00.665337 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad41942-7ec4-45af-b9ab-a6a2324bb210 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:00.666299 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad41942-7ec4-45af-b9ab-a6a2324bb210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:00.666830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad41942-7ec4-45af-b9ab-a6a2324bb210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:00.669341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad41942-7ec4-45af-b9ab-a6a2324bb210 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:00.695558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 264/539] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:00.701555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad41942-7ec4-45af-b9ab-a6a2324bb210 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:00.707278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f88bc-0d4f-4008-8848-9d936328b52d None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:00.774146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7dab2-1d5f-4645-ac35-fe7733ed16c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:00.774787 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7dab2-1d5f-4645-ac35-fe7733ed16c3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:00.775051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7dab2-1d5f-4645-ac35-fe7733ed16c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:00.775321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7dab2-1d5f-4645-ac35-fe7733ed16c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:00.776046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7dab2-1d5f-4645-ac35-fe7733ed16c3 None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=c610ab76127b40429d8e9259446df49a) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:00.776358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7dab2-1d5f-4645-ac35-fe7733ed16c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:00.777816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7dab2-1d5f-4645-ac35-fe7733ed16c3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:00.787991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:00.790522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 276/540] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:00 2022] GET /identity/v3/role_assignments?user.id=c610ab76127b40429d8e9259446df49a&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:00.874399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad41942-7ec4-45af-b9ab-a6a2324bb210 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:00.921698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d474494-8823-4f54-971e-06e4a9634770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:00.922808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d474494-8823-4f54-971e-06e4a9634770 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:00.923347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d474494-8823-4f54-971e-06e4a9634770 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:00.923835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d474494-8823-4f54-971e-06e4a9634770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:00.924778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d474494-8823-4f54-971e-06e4a9634770 None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=67880641bc954088bef0b601a8410f9a) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:00.925313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d474494-8823-4f54-971e-06e4a9634770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:00.926997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d474494-8823-4f54-971e-06e4a9634770 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:00.934197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 265/541] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:00 2022] GET /identity/v3/role_assignments?user.id=67880641bc954088bef0b601a8410f9a&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:01.083856 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b554-d4df-44cc-9711-fc7a7a39a061 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:01.084499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b554-d4df-44cc-9711-fc7a7a39a061 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:01.085001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b554-d4df-44cc-9711-fc7a7a39a061 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:01.086922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 277/542] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:01.092889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca61a-ca3a-47e5-adfd-cde015533f44 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:01.093456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca61a-ca3a-47e5-adfd-cde015533f44 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:01.093949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca61a-ca3a-47e5-adfd-cde015533f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:01.114572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c0cca61a-ca3a-47e5-adfd-cde015533f44 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:01.116170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c0cca61a-ca3a-47e5-adfd-cde015533f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:01.199499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 266/543] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:48:01.513749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78b554-d4df-44cc-9711-fc7a7a39a061 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:01.525696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb03f4-f46e-4c90-aaef-ffb4213d0de8 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:01.529916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb03f4-f46e-4c90-aaef-ffb4213d0de8 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:01.530539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb03f4-f46e-4c90-aaef-ffb4213d0de8 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:01.534182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 267/544] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:01.537760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f31843-c691-4aea-a957-d923835fe93f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:01.538380 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f31843-c691-4aea-a957-d923835fe93f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:01.538856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f31843-c691-4aea-a957-d923835fe93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:01.555679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:01.586398 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-12f31843-c691-4aea-a957-d923835fe93f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:01.587694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-12f31843-c691-4aea-a957-d923835fe93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:01.663417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:01.722242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78b554-d4df-44cc-9711-fc7a7a39a061 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:01.752941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 268/545] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:01.756040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd5e47-9b2d-447d-bb94-963e53af6668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:01.757084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd5e47-9b2d-447d-bb94-963e53af6668 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:01.757369 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd5e47-9b2d-447d-bb94-963e53af6668 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:01.757641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd5e47-9b2d-447d-bb94-963e53af6668 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:01.771498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd5e47-9b2d-447d-bb94-963e53af6668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-a8bd5e47-9b2d-447d-bb94-963e53af6668 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:01.776359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:01.777673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:01.779023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 278/546] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:01.783814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f31843-c691-4aea-a957-d923835fe93f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:01.943909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f31843-c691-4aea-a957-d923835fe93f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:01.998761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4295858-de2f-476c-9a34-577c9db94784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:01.999383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4295858-de2f-476c-9a34-577c9db94784 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:01.999661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4295858-de2f-476c-9a34-577c9db94784 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:01.999936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4295858-de2f-476c-9a34-577c9db94784 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:02.000613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4295858-de2f-476c-9a34-577c9db94784 None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:02.000915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4295858-de2f-476c-9a34-577c9db94784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:02.002316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4295858-de2f-476c-9a34-577c9db94784 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:02.011856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 269/547] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:02.017300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd5e47-9b2d-447d-bb94-963e53af6668 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:02.094861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4295858-de2f-476c-9a34-577c9db94784 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:02.160942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:02.184074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:02.211255 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd5e47-9b2d-447d-bb94-963e53af6668 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:02.274658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b556-0784-4b1f-851b-b40201ecf072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:02.275290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b556-0784-4b1f-851b-b40201ecf072 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:02.275567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b556-0784-4b1f-851b-b40201ecf072 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:02.275831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b556-0784-4b1f-851b-b40201ecf072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:02.280172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4295858-de2f-476c-9a34-577c9db94784 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:02.295706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b556-0784-4b1f-851b-b40201ecf072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:02.297173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8b556-0784-4b1f-851b-b40201ecf072 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-94b8b556-0784-4b1f-851b-b40201ecf072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:02.336309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:02.337246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:02.338611 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:02.338611 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:02.338611 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:02.345877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0909cf-73cf-4aec-80a4-ab20b38310cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:02.346466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0909cf-73cf-4aec-80a4-ab20b38310cb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:02.346742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0909cf-73cf-4aec-80a4-ab20b38310cb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:02.347007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0909cf-73cf-4aec-80a4-ab20b38310cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:02.347491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 279/548] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:02.352350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b556-0784-4b1f-851b-b40201ecf072 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:02.369681 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0909cf-73cf-4aec-80a4-ab20b38310cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-ad0909cf-73cf-4aec-80a4-ab20b38310cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:02.378001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:02.379010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:02.379815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:02.381249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 270/549] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:02.391000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0909cf-73cf-4aec-80a4-ab20b38310cb None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:02.564338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b556-0784-4b1f-851b-b40201ecf072 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:02.579508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:02.587767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0909cf-73cf-4aec-80a4-ab20b38310cb None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:02.630202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d68dc7-6c71-4c0a-bfeb-21e4f289bb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:02.631184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68dc7-6c71-4c0a-bfeb-21e4f289bb90 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:02.631712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68dc7-6c71-4c0a-bfeb-21e4f289bb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:02.632179 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68dc7-6c71-4c0a-bfeb-21e4f289bb90 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:02.633041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d68dc7-6c71-4c0a-bfeb-21e4f289bb90 None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:02.633551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d68dc7-6c71-4c0a-bfeb-21e4f289bb90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:02.635271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d68dc7-6c71-4c0a-bfeb-21e4f289bb90 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:02.643252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:02.645831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 271/550] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:02.651073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca908a44-0db8-4b2e-95f0-1755807db24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:02.652246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca908a44-0db8-4b2e-95f0-1755807db24b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:02.656569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca908a44-0db8-4b2e-95f0-1755807db24b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:02.656569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca908a44-0db8-4b2e-95f0-1755807db24b None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:02.656728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d68dc7-6c71-4c0a-bfeb-21e4f289bb90 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:02.656802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca908a44-0db8-4b2e-95f0-1755807db24b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:02.656802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca908a44-0db8-4b2e-95f0-1755807db24b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:02.656802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca908a44-0db8-4b2e-95f0-1755807db24b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:02.687114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 280/551] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:02.695673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca908a44-0db8-4b2e-95f0-1755807db24b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:02.856364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d68dc7-6c71-4c0a-bfeb-21e4f289bb90 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:02.905200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428d4bc-5a67-46fd-8df8-36a38bf3690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:02.905851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428d4bc-5a67-46fd-8df8-36a38bf3690b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:02.906130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428d4bc-5a67-46fd-8df8-36a38bf3690b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:02.906430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428d4bc-5a67-46fd-8df8-36a38bf3690b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:02.911158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca908a44-0db8-4b2e-95f0-1755807db24b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:02.930544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428d4bc-5a67-46fd-8df8-36a38bf3690b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:02.932009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428d4bc-5a67-46fd-8df8-36a38bf3690b None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-b428d4bc-5a67-46fd-8df8-36a38bf3690b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:02.960836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:02.962273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:02.963138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:02.963138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:02.963138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:02.963138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 272/552] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:02.970500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428d4bc-5a67-46fd-8df8-36a38bf3690b None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:02.986617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:03.004926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388ad68-d24c-4c42-b1ca-3fda37955f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:03.005648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ad68-d24c-4c42-b1ca-3fda37955f1d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.005929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ad68-d24c-4c42-b1ca-3fda37955f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.006195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ad68-d24c-4c42-b1ca-3fda37955f1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.020101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388ad68-d24c-4c42-b1ca-3fda37955f1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:03.022970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388ad68-d24c-4c42-b1ca-3fda37955f1d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-9388ad68-d24c-4c42-b1ca-3fda37955f1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:03.045122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:03.046066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:03.047009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:03.047009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:03.047009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:03.047009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:03.047009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:03.047009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:03.047009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:03.047009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:03.047009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:48:03.047009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:03.048432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 281/553] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Sep 14 11:48:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:03.057407 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388ad68-d24c-4c42-b1ca-3fda37955f1d None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:03.129774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428d4bc-5a67-46fd-8df8-36a38bf3690b None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:03.137496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:03.173649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe945bd-bfa3-440f-8588-7579d115a304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:03.174229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe945bd-bfa3-440f-8588-7579d115a304 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.174517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe945bd-bfa3-440f-8588-7579d115a304 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.174793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe945bd-bfa3-440f-8588-7579d115a304 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.175991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe945bd-bfa3-440f-8588-7579d115a304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:03.176300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe945bd-bfa3-440f-8588-7579d115a304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:03.178275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe945bd-bfa3-440f-8588-7579d115a304 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:03.192514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 273/554] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:03.193687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388ad68-d24c-4c42-b1ca-3fda37955f1d None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:03.193872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7e3ee-6666-4b94-b81e-17619a45745f None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.194113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7e3ee-6666-4b94-b81e-17619a45745f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.194418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7e3ee-6666-4b94-b81e-17619a45745f None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.195910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 274/555] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:03.199135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7e3ee-6666-4b94-b81e-17619a45745f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:03.230673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812a9ca-05fe-4078-9f44-6dc1c9932052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:03.231310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a9ca-05fe-4078-9f44-6dc1c9932052 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.231814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a9ca-05fe-4078-9f44-6dc1c9932052 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.232090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812a9ca-05fe-4078-9f44-6dc1c9932052 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.233390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812a9ca-05fe-4078-9f44-6dc1c9932052 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:03.233822 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812a9ca-05fe-4078-9f44-6dc1c9932052 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:03.235352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812a9ca-05fe-4078-9f44-6dc1c9932052 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:03.262346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 282/556] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Sep 14 11:48:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:03.265315 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e899f7-83b2-4c4a-a807-63d535d1c385 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.265619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e899f7-83b2-4c4a-a807-63d535d1c385 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.265878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e899f7-83b2-4c4a-a807-63d535d1c385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.276755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:03.286159 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b0e899f7-83b2-4c4a-a807-63d535d1c385 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:03.287626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b0e899f7-83b2-4c4a-a807-63d535d1c385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:03.329057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7e3ee-6666-4b94-b81e-17619a45745f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:03.372722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 283/557] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:03.373772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e899f7-83b2-4c4a-a807-63d535d1c385 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:03.382764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08f234-58f8-4aea-8c9a-89839d5b4d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:03.383769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08f234-58f8-4aea-8c9a-89839d5b4d2a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.384694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08f234-58f8-4aea-8c9a-89839d5b4d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.385208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08f234-58f8-4aea-8c9a-89839d5b4d2a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.397374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08f234-58f8-4aea-8c9a-89839d5b4d2a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:03.399821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08f234-58f8-4aea-8c9a-89839d5b4d2a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-4b08f234-58f8-4aea-8c9a-89839d5b4d2a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:03.415523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:03.416962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:03.418113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 275/558] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:03.426422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08f234-58f8-4aea-8c9a-89839d5b4d2a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:03.434617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:03.517339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e899f7-83b2-4c4a-a807-63d535d1c385 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:03.554495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4b2d-9822-4744-9c64-ba151141a316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:03.555149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4b2d-9822-4744-9c64-ba151141a316 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.555430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4b2d-9822-4744-9c64-ba151141a316 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.555705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4b2d-9822-4744-9c64-ba151141a316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.569807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e4b2d-9822-4744-9c64-ba151141a316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:03.571590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e4b2d-9822-4744-9c64-ba151141a316 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:03.580312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08f234-58f8-4aea-8c9a-89839d5b4d2a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-db2e4b2d-9822-4744-9c64-ba151141a316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:03.587828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:03.589106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:03.590533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:03.590533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:03.590533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:03.590533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 284/559] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:03.590533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d59e12-003f-4291-b6f7-ce91c7173ceb None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.590805 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d59e12-003f-4291-b6f7-ce91c7173ceb None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.591075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d59e12-003f-4291-b6f7-ce91c7173ceb None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.592873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 285/560] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:03.594555 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d59e12-003f-4291-b6f7-ce91c7173ceb None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:03.615141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:03.632101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7be20-cd19-42ca-8c29-e8e226373c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:03.633287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7be20-cd19-42ca-8c29-e8e226373c9d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.633840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7be20-cd19-42ca-8c29-e8e226373c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.634455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7be20-cd19-42ca-8c29-e8e226373c9d None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.635459 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7be20-cd19-42ca-8c29-e8e226373c9d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:03.636309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7be20-cd19-42ca-8c29-e8e226373c9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:03.639042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7be20-cd19-42ca-8c29-e8e226373c9d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:03.663784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 276/561] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Sep 14 11:48:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:03.666081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec0f37-dfc2-4e96-bf28-9a7872754f07 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.666820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec0f37-dfc2-4e96-bf28-9a7872754f07 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.668379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec0f37-dfc2-4e96-bf28-9a7872754f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.691271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-d3ec0f37-dfc2-4e96-bf28-9a7872754f07 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:03.692402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d3ec0f37-dfc2-4e96-bf28-9a7872754f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:03.700927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:03.711391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d59e12-003f-4291-b6f7-ce91c7173ceb None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:03.752351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d7d1c-86a4-44de-87bd-dddc41481094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:03.752973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7d1c-86a4-44de-87bd-dddc41481094 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.753254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7d1c-86a4-44de-87bd-dddc41481094 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.753607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d7d1c-86a4-44de-87bd-dddc41481094 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.754172 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d7d1c-86a4-44de-87bd-dddc41481094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:03.754509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d7d1c-86a4-44de-87bd-dddc41481094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:03.755932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d7d1c-86a4-44de-87bd-dddc41481094 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:03.778236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 286/562] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:03.778432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 277/563] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:03.778527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d7d1c-86a4-44de-87bd-dddc41481094 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:03.778612 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec0f37-dfc2-4e96-bf28-9a7872754f07 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:03.891492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d7d1c-86a4-44de-87bd-dddc41481094 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:03.898095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec0f37-dfc2-4e96-bf28-9a7872754f07 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:03.913554 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:03.927051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e3ec4-2d14-49dd-8067-aaf0dbe56f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:03.927674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3ec4-2d14-49dd-8067-aaf0dbe56f1f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.927960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3ec4-2d14-49dd-8067-aaf0dbe56f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.928238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3ec4-2d14-49dd-8067-aaf0dbe56f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.935949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b8216-686f-4c79-906f-9ca6c40fe89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:03.936818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b8216-686f-4c79-906f-9ca6c40fe89c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:03.937320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b8216-686f-4c79-906f-9ca6c40fe89c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:03.937792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b8216-686f-4c79-906f-9ca6c40fe89c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:03.949307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b8216-686f-4c79-906f-9ca6c40fe89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:03.950508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-2d6b8216-686f-4c79-906f-9ca6c40fe89c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:03.956129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:03.957251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:03.958284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:03.959418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 278/564] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:03.960199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b8216-686f-4c79-906f-9ca6c40fe89c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.007563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e3ec4-2d14-49dd-8067-aaf0dbe56f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:04.009022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e3ec4-2d14-49dd-8067-aaf0dbe56f1f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:04.069477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b8216-686f-4c79-906f-9ca6c40fe89c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:04.103496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38555bf1-33a3-422c-a7b6-2b723559d711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:04.104164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38555bf1-33a3-422c-a7b6-2b723559d711 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.104446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38555bf1-33a3-422c-a7b6-2b723559d711 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.104749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38555bf1-33a3-422c-a7b6-2b723559d711 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.108611 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 287/565] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:48:04.109863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ac3c8-4e6e-4b2c-a722-058464fa03c7 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.110148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ac3c8-4e6e-4b2c-a722-058464fa03c7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.110472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ac3c8-4e6e-4b2c-a722-058464fa03c7 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.111625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38555bf1-33a3-422c-a7b6-2b723559d711 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:04.111973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 288/566] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:04.112683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ac3c8-4e6e-4b2c-a722-058464fa03c7 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.114693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38555bf1-33a3-422c-a7b6-2b723559d711 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-38555bf1-33a3-422c-a7b6-2b723559d711 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:04.126571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:04.127499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:04.128403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:04.128403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:04.128403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:04.128403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:04.128403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:04.128403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:04.128403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:04.128403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:04.129217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 279/567] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:04.130049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38555bf1-33a3-422c-a7b6-2b723559d711 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.161097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:04.169434 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:04.220104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ac3c8-4e6e-4b2c-a722-058464fa03c7 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:04.233671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38555bf1-33a3-422c-a7b6-2b723559d711 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:04.256499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125daa37-25e9-47a7-95fd-66e1ed1119bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:04.257197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125daa37-25e9-47a7-95fd-66e1ed1119bb None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.257474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125daa37-25e9-47a7-95fd-66e1ed1119bb None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.257757 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125daa37-25e9-47a7-95fd-66e1ed1119bb None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.258452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125daa37-25e9-47a7-95fd-66e1ed1119bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:04.258759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125daa37-25e9-47a7-95fd-66e1ed1119bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:04.260134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125daa37-25e9-47a7-95fd-66e1ed1119bb None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:04.268625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cceec2d-7c45-4e00-b8d6-92d52d5df069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:04.268777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 289/568] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:04.269258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceec2d-7c45-4e00-b8d6-92d52d5df069 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.269527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125daa37-25e9-47a7-95fd-66e1ed1119bb None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.269623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceec2d-7c45-4e00-b8d6-92d52d5df069 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.269797 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceec2d-7c45-4e00-b8d6-92d52d5df069 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.280103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cceec2d-7c45-4e00-b8d6-92d52d5df069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-7cceec2d-7c45-4e00-b8d6-92d52d5df069 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:04.284971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:04.285911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:04.286822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 280/569] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:04.287508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601736d2-c34e-4289-928b-1c567d98e84f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.287799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601736d2-c34e-4289-928b-1c567d98e84f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.287988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601736d2-c34e-4289-928b-1c567d98e84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.305104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-601736d2-c34e-4289-928b-1c567d98e84f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:04.306335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-601736d2-c34e-4289-928b-1c567d98e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:04.374013 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 281/570] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:04.374894 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601736d2-c34e-4289-928b-1c567d98e84f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.377454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125daa37-25e9-47a7-95fd-66e1ed1119bb None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:04.390920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:04.410808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f407466-12b1-463a-912b-b085234760e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:04.411437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407466-12b1-463a-912b-b085234760e6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.411713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407466-12b1-463a-912b-b085234760e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.411983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407466-12b1-463a-912b-b085234760e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.421056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:04.423765 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f407466-12b1-463a-912b-b085234760e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:04.425265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f407466-12b1-463a-912b-b085234760e6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-5f407466-12b1-463a-912b-b085234760e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:04.441525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:04.442791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:04.443851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:04.443851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:04.443851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:04.449336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 290/571] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:04.449336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f407466-12b1-463a-912b-b085234760e6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.499594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601736d2-c34e-4289-928b-1c567d98e84f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:04.538693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c5b0-f8df-4f46-8ea0-abc619645009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:04.539301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c5b0-f8df-4f46-8ea0-abc619645009 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.539577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c5b0-f8df-4f46-8ea0-abc619645009 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.539846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c5b0-f8df-4f46-8ea0-abc619645009 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.540532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406c5b0-f8df-4f46-8ea0-abc619645009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:04.540833 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406c5b0-f8df-4f46-8ea0-abc619645009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:04.542933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406c5b0-f8df-4f46-8ea0-abc619645009 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:04.555329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 282/572] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:04.556140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c5b0-f8df-4f46-8ea0-abc619645009 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.569770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f407466-12b1-463a-912b-b085234760e6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:04.608021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec0903-cdc2-4207-b0e9-632a25931604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:04.608801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec0903-cdc2-4207-b0e9-632a25931604 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.609157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec0903-cdc2-4207-b0e9-632a25931604 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.609429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec0903-cdc2-4207-b0e9-632a25931604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.622412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec0903-cdc2-4207-b0e9-632a25931604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:04.623855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec0903-cdc2-4207-b0e9-632a25931604 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-d5ec0903-cdc2-4207-b0e9-632a25931604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:04.638584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:04.639686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:04.640930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:04.640930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:04.640930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:04.644243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 291/573] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:04.644973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec0903-cdc2-4207-b0e9-632a25931604 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.654575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:04.663588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:04.672441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c5b0-f8df-4f46-8ea0-abc619645009 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:04.706618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02c468-0784-418e-9337-f772abbbe92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:04.707218 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02c468-0784-418e-9337-f772abbbe92f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.707496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02c468-0784-418e-9337-f772abbbe92f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.707765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02c468-0784-418e-9337-f772abbbe92f None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.708419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02c468-0784-418e-9337-f772abbbe92f None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:04.708717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02c468-0784-418e-9337-f772abbbe92f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:04.710107 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02c468-0784-418e-9337-f772abbbe92f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:04.718301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 283/574] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:04.719077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02c468-0784-418e-9337-f772abbbe92f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.747077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec0903-cdc2-4207-b0e9-632a25931604 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:04.784236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde700e-2709-4eaf-84b2-cc8f32690cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:04.784236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde700e-2709-4eaf-84b2-cc8f32690cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.784236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde700e-2709-4eaf-84b2-cc8f32690cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.784236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde700e-2709-4eaf-84b2-cc8f32690cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.784641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde700e-2709-4eaf-84b2-cc8f32690cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:04.784641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde700e-2709-4eaf-84b2-cc8f32690cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:04.784641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde700e-2709-4eaf-84b2-cc8f32690cb1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:04.795926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 292/575] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:04.796739 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde700e-2709-4eaf-84b2-cc8f32690cb1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.821316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02c468-0784-418e-9337-f772abbbe92f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:04.855117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25e621-419d-48da-a2be-31510372bb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:04.856041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e621-419d-48da-a2be-31510372bb2c None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.856318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e621-419d-48da-a2be-31510372bb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.856587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25e621-419d-48da-a2be-31510372bb2c None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/8882a9f2764648be9bfe4606144660d1/roles/7667dacf895b4ae09b42a6ce839f2192` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.871282 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25e621-419d-48da-a2be-31510372bb2c None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=8882a9f2764648be9bfe4606144660d1, role_id=7667dacf895b4ae09b42a6ce839f2192)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:04.872812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25e621-419d-48da-a2be-31510372bb2c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:04.875000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:04.891365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:04.912038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde700e-2709-4eaf-84b2-cc8f32690cb1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:04.945419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca635a2-a602-4629-9cd3-a800341e70af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:04.946076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca635a2-a602-4629-9cd3-a800341e70af None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:04.946320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca635a2-a602-4629-9cd3-a800341e70af None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:04.946592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca635a2-a602-4629-9cd3-a800341e70af None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:04.947224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca635a2-a602-4629-9cd3-a800341e70af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:04.947524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca635a2-a602-4629-9cd3-a800341e70af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:04.949511 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca635a2-a602-4629-9cd3-a800341e70af None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:04.960220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 293/576] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:04.960994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca635a2-a602-4629-9cd3-a800341e70af None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:04.970943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 284/577] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:48:04 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/8882a9f2764648be9bfe4606144660d1/roles/7667dacf895b4ae09b42a6ce839f2192 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:48:04.971864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25e621-419d-48da-a2be-31510372bb2c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.075763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca635a2-a602-4629-9cd3-a800341e70af None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.084630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25e621-419d-48da-a2be-31510372bb2c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.117532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599bb3c-74bc-4e87-8901-5c2ec97b19ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.119135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599bb3c-74bc-4e87-8901-5c2ec97b19ec None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.119994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599bb3c-74bc-4e87-8901-5c2ec97b19ec None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.121055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599bb3c-74bc-4e87-8901-5c2ec97b19ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.122242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c07d-b443-4828-9de2-dbb75f7a9c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.122889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c07d-b443-4828-9de2-dbb75f7a9c3f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.123232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c07d-b443-4828-9de2-dbb75f7a9c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.123440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c07d-b443-4828-9de2-dbb75f7a9c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.129593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:05.134394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854c07d-b443-4828-9de2-dbb75f7a9c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:05.135218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599bb3c-74bc-4e87-8901-5c2ec97b19ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:05.136551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854c07d-b443-4828-9de2-dbb75f7a9c3f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-3599bb3c-74bc-4e87-8901-5c2ec97b19ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:05.142553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:05.143478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:05.144303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:05.144921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 294/578] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:05.145531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599bb3c-74bc-4e87-8901-5c2ec97b19ec None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-b854c07d-b443-4828-9de2-dbb75f7a9c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:05.158092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:05.159163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:05.160206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:05.160206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:05.160206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:05.160206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 285/579] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:05.160985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c07d-b443-4828-9de2-dbb75f7a9c3f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.208899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:05.257410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599bb3c-74bc-4e87-8901-5c2ec97b19ec None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.265867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c07d-b443-4828-9de2-dbb75f7a9c3f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.294384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7274-c229-4a58-b80f-132f034e364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.295025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7274-c229-4a58-b80f-132f034e364a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.295305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7274-c229-4a58-b80f-132f034e364a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.295607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7274-c229-4a58-b80f-132f034e364a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.302228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7274-c229-4a58-b80f-132f034e364a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:05.303396 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2891b3-8119-422d-ae9b-666ffaa2747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.303682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd7274-c229-4a58-b80f-132f034e364a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:05.304058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2891b3-8119-422d-ae9b-666ffaa2747b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.304294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2891b3-8119-422d-ae9b-666ffaa2747b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.304560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2891b3-8119-422d-ae9b-666ffaa2747b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.312477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2891b3-8119-422d-ae9b-666ffaa2747b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:05.313907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2891b3-8119-422d-ae9b-666ffaa2747b None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-4efd7274-c229-4a58-b80f-132f034e364a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:05.315968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:05.316966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:05.318114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:05.318114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:05.318114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:05.318114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:05.318114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:05.318114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:05.318114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:05.318114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:05.321732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 295/580] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:05.322682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7274-c229-4a58-b80f-132f034e364a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-af2891b3-8119-422d-ae9b-666ffaa2747b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:05.330002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:05.330975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 286/581] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:05.336503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2891b3-8119-422d-ae9b-666ffaa2747b None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.389140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:05.432078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7274-c229-4a58-b80f-132f034e364a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.441405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2891b3-8119-422d-ae9b-666ffaa2747b None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.449656 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:05.469136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dfe75-0e53-4336-844d-3cd3ab3a0db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.469746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfe75-0e53-4336-844d-3cd3ab3a0db0 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.470023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfe75-0e53-4336-844d-3cd3ab3a0db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.470319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfe75-0e53-4336-844d-3cd3ab3a0db0 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.471124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dfe75-0e53-4336-844d-3cd3ab3a0db0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:05.471362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dfe75-0e53-4336-844d-3cd3ab3a0db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:05.472728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dfe75-0e53-4336-844d-3cd3ab3a0db0 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:05.478842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a7a7d-8315-4bb2-81ff-ac5291324910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.479804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a7a7d-8315-4bb2-81ff-ac5291324910 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.480295 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a7a7d-8315-4bb2-81ff-ac5291324910 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.480746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a7a7d-8315-4bb2-81ff-ac5291324910 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.481596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a7a7d-8315-4bb2-81ff-ac5291324910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:05.481704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 296/582] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:05.482160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a7a7d-8315-4bb2-81ff-ac5291324910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:05.482445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dfe75-0e53-4336-844d-3cd3ab3a0db0 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.483980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a7a7d-8315-4bb2-81ff-ac5291324910 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:05.497574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 287/583] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:05.498740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a7a7d-8315-4bb2-81ff-ac5291324910 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.606494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dfe75-0e53-4336-844d-3cd3ab3a0db0 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.606962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a7a7d-8315-4bb2-81ff-ac5291324910 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.629464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:05.644722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700c91f-f991-471e-8ae6-83a7e1082447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.645341 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700c91f-f991-471e-8ae6-83a7e1082447 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.645625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700c91f-f991-471e-8ae6-83a7e1082447 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.649616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88a3b7-2c3a-4978-b390-0f3377fa7e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.649729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700c91f-f991-471e-8ae6-83a7e1082447 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.649804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a3b7-2c3a-4978-b390-0f3377fa7e81 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.649804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a3b7-2c3a-4978-b390-0f3377fa7e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.649929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700c91f-f991-471e-8ae6-83a7e1082447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:05.650012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a3b7-2c3a-4978-b390-0f3377fa7e81 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.650083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700c91f-f991-471e-8ae6-83a7e1082447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:05.650151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88a3b7-2c3a-4978-b390-0f3377fa7e81 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:05.650151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88a3b7-2c3a-4978-b390-0f3377fa7e81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:05.650503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700c91f-f991-471e-8ae6-83a7e1082447 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:05.650588 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88a3b7-2c3a-4978-b390-0f3377fa7e81 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:05.665278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 297/584] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:05.665278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700c91f-f991-471e-8ae6-83a7e1082447 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.669414 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 288/585] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Sep 14 11:48:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:05.670383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88a3b7-2c3a-4978-b390-0f3377fa7e81 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.695934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:05.776475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88a3b7-2c3a-4978-b390-0f3377fa7e81 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.776678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700c91f-f991-471e-8ae6-83a7e1082447 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.817802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfa7a0-a583-47c5-ace5-3ce5d6417e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.818474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa7a0-a583-47c5-ace5-3ce5d6417e83 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.818754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa7a0-a583-47c5-ace5-3ce5d6417e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.818856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d57bf-75eb-4e04-80e5-a1a74a15b7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.819050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfa7a0-a583-47c5-ace5-3ce5d6417e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.819380 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d57bf-75eb-4e04-80e5-a1a74a15b7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.819661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d57bf-75eb-4e04-80e5-a1a74a15b7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.819935 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d57bf-75eb-4e04-80e5-a1a74a15b7e8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.828488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d57bf-75eb-4e04-80e5-a1a74a15b7e8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:05.829930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d57bf-75eb-4e04-80e5-a1a74a15b7e8 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:05.831248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfa7a0-a583-47c5-ace5-3ce5d6417e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:05.832597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfa7a0-a583-47c5-ace5-3ce5d6417e83 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-096d57bf-75eb-4e04-80e5-a1a74a15b7e8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:05.842682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:05.843634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 289/586] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:05.844582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d57bf-75eb-4e04-80e5-a1a74a15b7e8 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-2ccfa7a0-a583-47c5-ace5-3ce5d6417e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:05.855052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:05.856485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:05.857478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:05.857478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:05.857478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:05.859434 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 298/587] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:05.863240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfa7a0-a583-47c5-ace5-3ce5d6417e83 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:05.903008 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:05.942637 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:05.959392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d57bf-75eb-4e04-80e5-a1a74a15b7e8 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.975883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfa7a0-a583-47c5-ace5-3ce5d6417e83 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:05.997721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad7df6-c9c8-4321-9fb3-57b3903d66b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:05.998461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad7df6-c9c8-4321-9fb3-57b3903d66b9 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:05.998743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad7df6-c9c8-4321-9fb3-57b3903d66b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:05.999137 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad7df6-c9c8-4321-9fb3-57b3903d66b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:05.999863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad7df6-c9c8-4321-9fb3-57b3903d66b9 None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=39b77396e6ec432e80f4d06bc09a8605) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:06.000197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad7df6-c9c8-4321-9fb3-57b3903d66b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.001802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad7df6-c9c8-4321-9fb3-57b3903d66b9 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:06.018257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 290/588] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:05 2022] GET /identity/v3/role_assignments?user.id=39b77396e6ec432e80f4d06bc09a8605&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:06.018257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad7df6-c9c8-4321-9fb3-57b3903d66b9 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:06.021228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2814f26-39ca-4db7-a075-20e217aab831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:06.021990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2814f26-39ca-4db7-a075-20e217aab831 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:06.022358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2814f26-39ca-4db7-a075-20e217aab831 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:06.022691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2814f26-39ca-4db7-a075-20e217aab831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:06.035082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2814f26-39ca-4db7-a075-20e217aab831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.036714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2814f26-39ca-4db7-a075-20e217aab831 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-a2814f26-39ca-4db7-a075-20e217aab831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:06.053153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:06.054483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:06.055583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:06.055583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:06.055583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:06.055944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 299/589] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:06.056788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2814f26-39ca-4db7-a075-20e217aab831 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:06.145509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad7df6-c9c8-4321-9fb3-57b3903d66b9 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:06.165813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:06.186778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2814f26-39ca-4db7-a075-20e217aab831 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:06.190806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b93a87-240d-455a-8cc6-92f3f354d48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:06.191645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b93a87-240d-455a-8cc6-92f3f354d48b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:06.192123 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b93a87-240d-455a-8cc6-92f3f354d48b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:06.192539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b93a87-240d-455a-8cc6-92f3f354d48b None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:06.193432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b93a87-240d-455a-8cc6-92f3f354d48b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:06.193909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b93a87-240d-455a-8cc6-92f3f354d48b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.196172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b93a87-240d-455a-8cc6-92f3f354d48b None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:06.220017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 291/590] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Sep 14 11:48:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:06.222489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b93a87-240d-455a-8cc6-92f3f354d48b None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:06.234037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:06.236572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85201e-5637-41bf-b6b9-ae4f005127b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:06.237198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85201e-5637-41bf-b6b9-ae4f005127b5 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:06.237483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85201e-5637-41bf-b6b9-ae4f005127b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:06.237758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85201e-5637-41bf-b6b9-ae4f005127b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:06.239596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85201e-5637-41bf-b6b9-ae4f005127b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:06.239596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85201e-5637-41bf-b6b9-ae4f005127b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.245046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85201e-5637-41bf-b6b9-ae4f005127b5 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:06.257874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 300/591] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:06.263080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85201e-5637-41bf-b6b9-ae4f005127b5 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:06.344592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b93a87-240d-455a-8cc6-92f3f354d48b None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:06.374790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85201e-5637-41bf-b6b9-ae4f005127b5 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:06.391878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ccd4e-6c2e-41dc-9239-f2c54aa38c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:06.393095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ccd4e-6c2e-41dc-9239-f2c54aa38c1f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:06.393623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ccd4e-6c2e-41dc-9239-f2c54aa38c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:06.394405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ccd4e-6c2e-41dc-9239-f2c54aa38c1f None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:06.395714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ccd4e-6c2e-41dc-9239-f2c54aa38c1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:06.396220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ccd4e-6c2e-41dc-9239-f2c54aa38c1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.398322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ccd4e-6c2e-41dc-9239-f2c54aa38c1f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:06.413103 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5649d-9e78-41e9-af5f-104902e8d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:06.413758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5649d-9e78-41e9-af5f-104902e8d632 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:06.414024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5649d-9e78-41e9-af5f-104902e8d632 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:06.414327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5649d-9e78-41e9-af5f-104902e8d632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:06.420920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 292/592] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:06.420920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ccd4e-6c2e-41dc-9239-f2c54aa38c1f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:06.435534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5649d-9e78-41e9-af5f-104902e8d632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.437923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5649d-9e78-41e9-af5f-104902e8d632 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:06.442541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-dec5649d-9e78-41e9-af5f-104902e8d632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:06.461364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:06.466069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:06.466973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:06.466973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:06.466973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:06.466973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 301/593] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:06.466973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5649d-9e78-41e9-af5f-104902e8d632 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:06.496783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:06.542041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ccd4e-6c2e-41dc-9239-f2c54aa38c1f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:06.581210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ead1d0-6671-4931-9b22-b1f99deb008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:06.582086 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ead1d0-6671-4931-9b22-b1f99deb008d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:06.582563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ead1d0-6671-4931-9b22-b1f99deb008d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:06.582984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ead1d0-6671-4931-9b22-b1f99deb008d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:06.591922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ead1d0-6671-4931-9b22-b1f99deb008d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.593690 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ead1d0-6671-4931-9b22-b1f99deb008d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-53ead1d0-6671-4931-9b22-b1f99deb008d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:06.606141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:06.607358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:06.608410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:06.608410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:06.608410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:06.608410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:06.608410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:06.608410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:06.608410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:06.608410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:06.608410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 11:48:06.608410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:06.608933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5649d-9e78-41e9-af5f-104902e8d632 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:06.610486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 293/594] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:06.611400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ead1d0-6671-4931-9b22-b1f99deb008d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:06.656132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1ada4-4297-47e2-8534-b4bcebc75ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:06.656875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1ada4-4297-47e2-8534-b4bcebc75ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:06.657230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1ada4-4297-47e2-8534-b4bcebc75ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:06.657599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1ada4-4297-47e2-8534-b4bcebc75ce5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:06.665352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1ada4-4297-47e2-8534-b4bcebc75ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.666919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1ada4-4297-47e2-8534-b4bcebc75ce5 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-82d1ada4-4297-47e2-8534-b4bcebc75ce5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:06.681707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:06.683436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:06.684531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:06.684531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:06.684531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:06.684531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:06.684531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:06.684531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:06.684531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:06.684531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:06.689978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 302/595] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:06.689978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1ada4-4297-47e2-8534-b4bcebc75ce5 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:06.742055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ead1d0-6671-4931-9b22-b1f99deb008d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:06.761552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:06.770530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:06.780399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4b208-526b-456f-98f9-32311281c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:06.781446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4b208-526b-456f-98f9-32311281c01c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:06.781927 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4b208-526b-456f-98f9-32311281c01c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:06.782458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4b208-526b-456f-98f9-32311281c01c None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:06.783311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4b208-526b-456f-98f9-32311281c01c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:06.783914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4b208-526b-456f-98f9-32311281c01c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.785509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4b208-526b-456f-98f9-32311281c01c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:06.799318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 294/596] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:06.800500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4b208-526b-456f-98f9-32311281c01c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:06.820983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1ada4-4297-47e2-8534-b4bcebc75ce5 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:06.862957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9099b-fe9b-4b09-ab83-8f750bf886da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:06.864056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9099b-fe9b-4b09-ab83-8f750bf886da None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:06.864559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9099b-fe9b-4b09-ab83-8f750bf886da None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:06.865040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9099b-fe9b-4b09-ab83-8f750bf886da None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:06.865968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9099b-fe9b-4b09-ab83-8f750bf886da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:06.866793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9099b-fe9b-4b09-ab83-8f750bf886da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.869533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9099b-fe9b-4b09-ab83-8f750bf886da None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:06.900185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 303/597] 10.222.0.77 () {56 vars in 1139 bytes} [Wed Sep 14 11:48:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:06.901092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9099b-fe9b-4b09-ab83-8f750bf886da None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:06.927561 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4b208-526b-456f-98f9-32311281c01c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:06.978019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c803c14-bb55-4325-9126-1df83e8505ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:06.979097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803c14-bb55-4325-9126-1df83e8505ac None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:06.979384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803c14-bb55-4325-9126-1df83e8505ac None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:06.980391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803c14-bb55-4325-9126-1df83e8505ac None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:06.982099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c803c14-bb55-4325-9126-1df83e8505ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:06.982430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c803c14-bb55-4325-9126-1df83e8505ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:06.984757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c803c14-bb55-4325-9126-1df83e8505ac None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:07.006422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 295/598] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:07.006422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c803c14-bb55-4325-9126-1df83e8505ac None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:07.039188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9099b-fe9b-4b09-ab83-8f750bf886da None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:07.062536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:07.070677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:07.089738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e7763-0e79-459c-9ddd-3b1e8c1eca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:07.090793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7763-0e79-459c-9ddd-3b1e8c1eca63 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:07.091281 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7763-0e79-459c-9ddd-3b1e8c1eca63 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:07.091772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7763-0e79-459c-9ddd-3b1e8c1eca63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:07.100640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e7763-0e79-459c-9ddd-3b1e8c1eca63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:07.102460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e7763-0e79-459c-9ddd-3b1e8c1eca63 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-737e7763-0e79-459c-9ddd-3b1e8c1eca63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:07.115763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:07.116669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:07.117550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:07.117550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:07.117550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:07.117550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:07.117550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:07.117550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:07.117550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:07.117550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:07.121841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 304/599] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:07.124230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e7763-0e79-459c-9ddd-3b1e8c1eca63 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:07.145463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c803c14-bb55-4325-9126-1df83e8505ac None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:07.185039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09829999-46a5-42fd-896e-51182d3eb7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:07.185647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09829999-46a5-42fd-896e-51182d3eb7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:07.186125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09829999-46a5-42fd-896e-51182d3eb7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:07.186125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09829999-46a5-42fd-896e-51182d3eb7b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:07.197130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09829999-46a5-42fd-896e-51182d3eb7b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:07.198872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09829999-46a5-42fd-896e-51182d3eb7b5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-09829999-46a5-42fd-896e-51182d3eb7b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:07.213233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:07.215061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:07.215949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:07.215949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:07.215949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:07.219525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 296/600] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:07.220598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09829999-46a5-42fd-896e-51182d3eb7b5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:07.237220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e7763-0e79-459c-9ddd-3b1e8c1eca63 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:07.271756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfa55f-78a5-41c4-972b-680df5007de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:07.272461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfa55f-78a5-41c4-972b-680df5007de3 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:07.272740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfa55f-78a5-41c4-972b-680df5007de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:07.273018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfa55f-78a5-41c4-972b-680df5007de3 None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/47bdd5f0b3bc4c099c0d34b3b7c3f3b9/roles/7667dacf895b4ae09b42a6ce839f2192` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:07.288202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfa55f-78a5-41c4-972b-680df5007de3 None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=47bdd5f0b3bc4c099c0d34b3b7c3f3b9, role_id=7667dacf895b4ae09b42a6ce839f2192)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:07.289652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfa55f-78a5-41c4-972b-680df5007de3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:07.321551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:07.325795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09829999-46a5-42fd-896e-51182d3eb7b5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:07.355496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 305/601] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:48:07 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/47bdd5f0b3bc4c099c0d34b3b7c3f3b9/roles/7667dacf895b4ae09b42a6ce839f2192 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:48:07.355496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf46c8-68d8-431f-8ed7-3a40ca0a78ad None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:07.355496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf46c8-68d8-431f-8ed7-3a40ca0a78ad None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:07.355496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf46c8-68d8-431f-8ed7-3a40ca0a78ad None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:07.355496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 306/602] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:07.355496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf46c8-68d8-431f-8ed7-3a40ca0a78ad None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:07.368680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f9942-5011-45f7-9a09-62946f43afa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:07.369673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9942-5011-45f7-9a09-62946f43afa6 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:07.370260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9942-5011-45f7-9a09-62946f43afa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:07.370551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9942-5011-45f7-9a09-62946f43afa6 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:07.371811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f9942-5011-45f7-9a09-62946f43afa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:07.372187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f9942-5011-45f7-9a09-62946f43afa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:07.373904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f9942-5011-45f7-9a09-62946f43afa6 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:07.388359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 297/603] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:07.389773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:07.390707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e586ca-7330-4eed-9fc0-c3fb2ce3ed0f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:07.391258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e586ca-7330-4eed-9fc0-c3fb2ce3ed0f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:07.391672 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e586ca-7330-4eed-9fc0-c3fb2ce3ed0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:07.412991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-a1e586ca-7330-4eed-9fc0-c3fb2ce3ed0f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:07.414536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a1e586ca-7330-4eed-9fc0-c3fb2ce3ed0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:07.495171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf46c8-68d8-431f-8ed7-3a40ca0a78ad None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:07.504838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 298/604] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:07.506011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e586ca-7330-4eed-9fc0-c3fb2ce3ed0f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:07.537278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bee51b-8975-4d6d-85c4-74088383391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:07.537995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bee51b-8975-4d6d-85c4-74088383391c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:07.538386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bee51b-8975-4d6d-85c4-74088383391c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:07.538771 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bee51b-8975-4d6d-85c4-74088383391c None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:07.540092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bee51b-8975-4d6d-85c4-74088383391c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:07.540473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bee51b-8975-4d6d-85c4-74088383391c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:07.542693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bee51b-8975-4d6d-85c4-74088383391c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:07.557198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 307/605] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:07.566532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bee51b-8975-4d6d-85c4-74088383391c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:07.650595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:07.661167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e586ca-7330-4eed-9fc0-c3fb2ce3ed0f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:07.662782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:07.680230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bee51b-8975-4d6d-85c4-74088383391c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:07.699912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef37896-d1aa-4b35-8c87-08e051a33291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:07.700844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef37896-d1aa-4b35-8c87-08e051a33291 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:07.706492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef37896-d1aa-4b35-8c87-08e051a33291 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:07.706492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef37896-d1aa-4b35-8c87-08e051a33291 None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/c610ab76127b40429d8e9259446df49a/roles/7667dacf895b4ae09b42a6ce839f2192` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:07.719295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bf503-a29c-47fd-9dcd-ce9436f600b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:07.719940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bf503-a29c-47fd-9dcd-ce9436f600b4 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:07.720220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bf503-a29c-47fd-9dcd-ce9436f600b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:07.720550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bf503-a29c-47fd-9dcd-ce9436f600b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:07.724593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef37896-d1aa-4b35-8c87-08e051a33291 None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=c610ab76127b40429d8e9259446df49a, role_id=7667dacf895b4ae09b42a6ce839f2192)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:07.726116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef37896-d1aa-4b35-8c87-08e051a33291 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:07.736372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bf503-a29c-47fd-9dcd-ce9436f600b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:07.737896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bf503-a29c-47fd-9dcd-ce9436f600b4 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-a58bf503-a29c-47fd-9dcd-ce9436f600b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:07.750793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:07.751861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:07.752849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:07.752849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:07.752849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:07.752849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:07.752849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:07.752849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:07.752849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:07.752849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:07.756659 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 308/606] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:07.757926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bf503-a29c-47fd-9dcd-ce9436f600b4 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:07.867293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bf503-a29c-47fd-9dcd-ce9436f600b4 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:07.893412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 299/607] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:48:07 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/c610ab76127b40429d8e9259446df49a/roles/7667dacf895b4ae09b42a6ce839f2192 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:48:07.893412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef37896-d1aa-4b35-8c87-08e051a33291 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:07.925349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385be4b6-f6d6-4b46-a282-40d21f6fdcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:07.926072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385be4b6-f6d6-4b46-a282-40d21f6fdcfd None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:07.926431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385be4b6-f6d6-4b46-a282-40d21f6fdcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:07.927778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385be4b6-f6d6-4b46-a282-40d21f6fdcfd None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:07.928563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385be4b6-f6d6-4b46-a282-40d21f6fdcfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:07.929374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385be4b6-f6d6-4b46-a282-40d21f6fdcfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:07.932210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385be4b6-f6d6-4b46-a282-40d21f6fdcfd None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:07.959454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 309/608] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:07.967528 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385be4b6-f6d6-4b46-a282-40d21f6fdcfd None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:07.973618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:08.107326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef37896-d1aa-4b35-8c87-08e051a33291 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:08.149640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385be4b6-f6d6-4b46-a282-40d21f6fdcfd None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:08.161194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c02a55-1f53-4ca5-8330-e2e2c94f28fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:08.162078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c02a55-1f53-4ca5-8330-e2e2c94f28fc None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:08.162917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c02a55-1f53-4ca5-8330-e2e2c94f28fc None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:08.163339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c02a55-1f53-4ca5-8330-e2e2c94f28fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:08.173781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:08.178041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c02a55-1f53-4ca5-8330-e2e2c94f28fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-78c02a55-1f53-4ca5-8330-e2e2c94f28fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:08.184648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:08.189430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:08.190649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 300/609] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:08.193329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c02a55-1f53-4ca5-8330-e2e2c94f28fc None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:08.206904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b25c4-3e0c-4669-a886-c4331731f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:08.209378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b25c4-3e0c-4669-a886-c4331731f928 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:08.209960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b25c4-3e0c-4669-a886-c4331731f928 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:08.211470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b25c4-3e0c-4669-a886-c4331731f928 None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/67880641bc954088bef0b601a8410f9a/roles/7667dacf895b4ae09b42a6ce839f2192` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:08.232228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b25c4-3e0c-4669-a886-c4331731f928 None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=67880641bc954088bef0b601a8410f9a, role_id=7667dacf895b4ae09b42a6ce839f2192)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:08.234657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b25c4-3e0c-4669-a886-c4331731f928 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:08.320675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c02a55-1f53-4ca5-8330-e2e2c94f28fc None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:08.330418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 310/610] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:48:07 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/67880641bc954088bef0b601a8410f9a/roles/7667dacf895b4ae09b42a6ce839f2192 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:48:08.331697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f99b-b93c-49ac-a434-678faf57a674 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:08.331979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f99b-b93c-49ac-a434-678faf57a674 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:08.332251 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f99b-b93c-49ac-a434-678faf57a674 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:08.345718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 311/611] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:08.353018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1322506-13d1-4ae3-9788-1e9c3dc7f1c7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:08.353331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1322506-13d1-4ae3-9788-1e9c3dc7f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:08.353604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1322506-13d1-4ae3-9788-1e9c3dc7f1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:08.369727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dca98b-73bc-4642-96af-6be9f887eb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:08.370350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dca98b-73bc-4642-96af-6be9f887eb30 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:08.370631 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dca98b-73bc-4642-96af-6be9f887eb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:08.370904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dca98b-73bc-4642-96af-6be9f887eb30 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:08.371642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dca98b-73bc-4642-96af-6be9f887eb30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:08.371951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dca98b-73bc-4642-96af-6be9f887eb30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:08.378160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dca98b-73bc-4642-96af-6be9f887eb30 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:08.384418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 301/612] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:08.387946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f1322506-13d1-4ae3-9788-1e9c3dc7f1c7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:08.389417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f1322506-13d1-4ae3-9788-1e9c3dc7f1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:08.394257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dca98b-73bc-4642-96af-6be9f887eb30 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:08.507756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:08.526606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:08.537831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 312/613] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 11:48:08.575078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dca98b-73bc-4642-96af-6be9f887eb30 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:08.637042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47285526-7f5d-4285-9d4f-6147a86aa4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:08.637898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47285526-7f5d-4285-9d4f-6147a86aa4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:08.638361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47285526-7f5d-4285-9d4f-6147a86aa4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:08.638768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47285526-7f5d-4285-9d4f-6147a86aa4c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:08.659159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47285526-7f5d-4285-9d4f-6147a86aa4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:08.661004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47285526-7f5d-4285-9d4f-6147a86aa4c1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-47285526-7f5d-4285-9d4f-6147a86aa4c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:08.675929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:08.677030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:08.678124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:08.678124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:08.678124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:08.679964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 302/614] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:08.688411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1322506-13d1-4ae3-9788-1e9c3dc7f1c7 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:08.834598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1322506-13d1-4ae3-9788-1e9c3dc7f1c7 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:08.870888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ad6c9-10d8-4e24-a583-02e3866ee32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:08.871358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ad6c9-10d8-4e24-a583-02e3866ee32a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:08.871638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ad6c9-10d8-4e24-a583-02e3866ee32a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:08.871907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ad6c9-10d8-4e24-a583-02e3866ee32a None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:08.872559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ad6c9-10d8-4e24-a583-02e3866ee32a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:08.872859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ad6c9-10d8-4e24-a583-02e3866ee32a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:08.874267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ad6c9-10d8-4e24-a583-02e3866ee32a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:08.886783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 313/615] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:08.892191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47285526-7f5d-4285-9d4f-6147a86aa4c1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:09.018349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ad6c9-10d8-4e24-a583-02e3866ee32a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:09.035141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47285526-7f5d-4285-9d4f-6147a86aa4c1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:09.062372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:09.106071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca02c0-9897-4fc5-937e-e43d3e0e4fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:09.106753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca02c0-9897-4fc5-937e-e43d3e0e4fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:09.107061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca02c0-9897-4fc5-937e-e43d3e0e4fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:09.107340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca02c0-9897-4fc5-937e-e43d3e0e4fb9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:09.122009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca02c0-9897-4fc5-937e-e43d3e0e4fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:09.122608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:09.123486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca02c0-9897-4fc5-937e-e43d3e0e4fb9 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-c3ca02c0-9897-4fc5-937e-e43d3e0e4fb9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:09.147670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:09.148624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:09.149621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:09.149621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:09.149621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:09.149621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:09.149621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:09.149621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:09.149621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:09.149621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:09.149621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:48:09.149621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:09.152670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 303/616] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Sep 14 11:48:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:09.158453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca02c0-9897-4fc5-937e-e43d3e0e4fb9 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:09.192024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ad6c9-10d8-4e24-a583-02e3866ee32a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:09.260254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2a94-8a92-432e-b3dc-72e083274358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:09.261593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2a94-8a92-432e-b3dc-72e083274358 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:09.261878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2a94-8a92-432e-b3dc-72e083274358 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:09.262151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2a94-8a92-432e-b3dc-72e083274358 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:09.285571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b2a94-8a92-432e-b3dc-72e083274358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-0b4b2a94-8a92-432e-b3dc-72e083274358 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:09.290930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:09.291902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:09.293140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 314/617] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:09.303322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2a94-8a92-432e-b3dc-72e083274358 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:09.355433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca02c0-9897-4fc5-937e-e43d3e0e4fb9 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:09.425413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb9ec1-3b80-4d6f-b467-c0fb85044600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:09.426041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb9ec1-3b80-4d6f-b467-c0fb85044600 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:09.426349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb9ec1-3b80-4d6f-b467-c0fb85044600 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:09.426626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb9ec1-3b80-4d6f-b467-c0fb85044600 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:09.427375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb9ec1-3b80-4d6f-b467-c0fb85044600 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:09.430492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb9ec1-3b80-4d6f-b467-c0fb85044600 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:09.431959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb9ec1-3b80-4d6f-b467-c0fb85044600 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:09.465543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 304/618] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Sep 14 11:48:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:09.469263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb9ec1-3b80-4d6f-b467-c0fb85044600 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:09.515479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2a94-8a92-432e-b3dc-72e083274358 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:09.520896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:09.534489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:09.589663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aac51-b549-4daf-aa33-fe35b7dd6d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:09.590381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aac51-b549-4daf-aa33-fe35b7dd6d28 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:09.590658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aac51-b549-4daf-aa33-fe35b7dd6d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:09.590923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aac51-b549-4daf-aa33-fe35b7dd6d28 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:09.591597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aac51-b549-4daf-aa33-fe35b7dd6d28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:09.591897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aac51-b549-4daf-aa33-fe35b7dd6d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:09.593256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1aac51-b549-4daf-aa33-fe35b7dd6d28 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:09.619836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 315/619] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:09.621438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aac51-b549-4daf-aa33-fe35b7dd6d28 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:09.657590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb9ec1-3b80-4d6f-b467-c0fb85044600 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:09.705310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61437a1f-5d20-405e-907d-3cde76dc477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:09.705842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437a1f-5d20-405e-907d-3cde76dc477e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:09.706119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437a1f-5d20-405e-907d-3cde76dc477e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:09.706415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437a1f-5d20-405e-907d-3cde76dc477e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:09.833224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aac51-b549-4daf-aa33-fe35b7dd6d28 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:09.851167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61437a1f-5d20-405e-907d-3cde76dc477e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:09.852961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61437a1f-5d20-405e-907d-3cde76dc477e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:09.872537 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e643f-f1af-4ecf-9ed8-e3d2ecaaef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:09.873183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e643f-f1af-4ecf-9ed8-e3d2ecaaef74 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:09.873458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e643f-f1af-4ecf-9ed8-e3d2ecaaef74 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:09.873726 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e643f-f1af-4ecf-9ed8-e3d2ecaaef74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:09.896217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e643f-f1af-4ecf-9ed8-e3d2ecaaef74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:09.897666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e643f-f1af-4ecf-9ed8-e3d2ecaaef74 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-d00e643f-f1af-4ecf-9ed8-e3d2ecaaef74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:09.920764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:09.922101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:09.923148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:09.923148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:09.923148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:09.923148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 316/620] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:09.931196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e643f-f1af-4ecf-9ed8-e3d2ecaaef74 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:09.954472 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:09.966636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:10.022070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 305/621] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:48:10.023821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941ed89-79b9-44ee-ab90-a288ec9b699e None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.024266 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941ed89-79b9-44ee-ab90-a288ec9b699e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.024689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941ed89-79b9-44ee-ab90-a288ec9b699e None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.028467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 306/622] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:10.029441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941ed89-79b9-44ee-ab90-a288ec9b699e None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:10.066780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e643f-f1af-4ecf-9ed8-e3d2ecaaef74 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:10.102482 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc561027-1334-4b99-be47-ba351d4c0d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:10.103325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc561027-1334-4b99-be47-ba351d4c0d9a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.103774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc561027-1334-4b99-be47-ba351d4c0d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.104218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc561027-1334-4b99-be47-ba351d4c0d9a None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.105042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc561027-1334-4b99-be47-ba351d4c0d9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:10.105502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc561027-1334-4b99-be47-ba351d4c0d9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:10.107059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc561027-1334-4b99-be47-ba351d4c0d9a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:10.124982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 317/623] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:10.126604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df160d7-7c16-42d0-a452-3802c765a7b6 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.127059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df160d7-7c16-42d0-a452-3802c765a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.127495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df160d7-7c16-42d0-a452-3802c765a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.146149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-7df160d7-7c16-42d0-a452-3802c765a7b6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:10.147528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941ed89-79b9-44ee-ab90-a288ec9b699e None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:10.147971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7df160d7-7c16-42d0-a452-3802c765a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:10.179688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:10.187665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ef130-3b6b-471a-8157-93b9f2d3d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:10.188194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ef130-3b6b-471a-8157-93b9f2d3d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.194857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ef130-3b6b-471a-8157-93b9f2d3d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.194857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ef130-3b6b-471a-8157-93b9f2d3d6e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.201342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ef130-3b6b-471a-8157-93b9f2d3d6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:10.202871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ef130-3b6b-471a-8157-93b9f2d3d6e3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-b89ef130-3b6b-471a-8157-93b9f2d3d6e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:10.219878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:10.221028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:10.221943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:10.221943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:10.221943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:10.222627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 307/624] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:10.223548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ef130-3b6b-471a-8157-93b9f2d3d6e3 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:10.234582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 318/625] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:10.236122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df160d7-7c16-42d0-a452-3802c765a7b6 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:10.247420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:10.349008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ef130-3b6b-471a-8157-93b9f2d3d6e3 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:10.386144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f71c9-603b-4ebf-ae4a-65fd9dad9fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:10.387660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f71c9-603b-4ebf-ae4a-65fd9dad9fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.388144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f71c9-603b-4ebf-ae4a-65fd9dad9fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.388619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f71c9-603b-4ebf-ae4a-65fd9dad9fb0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.396944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f71c9-603b-4ebf-ae4a-65fd9dad9fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:10.398684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f71c9-603b-4ebf-ae4a-65fd9dad9fb0 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:10.402107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df160d7-7c16-42d0-a452-3802c765a7b6 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-109f71c9-603b-4ebf-ae4a-65fd9dad9fb0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:10.412245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:10.413243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:10.414186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:10.414186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:10.414186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:10.414186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:10.414186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:10.414186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:10.414186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:10.414186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:10.414186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:10.414186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:10.417033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 308/626] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:10.423289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f71c9-603b-4ebf-ae4a-65fd9dad9fb0 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:10.474404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:10.474907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e55f3-d91e-4f76-8ff4-a3b64b1981ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:10.475542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e55f3-d91e-4f76-8ff4-a3b64b1981ff None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.476066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e55f3-d91e-4f76-8ff4-a3b64b1981ff None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.476066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e55f3-d91e-4f76-8ff4-a3b64b1981ff None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.476749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e55f3-d91e-4f76-8ff4-a3b64b1981ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:10.477057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e55f3-d91e-4f76-8ff4-a3b64b1981ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:10.478474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e55f3-d91e-4f76-8ff4-a3b64b1981ff None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:10.495135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 319/627] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:10.500582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e55f3-d91e-4f76-8ff4-a3b64b1981ff None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:10.538046 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f71c9-603b-4ebf-ae4a-65fd9dad9fb0 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:10.574246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daca02d-c3e1-42f4-84a6-d4cf56887924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:10.575230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca02d-c3e1-42f4-84a6-d4cf56887924 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.575705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca02d-c3e1-42f4-84a6-d4cf56887924 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.576208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca02d-c3e1-42f4-84a6-d4cf56887924 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.577128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca02d-c3e1-42f4-84a6-d4cf56887924 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:10.577644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca02d-c3e1-42f4-84a6-d4cf56887924 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:10.579482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca02d-c3e1-42f4-84a6-d4cf56887924 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:10.602135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 309/628] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Sep 14 11:48:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:10.603755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51300bf-0a05-413b-a6fe-587391890135 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.604045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51300bf-0a05-413b-a6fe-587391890135 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.604371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51300bf-0a05-413b-a6fe-587391890135 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.609816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 310/629] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:10.609816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51300bf-0a05-413b-a6fe-587391890135 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:10.618550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:10.658475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e55f3-d91e-4f76-8ff4-a3b64b1981ff None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:10.701210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1892fef-6b5a-48a8-9063-1777973f184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:10.701860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1892fef-6b5a-48a8-9063-1777973f184b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.702144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1892fef-6b5a-48a8-9063-1777973f184b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.702427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1892fef-6b5a-48a8-9063-1777973f184b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.711453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1892fef-6b5a-48a8-9063-1777973f184b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:10.712900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1892fef-6b5a-48a8-9063-1777973f184b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-c1892fef-6b5a-48a8-9063-1777973f184b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:10.725406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:10.726363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:10.727291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:10.727291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:10.727291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:10.727291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:10.727291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:10.727291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:10.727291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:10.727291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:10.727291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 320/630] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:10.727788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844983-a369-4f78-9d12-b50d08549cd3 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.728316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844983-a369-4f78-9d12-b50d08549cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.728316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844983-a369-4f78-9d12-b50d08549cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.744602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:10.746670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-89844983-a369-4f78-9d12-b50d08549cd3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:10.747852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-89844983-a369-4f78-9d12-b50d08549cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:10.750105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51300bf-0a05-413b-a6fe-587391890135 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:10.794405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a33be-ef69-4d02-b83e-ce6639825eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:10.795040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a33be-ef69-4d02-b83e-ce6639825eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.795319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a33be-ef69-4d02-b83e-ce6639825eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.795590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a33be-ef69-4d02-b83e-ce6639825eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.805615 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a33be-ef69-4d02-b83e-ce6639825eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:10.810329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a33be-ef69-4d02-b83e-ce6639825eb5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:10.816842 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 321/631] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:10.817724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89844983-a369-4f78-9d12-b50d08549cd3 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-c08a33be-ef69-4d02-b83e-ce6639825eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:10.824070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:10.825056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:10.825954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:10.825954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:10.825954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:10.825954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 311/632] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:10.826685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a33be-ef69-4d02-b83e-ce6639825eb5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:10.884247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:10.928661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89844983-a369-4f78-9d12-b50d08549cd3 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:10.929483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a33be-ef69-4d02-b83e-ce6639825eb5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:10.967128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e584386-7200-40cc-9b88-e99171250474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:10.967666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a65f0-083b-4420-9a4f-019d7dcac10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:10.967791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e584386-7200-40cc-9b88-e99171250474 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.967989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e584386-7200-40cc-9b88-e99171250474 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.968260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e584386-7200-40cc-9b88-e99171250474 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.968361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a65f0-083b-4420-9a4f-019d7dcac10e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.968553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a65f0-083b-4420-9a4f-019d7dcac10e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.968820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a65f0-083b-4420-9a4f-019d7dcac10e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.968980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e584386-7200-40cc-9b88-e99171250474 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:10.969285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e584386-7200-40cc-9b88-e99171250474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:10.970688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e584386-7200-40cc-9b88-e99171250474 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:10.979113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a65f0-083b-4420-9a4f-019d7dcac10e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:10.987258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 312/633] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:10.987258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4251c2-30b2-4c72-a07f-7925adbbe92a None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:10.987258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4251c2-30b2-4c72-a07f-7925adbbe92a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-fe7a65f0-083b-4420-9a4f-019d7dcac10e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:10.987548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:10.988396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:10.989220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:10.989866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4251c2-30b2-4c72-a07f-7925adbbe92a None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:10.989934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 322/634] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:10.989934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a65f0-083b-4420-9a4f-019d7dcac10e None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:10.990944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 313/635] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:10.990944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4251c2-30b2-4c72-a07f-7925adbbe92a None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:11.006744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:11.096283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4251c2-30b2-4c72-a07f-7925adbbe92a None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.102466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a65f0-083b-4420-9a4f-019d7dcac10e None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.119683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:11.130748 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ddc01-8440-4d71-a015-257fbc840878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:11.131349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ddc01-8440-4d71-a015-257fbc840878 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.131626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ddc01-8440-4d71-a015-257fbc840878 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.131898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ddc01-8440-4d71-a015-257fbc840878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.132613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ddc01-8440-4d71-a015-257fbc840878 None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=8882a9f2764648be9bfe4606144660d1) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:11.132917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ddc01-8440-4d71-a015-257fbc840878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:11.134371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ddc01-8440-4d71-a015-257fbc840878 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:11.137426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a646fce-f546-41f3-980e-1a9486ce6eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:11.138025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a646fce-f546-41f3-980e-1a9486ce6eaa None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.138330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a646fce-f546-41f3-980e-1a9486ce6eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.138599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a646fce-f546-41f3-980e-1a9486ce6eaa None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.139234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a646fce-f546-41f3-980e-1a9486ce6eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:11.139531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a646fce-f546-41f3-980e-1a9486ce6eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:11.140343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 314/636] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:10 2022] GET /identity/v3/role_assignments?user.id=8882a9f2764648be9bfe4606144660d1&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:11.140872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a646fce-f546-41f3-980e-1a9486ce6eaa None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:11.141124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ddc01-8440-4d71-a015-257fbc840878 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:11.159129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 323/637] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:11.159129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de44a5-0975-496f-ae6a-570a4d8d3cf4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.159129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de44a5-0975-496f-ae6a-570a4d8d3cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.159129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de44a5-0975-496f-ae6a-570a4d8d3cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.178025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f9de44a5-0975-496f-ae6a-570a4d8d3cf4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:11.179308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f9de44a5-0975-496f-ae6a-570a4d8d3cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:11.232806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:11.257675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ddc01-8440-4d71-a015-257fbc840878 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.259478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 324/638] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:11.261496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de44a5-0975-496f-ae6a-570a4d8d3cf4 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:11.313252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338b6a8-71ff-493c-a063-f714f51eab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:11.314946 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338b6a8-71ff-493c-a063-f714f51eab0c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.315489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338b6a8-71ff-493c-a063-f714f51eab0c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.315758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338b6a8-71ff-493c-a063-f714f51eab0c None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.316476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338b6a8-71ff-493c-a063-f714f51eab0c None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:11.316774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338b6a8-71ff-493c-a063-f714f51eab0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:11.318168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338b6a8-71ff-493c-a063-f714f51eab0c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:11.336326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 315/639] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:11.336326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338b6a8-71ff-493c-a063-f714f51eab0c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:11.409406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de44a5-0975-496f-ae6a-570a4d8d3cf4 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.421682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:11.450603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea612c2-88af-4a74-b548-d8cc5db97a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:11.451291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea612c2-88af-4a74-b548-d8cc5db97a36 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.451718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea612c2-88af-4a74-b548-d8cc5db97a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.452183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea612c2-88af-4a74-b548-d8cc5db97a36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.455329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338b6a8-71ff-493c-a063-f714f51eab0c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.471141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea612c2-88af-4a74-b548-d8cc5db97a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-4ea612c2-88af-4a74-b548-d8cc5db97a36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:11.474417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:11.475469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:11.476368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 325/640] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:11.477046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea612c2-88af-4a74-b548-d8cc5db97a36 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:11.499784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca393b-c77e-4f0a-996c-d1763de8d2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:11.500338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca393b-c77e-4f0a-996c-d1763de8d2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.500616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca393b-c77e-4f0a-996c-d1763de8d2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.500889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca393b-c77e-4f0a-996c-d1763de8d2c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.508248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca393b-c77e-4f0a-996c-d1763de8d2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:11.509711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca393b-c77e-4f0a-996c-d1763de8d2c3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:11.513199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-a2ca393b-c77e-4f0a-996c-d1763de8d2c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:11.526719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:11.527642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:11.528942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:11.528942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:11.528942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:11.528942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:11.528942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:11.528942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:11.528942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:11.528942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:11.528942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 316/641] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:11.528942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca393b-c77e-4f0a-996c-d1763de8d2c3 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:11.597119 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea612c2-88af-4a74-b548-d8cc5db97a36 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.632834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80466-00d0-450c-af12-fe3fac15732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:11.633679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80466-00d0-450c-af12-fe3fac15732c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.634128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80466-00d0-450c-af12-fe3fac15732c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.634445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80466-00d0-450c-af12-fe3fac15732c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.643410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca393b-c77e-4f0a-996c-d1763de8d2c3 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.645985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b80466-00d0-450c-af12-fe3fac15732c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:11.647457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b80466-00d0-450c-af12-fe3fac15732c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-42b80466-00d0-450c-af12-fe3fac15732c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:11.661456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:11.662521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:11.663623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:11.663623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:11.663623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:11.667182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 326/642] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:11.668026 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80466-00d0-450c-af12-fe3fac15732c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:11.683369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8513fb8-344f-4ff1-8f4d-86029ab4cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:11.684257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8513fb8-344f-4ff1-8f4d-86029ab4cd78 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.684709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8513fb8-344f-4ff1-8f4d-86029ab4cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.684980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8513fb8-344f-4ff1-8f4d-86029ab4cd78 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.685647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8513fb8-344f-4ff1-8f4d-86029ab4cd78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:11.685968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8513fb8-344f-4ff1-8f4d-86029ab4cd78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:11.687415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8513fb8-344f-4ff1-8f4d-86029ab4cd78 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:11.691758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:11.701166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 317/643] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:11.702054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8513fb8-344f-4ff1-8f4d-86029ab4cd78 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:11.767066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:11.778280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80466-00d0-450c-af12-fe3fac15732c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.814078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8513fb8-344f-4ff1-8f4d-86029ab4cd78 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.814658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de71ca-a133-49cd-b795-e0e5932e0771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:11.815543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de71ca-a133-49cd-b795-e0e5932e0771 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.815827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de71ca-a133-49cd-b795-e0e5932e0771 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.816087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de71ca-a133-49cd-b795-e0e5932e0771 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.816778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de71ca-a133-49cd-b795-e0e5932e0771 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:11.817077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de71ca-a133-49cd-b795-e0e5932e0771 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:11.818543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de71ca-a133-49cd-b795-e0e5932e0771 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:11.831756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 327/644] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:11.832584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de71ca-a133-49cd-b795-e0e5932e0771 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:11.856271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91fa1b-b1db-4074-bdcd-a16982d1ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:11.857336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91fa1b-b1db-4074-bdcd-a16982d1ba0c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.857849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91fa1b-b1db-4074-bdcd-a16982d1ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.858338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91fa1b-b1db-4074-bdcd-a16982d1ba0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.869323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91fa1b-b1db-4074-bdcd-a16982d1ba0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-2e91fa1b-b1db-4074-bdcd-a16982d1ba0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:11.876199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:11.877146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:11.878143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 318/645] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:11.878889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91fa1b-b1db-4074-bdcd-a16982d1ba0c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:11.925323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:11.945094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de71ca-a133-49cd-b795-e0e5932e0771 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.981822 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf95b5c-00c7-4626-b74a-cc4d2d6e4bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:11.982463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf95b5c-00c7-4626-b74a-cc4d2d6e4bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:11.982742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf95b5c-00c7-4626-b74a-cc4d2d6e4bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:11.983017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf95b5c-00c7-4626-b74a-cc4d2d6e4bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:11.983655 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf95b5c-00c7-4626-b74a-cc4d2d6e4bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:11.983954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf95b5c-00c7-4626-b74a-cc4d2d6e4bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:11.985296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf95b5c-00c7-4626-b74a-cc4d2d6e4bf5 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:11.985650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91fa1b-b1db-4074-bdcd-a16982d1ba0c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:11.997272 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 328/646] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:11.999211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf95b5c-00c7-4626-b74a-cc4d2d6e4bf5 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:12.013301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:12.028024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed7433-4805-4c67-ad89-f5017e3fd424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:12.028707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed7433-4805-4c67-ad89-f5017e3fd424 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:12.029016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed7433-4805-4c67-ad89-f5017e3fd424 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:12.029372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed7433-4805-4c67-ad89-f5017e3fd424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:12.040646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed7433-4805-4c67-ad89-f5017e3fd424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:12.042794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed7433-4805-4c67-ad89-f5017e3fd424 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-25ed7433-4805-4c67-ad89-f5017e3fd424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:12.059418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:12.060381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:12.061256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:12.061256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:12.061256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:12.061256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 319/647] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:12.061476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed7433-4805-4c67-ad89-f5017e3fd424 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:12.116753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf95b5c-00c7-4626-b74a-cc4d2d6e4bf5 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:12.157106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b9adf-b73d-4fcb-a2c9-a0e015880286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:12.158427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b9adf-b73d-4fcb-a2c9-a0e015880286 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:12.158726 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b9adf-b73d-4fcb-a2c9-a0e015880286 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:12.159005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b9adf-b73d-4fcb-a2c9-a0e015880286 None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/39b77396e6ec432e80f4d06bc09a8605/roles/7667dacf895b4ae09b42a6ce839f2192` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:12.165109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed7433-4805-4c67-ad89-f5017e3fd424 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:12.170500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:12.175388 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b9adf-b73d-4fcb-a2c9-a0e015880286 None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=39b77396e6ec432e80f4d06bc09a8605, role_id=7667dacf895b4ae09b42a6ce839f2192)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:12.177238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b9adf-b73d-4fcb-a2c9-a0e015880286 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:12.200871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8c36-1cd2-4d77-82df-774f744cc0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:12.201500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8c36-1cd2-4d77-82df-774f744cc0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:12.201784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8c36-1cd2-4d77-82df-774f744cc0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:12.202058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8c36-1cd2-4d77-82df-774f744cc0a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:12.202777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a8c36-1cd2-4d77-82df-774f744cc0a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:12.203089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a8c36-1cd2-4d77-82df-774f744cc0a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:12.204537 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a8c36-1cd2-4d77-82df-774f744cc0a5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:12.214444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 320/648] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:12.215659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8c36-1cd2-4d77-82df-774f744cc0a5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:12.242263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 329/649] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:48:11 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/39b77396e6ec432e80f4d06bc09a8605/roles/7667dacf895b4ae09b42a6ce839f2192 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:48:12.242263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b9adf-b73d-4fcb-a2c9-a0e015880286 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:12.266234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:12.349741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8c36-1cd2-4d77-82df-774f744cc0a5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:12.383138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b9adf-b73d-4fcb-a2c9-a0e015880286 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:12.389115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f0e45-2066-47eb-9c61-082ff0fe693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:12.389997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f0e45-2066-47eb-9c61-082ff0fe693c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:12.390419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f0e45-2066-47eb-9c61-082ff0fe693c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:12.390796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f0e45-2066-47eb-9c61-082ff0fe693c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:12.399239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f0e45-2066-47eb-9c61-082ff0fe693c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:12.400923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f0e45-2066-47eb-9c61-082ff0fe693c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-f14f0e45-2066-47eb-9c61-082ff0fe693c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:12.415936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:12.417758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:12.419028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:12.419028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:12.419028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:12.419028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:12.419028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:12.419028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:12.419028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:12.419028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:12.419028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 11:48:12.419028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:12.419647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 321/650] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:12.420495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f0e45-2066-47eb-9c61-082ff0fe693c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:12.437592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316608c-3bf5-44f1-8621-eb84784272fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:12.438520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316608c-3bf5-44f1-8621-eb84784272fb None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:12.438799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316608c-3bf5-44f1-8621-eb84784272fb None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:12.439062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316608c-3bf5-44f1-8621-eb84784272fb None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:12.439717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316608c-3bf5-44f1-8621-eb84784272fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:12.440281 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316608c-3bf5-44f1-8621-eb84784272fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:12.441639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316608c-3bf5-44f1-8621-eb84784272fb None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:12.456722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 330/651] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:12.457670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316608c-3bf5-44f1-8621-eb84784272fb None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:12.540292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:12.550311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:12.557336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f0e45-2066-47eb-9c61-082ff0fe693c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:12.586824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316608c-3bf5-44f1-8621-eb84784272fb None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:12.600710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f652f-9d7c-43bb-b4c5-1f5cb1fb38ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:12.601270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f652f-9d7c-43bb-b4c5-1f5cb1fb38ae None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:12.601552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f652f-9d7c-43bb-b4c5-1f5cb1fb38ae None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:12.601831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f652f-9d7c-43bb-b4c5-1f5cb1fb38ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:12.616076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f652f-9d7c-43bb-b4c5-1f5cb1fb38ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:12.617914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f652f-9d7c-43bb-b4c5-1f5cb1fb38ae None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:12.636240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efb22-a9bf-4fb2-bf2e-b0422f08018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:12.636864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efb22-a9bf-4fb2-bf2e-b0422f08018f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:12.637146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efb22-a9bf-4fb2-bf2e-b0422f08018f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:12.637418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efb22-a9bf-4fb2-bf2e-b0422f08018f None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-3f3f652f-9d7c-43bb-b4c5-1f5cb1fb38ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:12.638035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:12.639163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:12.640494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:12.640494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:12.640494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:12.640698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079efb22-a9bf-4fb2-bf2e-b0422f08018f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:12.640698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079efb22-a9bf-4fb2-bf2e-b0422f08018f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:12.640698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079efb22-a9bf-4fb2-bf2e-b0422f08018f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:12.646245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 322/652] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:12.646245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f652f-9d7c-43bb-b4c5-1f5cb1fb38ae None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:12.665388 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 331/653] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Sep 14 11:48:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:12.666618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efb22-a9bf-4fb2-bf2e-b0422f08018f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:12.780897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f652f-9d7c-43bb-b4c5-1f5cb1fb38ae None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:12.790664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efb22-a9bf-4fb2-bf2e-b0422f08018f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:12.802335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:12.825351 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea43662-777e-4fe1-a960-9d981100af98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:12.826566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43662-777e-4fe1-a960-9d981100af98 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:12.827051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43662-777e-4fe1-a960-9d981100af98 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:12.827530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43662-777e-4fe1-a960-9d981100af98 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:12.829870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7db4d2-51aa-436c-b623-e7235a412154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:12.830540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db4d2-51aa-436c-b623-e7235a412154 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:12.831320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db4d2-51aa-436c-b623-e7235a412154 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:12.831600 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db4d2-51aa-436c-b623-e7235a412154 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:12.832312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7db4d2-51aa-436c-b623-e7235a412154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:12.832624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7db4d2-51aa-436c-b623-e7235a412154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:12.834006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7db4d2-51aa-436c-b623-e7235a412154 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:12.837436 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea43662-777e-4fe1-a960-9d981100af98 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:12.839354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea43662-777e-4fe1-a960-9d981100af98 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:12.850845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 332/654] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:12.850845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7db4d2-51aa-436c-b623-e7235a412154 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-8ea43662-777e-4fe1-a960-9d981100af98 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:12.860532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:12.861475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:12.862453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:12.862453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:12.862453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:12.862453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:12.862453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:12.862453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:12.862453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:12.862453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:12.862453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 11:48:12.862453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:12.868287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 323/655] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:12.868287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea43662-777e-4fe1-a960-9d981100af98 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:12.900832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:12.973122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7db4d2-51aa-436c-b623-e7235a412154 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:12.974248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea43662-777e-4fe1-a960-9d981100af98 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:13.011712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa96c88-9985-4412-bd3b-4cc47c8b2dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:13.012349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa96c88-9985-4412-bd3b-4cc47c8b2dac None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:13.012633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa96c88-9985-4412-bd3b-4cc47c8b2dac None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:13.012911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa96c88-9985-4412-bd3b-4cc47c8b2dac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:13.016980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d90dff-0b78-4239-b338-aa186ca9a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:13.017850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d90dff-0b78-4239-b338-aa186ca9a796 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:13.018392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d90dff-0b78-4239-b338-aa186ca9a796 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:13.018871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d90dff-0b78-4239-b338-aa186ca9a796 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:13.020444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa96c88-9985-4412-bd3b-4cc47c8b2dac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:13.022190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa96c88-9985-4412-bd3b-4cc47c8b2dac None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-7aa96c88-9985-4412-bd3b-4cc47c8b2dac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:13.035388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:13.036390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:13.037339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:13.037339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:13.037339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:13.037339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:13.037339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:13.037339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:13.037339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:13.037339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:13.037339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 11:48:13.037339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:13.042019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 324/656] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:13.043010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa96c88-9985-4412-bd3b-4cc47c8b2dac None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:13.062479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:13.100961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d90dff-0b78-4239-b338-aa186ca9a796 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:13.102677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d90dff-0b78-4239-b338-aa186ca9a796 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:13.146600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:13.173311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa96c88-9985-4412-bd3b-4cc47c8b2dac None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:13.218611 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 333/657] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:48:13.218921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48c6b7-c078-4225-8670-e8ceeb2f7a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:13.219639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48c6b7-c078-4225-8670-e8ceeb2f7a51 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:13.220016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48c6b7-c078-4225-8670-e8ceeb2f7a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:13.220307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d90dff-0b78-4239-b338-aa186ca9a796 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:13.220444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48c6b7-c078-4225-8670-e8ceeb2f7a51 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:13.221277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48c6b7-c078-4225-8670-e8ceeb2f7a51 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:13.221701 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48c6b7-c078-4225-8670-e8ceeb2f7a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:13.223603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48c6b7-c078-4225-8670-e8ceeb2f7a51 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:13.246458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 325/658] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Sep 14 11:48:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:13.247745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48c6b7-c078-4225-8670-e8ceeb2f7a51 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:13.324689 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:13.355722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48c6b7-c078-4225-8670-e8ceeb2f7a51 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:13.370550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d90dff-0b78-4239-b338-aa186ca9a796 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:13.381265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:13.393837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1029335-844e-4caf-81be-765d1232999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:13.399359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029335-844e-4caf-81be-765d1232999c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:13.399359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029335-844e-4caf-81be-765d1232999c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:13.399359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029335-844e-4caf-81be-765d1232999c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:13.407422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1029335-844e-4caf-81be-765d1232999c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:13.409092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1029335-844e-4caf-81be-765d1232999c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:13.418831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dde9b9-c7ea-4f04-bfae-36f435dc8928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:13.420563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dde9b9-c7ea-4f04-bfae-36f435dc8928 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:13.421305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dde9b9-c7ea-4f04-bfae-36f435dc8928 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:13.421740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dde9b9-c7ea-4f04-bfae-36f435dc8928 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:13.422714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dde9b9-c7ea-4f04-bfae-36f435dc8928 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:13.423210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dde9b9-c7ea-4f04-bfae-36f435dc8928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:13.424883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dde9b9-c7ea-4f04-bfae-36f435dc8928 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-c1029335-844e-4caf-81be-765d1232999c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:13.427842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:13.429040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:13.430118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:13.430118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:13.430118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:13.438034 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 326/659] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:13.438034 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1029335-844e-4caf-81be-765d1232999c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:13.456825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 334/660] 10.222.0.77 () {56 vars in 1139 bytes} [Wed Sep 14 11:48:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:13.458091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dde9b9-c7ea-4f04-bfae-36f435dc8928 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:13.555331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1029335-844e-4caf-81be-765d1232999c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:13.590256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dde9b9-c7ea-4f04-bfae-36f435dc8928 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:13.594942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f248e65-d5e5-47e0-8c1c-4a7f6db7a0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:13.595770 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f248e65-d5e5-47e0-8c1c-4a7f6db7a0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:13.596177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f248e65-d5e5-47e0-8c1c-4a7f6db7a0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:13.596543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f248e65-d5e5-47e0-8c1c-4a7f6db7a0f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:13.622940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:13.632589 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf864a-11f4-4664-a020-4b933185e8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:13.633481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf864a-11f4-4664-a020-4b933185e8ec None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:13.633769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf864a-11f4-4664-a020-4b933185e8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:13.639575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf864a-11f4-4664-a020-4b933185e8ec None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:13.639575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf864a-11f4-4664-a020-4b933185e8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:13.639575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf864a-11f4-4664-a020-4b933185e8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:13.639575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf864a-11f4-4664-a020-4b933185e8ec None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:13.647739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:13.648793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 335/661] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:13.649694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf864a-11f4-4664-a020-4b933185e8ec None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:13.675973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f248e65-d5e5-47e0-8c1c-4a7f6db7a0f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:13.677546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f248e65-d5e5-47e0-8c1c-4a7f6db7a0f8 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:13.763732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf864a-11f4-4664-a020-4b933185e8ec None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:13.785871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 327/662] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:48:13.787221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a55d5-c951-4e34-aeec-5476bdf75fff None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:13.787511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a55d5-c951-4e34-aeec-5476bdf75fff None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:13.787788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a55d5-c951-4e34-aeec-5476bdf75fff None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:13.789175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 328/663] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:13.789753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a55d5-c951-4e34-aeec-5476bdf75fff None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:13.801178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e6765-663b-4d6b-8358-877fa240c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:13.802138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6765-663b-4d6b-8358-877fa240c487 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:13.802546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6765-663b-4d6b-8358-877fa240c487 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:13.802833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6765-663b-4d6b-8358-877fa240c487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:13.862969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:13.877676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e6765-663b-4d6b-8358-877fa240c487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:13.878543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:13.879087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e6765-663b-4d6b-8358-877fa240c487 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:13.907499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a55d5-c951-4e34-aeec-5476bdf75fff None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:13.961285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e8c4-9af3-424e-abf3-705edf88ee19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:13.962269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e8c4-9af3-424e-abf3-705edf88ee19 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:13.962671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e8c4-9af3-424e-abf3-705edf88ee19 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:13.963126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e8c4-9af3-424e-abf3-705edf88ee19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:13.973715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e8c4-9af3-424e-abf3-705edf88ee19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:13.976235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e8c4-9af3-424e-abf3-705edf88ee19 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-9e48e8c4-9af3-424e-abf3-705edf88ee19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:13.996016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:13.996948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:13.997849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:13.997849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:13.997849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:13.997849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:13.997849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:13.997849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:13.997849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:13.997849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:13.997849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 329/664] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:13.998800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e8c4-9af3-424e-abf3-705edf88ee19 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:14.031162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 336/665] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:48:14.031162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a02827-606b-4120-87aa-80ec41603f58 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.031162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a02827-606b-4120-87aa-80ec41603f58 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.031162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a02827-606b-4120-87aa-80ec41603f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.047823 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b9a02827-606b-4120-87aa-80ec41603f58 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:14.049433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b9a02827-606b-4120-87aa-80ec41603f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:14.110002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e8c4-9af3-424e-abf3-705edf88ee19 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:14.129583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 337/666] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:14.130792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a02827-606b-4120-87aa-80ec41603f58 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:14.153517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34900978-1026-4e2a-ab03-eb6a61154c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:14.154154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34900978-1026-4e2a-ab03-eb6a61154c52 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.154460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34900978-1026-4e2a-ab03-eb6a61154c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.154731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34900978-1026-4e2a-ab03-eb6a61154c52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.157128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:14.158508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:14.166500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34900978-1026-4e2a-ab03-eb6a61154c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:14.168051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34900978-1026-4e2a-ab03-eb6a61154c52 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-34900978-1026-4e2a-ab03-eb6a61154c52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:14.183188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:14.184441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:14.185814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:14.185814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:14.185814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:14.185814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 330/667] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:14.185814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34900978-1026-4e2a-ab03-eb6a61154c52 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:14.279077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a02827-606b-4120-87aa-80ec41603f58 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:14.292830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34900978-1026-4e2a-ab03-eb6a61154c52 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:14.328809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f8ede-1bd2-4e12-a438-037fd489f78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:14.329419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f8ede-1bd2-4e12-a438-037fd489f78a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.329694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f8ede-1bd2-4e12-a438-037fd489f78a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.329965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f8ede-1bd2-4e12-a438-037fd489f78a None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.330699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f8ede-1bd2-4e12-a438-037fd489f78a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:14.331009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f8ede-1bd2-4e12-a438-037fd489f78a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:14.332487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f8ede-1bd2-4e12-a438-037fd489f78a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:14.335607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb7378-83aa-4afa-8bfa-991fc4989cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:14.336458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb7378-83aa-4afa-8bfa-991fc4989cbf None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.336947 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb7378-83aa-4afa-8bfa-991fc4989cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.337424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb7378-83aa-4afa-8bfa-991fc4989cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.345432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 338/668] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:14.346405 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f8ede-1bd2-4e12-a438-037fd489f78a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:14.352263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb7378-83aa-4afa-8bfa-991fc4989cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:14.354061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb7378-83aa-4afa-8bfa-991fc4989cbf None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-ccfb7378-83aa-4afa-8bfa-991fc4989cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:14.372703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:14.373717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:14.374638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:14.374638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:14.374638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:14.381536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 331/669] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:14.383001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb7378-83aa-4afa-8bfa-991fc4989cbf None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:14.429132 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:14.432100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:14.456500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f8ede-1bd2-4e12-a438-037fd489f78a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:14.490696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb7378-83aa-4afa-8bfa-991fc4989cbf None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:14.494270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e4269-9c6a-4da1-8d2b-7e321ce3756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:14.495458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e4269-9c6a-4da1-8d2b-7e321ce3756b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.495695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e4269-9c6a-4da1-8d2b-7e321ce3756b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.495972 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e4269-9c6a-4da1-8d2b-7e321ce3756b None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.496612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e4269-9c6a-4da1-8d2b-7e321ce3756b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:14.496914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e4269-9c6a-4da1-8d2b-7e321ce3756b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:14.498326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e4269-9c6a-4da1-8d2b-7e321ce3756b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:14.510069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 339/670] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:14.511468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e4269-9c6a-4da1-8d2b-7e321ce3756b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:14.525815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e597d0f-f9e8-4911-b526-dd5d17de675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:14.526486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e597d0f-f9e8-4911-b526-dd5d17de675f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.526773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e597d0f-f9e8-4911-b526-dd5d17de675f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.527049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e597d0f-f9e8-4911-b526-dd5d17de675f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.527771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e597d0f-f9e8-4911-b526-dd5d17de675f None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=47bdd5f0b3bc4c099c0d34b3b7c3f3b9) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:14.528085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e597d0f-f9e8-4911-b526-dd5d17de675f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:14.529521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e597d0f-f9e8-4911-b526-dd5d17de675f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:14.535135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 332/671] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:14 2022] GET /identity/v3/role_assignments?user.id=47bdd5f0b3bc4c099c0d34b3b7c3f3b9&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:14.535919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e597d0f-f9e8-4911-b526-dd5d17de675f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:14.639354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e4269-9c6a-4da1-8d2b-7e321ce3756b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:14.656840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e597d0f-f9e8-4911-b526-dd5d17de675f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:14.659929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:14.679273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3040a-49f9-438c-80c3-cde49a1601ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:14.679893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3040a-49f9-438c-80c3-cde49a1601ec None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.680271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3040a-49f9-438c-80c3-cde49a1601ec None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.680426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3040a-49f9-438c-80c3-cde49a1601ec None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.681074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3040a-49f9-438c-80c3-cde49a1601ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:14.681376 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3040a-49f9-438c-80c3-cde49a1601ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:14.683387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3040a-49f9-438c-80c3-cde49a1601ec None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:14.686144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:14.696180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 340/672] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:14.697471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f3a1-edc7-43f0-888d-89f2bcd55438 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.697754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f3a1-edc7-43f0-888d-89f2bcd55438 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.698669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f3a1-edc7-43f0-888d-89f2bcd55438 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.702250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 341/673] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:14.702250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1f3a1-edc7-43f0-888d-89f2bcd55438 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:14.705273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a739a62-6b9f-4a4f-9190-baed76a38c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:14.705961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a739a62-6b9f-4a4f-9190-baed76a38c58 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.706241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a739a62-6b9f-4a4f-9190-baed76a38c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.706517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a739a62-6b9f-4a4f-9190-baed76a38c58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.717915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a739a62-6b9f-4a4f-9190-baed76a38c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-4a739a62-6b9f-4a4f-9190-baed76a38c58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:14.722939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:14.723963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 333/674] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:14.725366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a739a62-6b9f-4a4f-9190-baed76a38c58 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:14.829187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1f3a1-edc7-43f0-888d-89f2bcd55438 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:14.840677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a739a62-6b9f-4a4f-9190-baed76a38c58 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:14.866697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0764d-f04c-4aa1-9e06-e2f39a87bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:14.867601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0764d-f04c-4aa1-9e06-e2f39a87bda1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.868027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0764d-f04c-4aa1-9e06-e2f39a87bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.868561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0764d-f04c-4aa1-9e06-e2f39a87bda1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.874356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed95d8-b92a-4ba4-806d-849eaa5ab429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:14.874983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed95d8-b92a-4ba4-806d-849eaa5ab429 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.875262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed95d8-b92a-4ba4-806d-849eaa5ab429 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.875532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed95d8-b92a-4ba4-806d-849eaa5ab429 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.877104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0764d-f04c-4aa1-9e06-e2f39a87bda1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:14.878918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0764d-f04c-4aa1-9e06-e2f39a87bda1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:14.882398 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed95d8-b92a-4ba4-806d-849eaa5ab429 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:14.883825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed95d8-b92a-4ba4-806d-849eaa5ab429 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-75a0764d-f04c-4aa1-9e06-e2f39a87bda1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:14.892870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:14.894195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:14.895583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:14.895583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:14.895583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:14.895583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:14.895583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:14.895583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:14.895583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:14.895583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-51ed95d8-b92a-4ba4-806d-849eaa5ab429 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:14.896275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:14.897462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:14.898372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:14.898372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:14.898372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:14.898372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:14.898372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:14.898372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:14.898372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:14.898372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:14.898814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 342/675] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:14.898814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189d071-669b-404f-b101-cb5eefa17dba None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:14.898814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189d071-669b-404f-b101-cb5eefa17dba None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:14.898814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189d071-669b-404f-b101-cb5eefa17dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:14.905648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 334/676] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:14.905648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed95d8-b92a-4ba4-806d-849eaa5ab429 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:14.923032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c189d071-669b-404f-b101-cb5eefa17dba None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:14.924757 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c189d071-669b-404f-b101-cb5eefa17dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:14.931000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:14.978875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:14.997875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 343/677] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:14.998574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189d071-669b-404f-b101-cb5eefa17dba None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:15.014341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed95d8-b92a-4ba4-806d-849eaa5ab429 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:15.062887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa48ce4-74da-49d7-a08e-2f85dda60027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:15.064012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa48ce4-74da-49d7-a08e-2f85dda60027 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:15.064777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa48ce4-74da-49d7-a08e-2f85dda60027 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:15.065769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa48ce4-74da-49d7-a08e-2f85dda60027 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:15.066849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa48ce4-74da-49d7-a08e-2f85dda60027 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:15.067357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa48ce4-74da-49d7-a08e-2f85dda60027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:15.069497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa48ce4-74da-49d7-a08e-2f85dda60027 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:15.081089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 335/678] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:15.082578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa48ce4-74da-49d7-a08e-2f85dda60027 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:15.118513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189d071-669b-404f-b101-cb5eefa17dba None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:15.157429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d2470-ed68-447a-9e38-fe606580a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:15.158158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d2470-ed68-447a-9e38-fe606580a4bf None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:15.158570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d2470-ed68-447a-9e38-fe606580a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:15.158909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d2470-ed68-447a-9e38-fe606580a4bf None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:15.160594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d2470-ed68-447a-9e38-fe606580a4bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:15.160708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d2470-ed68-447a-9e38-fe606580a4bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:15.162851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d2470-ed68-447a-9e38-fe606580a4bf None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:15.180538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 344/679] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:15.181599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d2470-ed68-447a-9e38-fe606580a4bf None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:15.201552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:15.222616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa48ce4-74da-49d7-a08e-2f85dda60027 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:15.232240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:15.268612 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052ea82-0be7-4afd-81f9-0ea0d4d3cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:15.270008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ea82-0be7-4afd-81f9-0ea0d4d3cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:15.270506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ea82-0be7-4afd-81f9-0ea0d4d3cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:15.271398 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ea82-0be7-4afd-81f9-0ea0d4d3cdc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:15.272578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052ea82-0be7-4afd-81f9-0ea0d4d3cdc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:15.273064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052ea82-0be7-4afd-81f9-0ea0d4d3cdc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:15.275537 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052ea82-0be7-4afd-81f9-0ea0d4d3cdc9 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:15.293811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 336/680] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:15.293811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052ea82-0be7-4afd-81f9-0ea0d4d3cdc9 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:15.301105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d2470-ed68-447a-9e38-fe606580a4bf None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:15.337969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe9f9e-7d5b-4713-b91b-f4e4e48ee7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:15.339337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe9f9e-7d5b-4713-b91b-f4e4e48ee7db None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:15.339663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe9f9e-7d5b-4713-b91b-f4e4e48ee7db None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:15.339943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe9f9e-7d5b-4713-b91b-f4e4e48ee7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:15.350787 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe9f9e-7d5b-4713-b91b-f4e4e48ee7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:15.352229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe9f9e-7d5b-4713-b91b-f4e4e48ee7db None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-77fe9f9e-7d5b-4713-b91b-f4e4e48ee7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:15.368564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:15.369531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:15.370809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:15.370809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:15.370809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:15.370809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 345/681] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:15.370809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe9f9e-7d5b-4713-b91b-f4e4e48ee7db None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:15.410908 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052ea82-0be7-4afd-81f9-0ea0d4d3cdc9 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:15.445191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35ed8d-dfb5-4e43-9c6c-37bdf39b6150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:15.445790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35ed8d-dfb5-4e43-9c6c-37bdf39b6150 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:15.446065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35ed8d-dfb5-4e43-9c6c-37bdf39b6150 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:15.446371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35ed8d-dfb5-4e43-9c6c-37bdf39b6150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:15.447084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35ed8d-dfb5-4e43-9c6c-37bdf39b6150 None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=c610ab76127b40429d8e9259446df49a) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:15.447387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35ed8d-dfb5-4e43-9c6c-37bdf39b6150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:15.448839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35ed8d-dfb5-4e43-9c6c-37bdf39b6150 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:15.454814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 337/682] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:15 2022] GET /identity/v3/role_assignments?user.id=c610ab76127b40429d8e9259446df49a&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:15.467366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35ed8d-dfb5-4e43-9c6c-37bdf39b6150 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:15.481302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:15.488215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:15.488431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe9f9e-7d5b-4713-b91b-f4e4e48ee7db None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:15.537921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842f86d-6479-4b19-be4d-3675ff894875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:15.538604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842f86d-6479-4b19-be4d-3675ff894875 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:15.538886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842f86d-6479-4b19-be4d-3675ff894875 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:15.539622 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842f86d-6479-4b19-be4d-3675ff894875 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:15.553743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842f86d-6479-4b19-be4d-3675ff894875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-e842f86d-6479-4b19-be4d-3675ff894875 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:15.563857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:15.564850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:15.565973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:15.574297 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 346/683] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:15.575608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842f86d-6479-4b19-be4d-3675ff894875 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:15.608673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35ed8d-dfb5-4e43-9c6c-37bdf39b6150 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:15.646553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecfdef-84de-40d7-a9bb-edde54ad757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:15.647167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecfdef-84de-40d7-a9bb-edde54ad757c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:15.647447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecfdef-84de-40d7-a9bb-edde54ad757c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:15.647719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecfdef-84de-40d7-a9bb-edde54ad757c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:15.648455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecfdef-84de-40d7-a9bb-edde54ad757c None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=67880641bc954088bef0b601a8410f9a) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:15.648783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecfdef-84de-40d7-a9bb-edde54ad757c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:15.650197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecfdef-84de-40d7-a9bb-edde54ad757c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:15.658684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 338/684] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:15 2022] GET /identity/v3/role_assignments?user.id=67880641bc954088bef0b601a8410f9a&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:15.659669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecfdef-84de-40d7-a9bb-edde54ad757c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:15.702924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842f86d-6479-4b19-be4d-3675ff894875 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:15.748946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00ec9c-422d-4a80-94a3-55bc30736b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:15.750134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00ec9c-422d-4a80-94a3-55bc30736b9b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:15.750602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00ec9c-422d-4a80-94a3-55bc30736b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:15.751056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00ec9c-422d-4a80-94a3-55bc30736b9b None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:15.751885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00ec9c-422d-4a80-94a3-55bc30736b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:15.752349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00ec9c-422d-4a80-94a3-55bc30736b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:15.754126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00ec9c-422d-4a80-94a3-55bc30736b9b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:15.770526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 347/685] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:15.772417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:15.779457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00ec9c-422d-4a80-94a3-55bc30736b9b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:15.806412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:15.809518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecfdef-84de-40d7-a9bb-edde54ad757c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:15.850072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2ef8-8c48-4760-9f0e-e3e012b51385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:15.850740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2ef8-8c48-4760-9f0e-e3e012b51385 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:15.851003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2ef8-8c48-4760-9f0e-e3e012b51385 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:15.851275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2ef8-8c48-4760-9f0e-e3e012b51385 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:15.852054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f2ef8-8c48-4760-9f0e-e3e012b51385 None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:15.852360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f2ef8-8c48-4760-9f0e-e3e012b51385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:15.853774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f2ef8-8c48-4760-9f0e-e3e012b51385 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:15.866513 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 339/686] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:15.871924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2ef8-8c48-4760-9f0e-e3e012b51385 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:15.927074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00ec9c-422d-4a80-94a3-55bc30736b9b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:15.972525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28872d-41d4-4422-af40-b8f89bf05e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:15.973088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28872d-41d4-4422-af40-b8f89bf05e45 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:15.973371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28872d-41d4-4422-af40-b8f89bf05e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:15.973644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28872d-41d4-4422-af40-b8f89bf05e45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:15.987922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28872d-41d4-4422-af40-b8f89bf05e45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:15.990491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28872d-41d4-4422-af40-b8f89bf05e45 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-0e28872d-41d4-4422-af40-b8f89bf05e45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:16.005291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:16.006319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:16.007263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:16.007263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:16.007263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:16.007263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:16.007263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:16.007263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:16.007263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:16.007263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:16.007263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:48:16.007263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:16.009371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 348/687] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Sep 14 11:48:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:16.014598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28872d-41d4-4422-af40-b8f89bf05e45 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:16.029197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2ef8-8c48-4760-9f0e-e3e012b51385 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:16.067418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ead7-61a2-4d77-a1bb-2fff6911713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:16.068072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ead7-61a2-4d77-a1bb-2fff6911713c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:16.068350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ead7-61a2-4d77-a1bb-2fff6911713c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:16.068634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ead7-61a2-4d77-a1bb-2fff6911713c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:16.071900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:16.081440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816ead7-61a2-4d77-a1bb-2fff6911713c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:16.082997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816ead7-61a2-4d77-a1bb-2fff6911713c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-7816ead7-61a2-4d77-a1bb-2fff6911713c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:16.098703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:16.099682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:16.100726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:16.100726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:16.100726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:16.100726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 340/688] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:16.105795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ead7-61a2-4d77-a1bb-2fff6911713c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:16.112759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:16.147529 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28872d-41d4-4422-af40-b8f89bf05e45 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:16.222986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855d751-0f6f-4b0b-a14c-6a75bbd676de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:16.223514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855d751-0f6f-4b0b-a14c-6a75bbd676de None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:16.223793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855d751-0f6f-4b0b-a14c-6a75bbd676de None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:16.227018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855d751-0f6f-4b0b-a14c-6a75bbd676de None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:16.227841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855d751-0f6f-4b0b-a14c-6a75bbd676de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:16.228183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855d751-0f6f-4b0b-a14c-6a75bbd676de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:16.230079 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855d751-0f6f-4b0b-a14c-6a75bbd676de None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:16.267587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 349/689] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Sep 14 11:48:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:16.275325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855d751-0f6f-4b0b-a14c-6a75bbd676de None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:16.281589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ead7-61a2-4d77-a1bb-2fff6911713c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:16.324037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4ae24-0e4d-4d5e-ba26-c1bb5bc3e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:16.324669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4ae24-0e4d-4d5e-ba26-c1bb5bc3e922 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:16.324949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4ae24-0e4d-4d5e-ba26-c1bb5bc3e922 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:16.325220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4ae24-0e4d-4d5e-ba26-c1bb5bc3e922 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:16.325870 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4ae24-0e4d-4d5e-ba26-c1bb5bc3e922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:16.326175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4ae24-0e4d-4d5e-ba26-c1bb5bc3e922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:16.327586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4ae24-0e4d-4d5e-ba26-c1bb5bc3e922 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:16.357673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 341/690] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:16.365730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4ae24-0e4d-4d5e-ba26-c1bb5bc3e922 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:16.459850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:16.491924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855d751-0f6f-4b0b-a14c-6a75bbd676de None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:16.546972 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef2720-e425-45ed-879e-187373ca980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:16.547657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef2720-e425-45ed-879e-187373ca980c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:16.547932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef2720-e425-45ed-879e-187373ca980c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:16.548196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef2720-e425-45ed-879e-187373ca980c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:16.554668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:16.582161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4ae24-0e4d-4d5e-ba26-c1bb5bc3e922 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:16.649112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665003a8-506a-4ff4-9365-909814eb054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:16.649747 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665003a8-506a-4ff4-9365-909814eb054d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:16.650067 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665003a8-506a-4ff4-9365-909814eb054d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:16.650363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665003a8-506a-4ff4-9365-909814eb054d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:16.670694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665003a8-506a-4ff4-9365-909814eb054d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:16.675368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665003a8-506a-4ff4-9365-909814eb054d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:16.687826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef2720-e425-45ed-879e-187373ca980c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:16.689277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef2720-e425-45ed-879e-187373ca980c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-665003a8-506a-4ff4-9365-909814eb054d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:16.698915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:16.700238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:16.701995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 342/691] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:16.709752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665003a8-506a-4ff4-9365-909814eb054d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:16.833723 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 350/692] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:48:16.840423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef2720-e425-45ed-879e-187373ca980c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:16.890165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665003a8-506a-4ff4-9365-909814eb054d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:16.903319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:16.925662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:16.937202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18415a49-1259-4fa7-a02e-9aeadad0d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:16.938100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18415a49-1259-4fa7-a02e-9aeadad0d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:16.938586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18415a49-1259-4fa7-a02e-9aeadad0d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:16.939034 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18415a49-1259-4fa7-a02e-9aeadad0d7a0 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:16.940200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18415a49-1259-4fa7-a02e-9aeadad0d7a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:16.940704 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18415a49-1259-4fa7-a02e-9aeadad0d7a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:16.946399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18415a49-1259-4fa7-a02e-9aeadad0d7a0 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:16.979688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 343/693] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Sep 14 11:48:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:16.980996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeef5d-e138-4ba5-87ea-e60bed2bf607 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:16.981278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeef5d-e138-4ba5-87ea-e60bed2bf607 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:16.981551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeef5d-e138-4ba5-87ea-e60bed2bf607 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:16.983103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 344/694] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:16.988306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7495707-0c6b-498b-9422-7470f5298b5f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:16.988902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7495707-0c6b-498b-9422-7470f5298b5f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:16.989248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7495707-0c6b-498b-9422-7470f5298b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:16.996005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef2720-e425-45ed-879e-187373ca980c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:17.020362 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-e7495707-0c6b-498b-9422-7470f5298b5f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:17.021586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e7495707-0c6b-498b-9422-7470f5298b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:17.036954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d79a1-4f88-45f1-a6b0-7e5f2ea1ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:17.037839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d79a1-4f88-45f1-a6b0-7e5f2ea1ac3b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:17.038186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d79a1-4f88-45f1-a6b0-7e5f2ea1ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:17.038857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d79a1-4f88-45f1-a6b0-7e5f2ea1ac3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:17.051498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d79a1-4f88-45f1-a6b0-7e5f2ea1ac3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:17.053225 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d79a1-4f88-45f1-a6b0-7e5f2ea1ac3b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-549d79a1-4f88-45f1-a6b0-7e5f2ea1ac3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:17.076870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:17.077920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:17.078886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:17.078886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:17.078886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:17.078886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 351/695] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:17.079621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d79a1-4f88-45f1-a6b0-7e5f2ea1ac3b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:17.099995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 345/696] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:17.101055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7495707-0c6b-498b-9422-7470f5298b5f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:17.229138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:17.254233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d79a1-4f88-45f1-a6b0-7e5f2ea1ac3b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:17.285438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:17.296985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7495707-0c6b-498b-9422-7470f5298b5f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:17.306630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453813a1-b995-43df-9fb5-bd88f5cd149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:17.307869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453813a1-b995-43df-9fb5-bd88f5cd149f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:17.308202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453813a1-b995-43df-9fb5-bd88f5cd149f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:17.308484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453813a1-b995-43df-9fb5-bd88f5cd149f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:17.367708 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec792024-e891-42b9-be08-7d561604bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:17.368248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec792024-e891-42b9-be08-7d561604bdcd None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:17.370440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec792024-e891-42b9-be08-7d561604bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:17.370732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec792024-e891-42b9-be08-7d561604bdcd None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:17.371399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec792024-e891-42b9-be08-7d561604bdcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:17.371708 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec792024-e891-42b9-be08-7d561604bdcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:17.373089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec792024-e891-42b9-be08-7d561604bdcd None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:17.399341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 346/697] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:17.400855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec792024-e891-42b9-be08-7d561604bdcd None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:17.422290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453813a1-b995-43df-9fb5-bd88f5cd149f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:17.424151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453813a1-b995-43df-9fb5-bd88f5cd149f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:17.516751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec792024-e891-42b9-be08-7d561604bdcd None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:17.533170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:17.550303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 352/698] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 11:48:17.551963 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453813a1-b995-43df-9fb5-bd88f5cd149f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:17.559866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6a902-d0b6-4021-bdb8-4f6a74a269ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:17.560521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6a902-d0b6-4021-bdb8-4f6a74a269ed None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:17.560805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6a902-d0b6-4021-bdb8-4f6a74a269ed None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:17.561077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6a902-d0b6-4021-bdb8-4f6a74a269ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:17.576579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6a902-d0b6-4021-bdb8-4f6a74a269ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:17.578587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6a902-d0b6-4021-bdb8-4f6a74a269ed None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-8de6a902-d0b6-4021-bdb8-4f6a74a269ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:17.598587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:17.599626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:17.600545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:17.600545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:17.600545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:17.600545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 347/699] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:17.606631 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6a902-d0b6-4021-bdb8-4f6a74a269ed None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:17.614720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:17.687059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453813a1-b995-43df-9fb5-bd88f5cd149f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:17.729878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a64e-722f-4a76-9028-8f98ce1e78e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:17.730703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a64e-722f-4a76-9028-8f98ce1e78e5 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:17.731084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a64e-722f-4a76-9028-8f98ce1e78e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:17.731466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a64e-722f-4a76-9028-8f98ce1e78e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:17.739866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6a64e-722f-4a76-9028-8f98ce1e78e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:17.740343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6a902-d0b6-4021-bdb8-4f6a74a269ed None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:17.741551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6a64e-722f-4a76-9028-8f98ce1e78e5 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-14e6a64e-722f-4a76-9028-8f98ce1e78e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:17.756850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:17.757838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:17.759071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:17.759071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:17.759071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:17.759071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:17.759071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:17.759071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:17.759071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:17.759071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:17.759071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 353/700] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:17.761062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a64e-722f-4a76-9028-8f98ce1e78e5 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:17.788367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808f431-ba6d-49cb-9d65-ebaac983b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:17.791477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808f431-ba6d-49cb-9d65-ebaac983b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:17.791477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808f431-ba6d-49cb-9d65-ebaac983b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:17.791477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808f431-ba6d-49cb-9d65-ebaac983b0a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:17.807866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808f431-ba6d-49cb-9d65-ebaac983b0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:17.810263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808f431-ba6d-49cb-9d65-ebaac983b0a7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:17.826385 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-7808f431-ba6d-49cb-9d65-ebaac983b0a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:17.830419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:17.831430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:17.832312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:17.832312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:17.832312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:17.834732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 348/701] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:17.835749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808f431-ba6d-49cb-9d65-ebaac983b0a7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:17.894888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a64e-722f-4a76-9028-8f98ce1e78e5 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:17.943423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2af1cd-bbd2-41f0-ba81-dc2133c3da5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:17.944194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2af1cd-bbd2-41f0-ba81-dc2133c3da5b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:17.944572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2af1cd-bbd2-41f0-ba81-dc2133c3da5b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:17.944981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2af1cd-bbd2-41f0-ba81-dc2133c3da5b None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:17.945816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2af1cd-bbd2-41f0-ba81-dc2133c3da5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:17.946230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2af1cd-bbd2-41f0-ba81-dc2133c3da5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:17.948232 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2af1cd-bbd2-41f0-ba81-dc2133c3da5b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:17.968104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 354/702] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:17.969215 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2af1cd-bbd2-41f0-ba81-dc2133c3da5b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:18.028623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:18.078248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808f431-ba6d-49cb-9d65-ebaac983b0a7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:18.114001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2af1cd-bbd2-41f0-ba81-dc2133c3da5b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:18.116157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb76b50-47d7-40ca-a386-fa2c65087543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:18.117012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76b50-47d7-40ca-a386-fa2c65087543 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.117518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76b50-47d7-40ca-a386-fa2c65087543 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.118001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb76b50-47d7-40ca-a386-fa2c65087543 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.118978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb76b50-47d7-40ca-a386-fa2c65087543 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:18.119516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb76b50-47d7-40ca-a386-fa2c65087543 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:18.121269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb76b50-47d7-40ca-a386-fa2c65087543 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:18.126110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:18.136216 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 349/703] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:18.137543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb76b50-47d7-40ca-a386-fa2c65087543 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:18.160148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878c294-19e9-4c67-9fb0-b8d19718e5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:18.161214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c294-19e9-4c67-9fb0-b8d19718e5ce None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.161711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c294-19e9-4c67-9fb0-b8d19718e5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.162322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c294-19e9-4c67-9fb0-b8d19718e5ce None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.163181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878c294-19e9-4c67-9fb0-b8d19718e5ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:18.163695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878c294-19e9-4c67-9fb0-b8d19718e5ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:18.165335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878c294-19e9-4c67-9fb0-b8d19718e5ce None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:18.179165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 355/704] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:18.180436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878c294-19e9-4c67-9fb0-b8d19718e5ce None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:18.258230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb76b50-47d7-40ca-a386-fa2c65087543 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:18.279098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:18.288940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878c294-19e9-4c67-9fb0-b8d19718e5ce None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:18.292658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d030667-68c3-4164-aaa2-90ba1e21b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:18.293251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030667-68c3-4164-aaa2-90ba1e21b83a None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.293527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030667-68c3-4164-aaa2-90ba1e21b83a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.293796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030667-68c3-4164-aaa2-90ba1e21b83a None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.294472 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d030667-68c3-4164-aaa2-90ba1e21b83a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:18.295943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d030667-68c3-4164-aaa2-90ba1e21b83a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:18.323358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d0e8c-e597-40d9-be4b-e96182c521f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:18.323954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d0e8c-e597-40d9-be4b-e96182c521f3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.324228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d0e8c-e597-40d9-be4b-e96182c521f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.324491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d0e8c-e597-40d9-be4b-e96182c521f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.325197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d0e8c-e597-40d9-be4b-e96182c521f3 None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=8882a9f2764648be9bfe4606144660d1) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:18.325511 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d0e8c-e597-40d9-be4b-e96182c521f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:18.326938 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d0e8c-e597-40d9-be4b-e96182c521f3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:18.332108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 356/705] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:18 2022] GET /identity/v3/role_assignments?user.id=8882a9f2764648be9bfe4606144660d1&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:18.333231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c641a5c-6844-424c-808e-b4a04901cf06 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.333507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c641a5c-6844-424c-808e-b4a04901cf06 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.333773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c641a5c-6844-424c-808e-b4a04901cf06 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.334990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 357/706] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:18.335693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c641a5c-6844-424c-808e-b4a04901cf06 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:18.369223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:18.413315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 350/707] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:48:18 2022] POST /identity/v3/users => generated 254 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:48:18.414478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814187f6-7696-4fec-8f60-c5d12d312e0b None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.414763 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814187f6-7696-4fec-8f60-c5d12d312e0b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.415032 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814187f6-7696-4fec-8f60-c5d12d312e0b None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.420903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 351/708] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:18.420903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999c8e2-71d9-4c16-a440-5f7c09d1caf5 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.420903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999c8e2-71d9-4c16-a440-5f7c09d1caf5 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.420903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999c8e2-71d9-4c16-a440-5f7c09d1caf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.444578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-9999c8e2-71d9-4c16-a440-5f7c09d1caf5 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:18.445888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9999c8e2-71d9-4c16-a440-5f7c09d1caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:18.470292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c641a5c-6844-424c-808e-b4a04901cf06 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:18.521868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a39af-b2f6-4b7d-a3e1-8eb3a70c2fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:18.522597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a39af-b2f6-4b7d-a3e1-8eb3a70c2fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.522876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a39af-b2f6-4b7d-a3e1-8eb3a70c2fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.523143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a39af-b2f6-4b7d-a3e1-8eb3a70c2fa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.532448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a39af-b2f6-4b7d-a3e1-8eb3a70c2fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:18.533998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a39af-b2f6-4b7d-a3e1-8eb3a70c2fa3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:18.539997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 352/709] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:18.541842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a19eb-6956-486c-8139-b2f11540ccac None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.542735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a19eb-6956-486c-8139-b2f11540ccac None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.543308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a19eb-6956-486c-8139-b2f11540ccac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-748a39af-b2f6-4b7d-a3e1-8eb3a70c2fa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:18.548525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:18.549616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:18.550750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:18.550750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:18.550750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:18.550750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:18.550750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:18.550750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:18.550750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:18.550750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:18.552048 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 358/710] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:18.558836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a39af-b2f6-4b7d-a3e1-8eb3a70c2fa3 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:18.577419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-519a19eb-6956-486c-8139-b2f11540ccac None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:18.578652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-519a19eb-6956-486c-8139-b2f11540ccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:18.673960 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 353/711] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:18.702257 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:18.711442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a39af-b2f6-4b7d-a3e1-8eb3a70c2fa3 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:18.747573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294094e-703c-4036-8090-d782b4119b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:18.748180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294094e-703c-4036-8090-d782b4119b22 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.748456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294094e-703c-4036-8090-d782b4119b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.748727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294094e-703c-4036-8090-d782b4119b22 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.749419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294094e-703c-4036-8090-d782b4119b22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:18.749722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294094e-703c-4036-8090-d782b4119b22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:18.751169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294094e-703c-4036-8090-d782b4119b22 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:18.764610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 359/712] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:18.770392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a19eb-6956-486c-8139-b2f11540ccac None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:18.808544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:18.858057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294094e-703c-4036-8090-d782b4119b22 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:18.879438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a19eb-6956-486c-8139-b2f11540ccac None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:18.924567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2bf68-fd7a-4a49-8ee1-b6f60a60f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:18.925113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bf68-fd7a-4a49-8ee1-b6f60a60f10a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:18.925400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bf68-fd7a-4a49-8ee1-b6f60a60f10a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:18.925672 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bf68-fd7a-4a49-8ee1-b6f60a60f10a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:18.926440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2bf68-fd7a-4a49-8ee1-b6f60a60f10a None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=39b77396e6ec432e80f4d06bc09a8605) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:18.926751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2bf68-fd7a-4a49-8ee1-b6f60a60f10a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:18.928757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2bf68-fd7a-4a49-8ee1-b6f60a60f10a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:18.938503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 354/713] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:18 2022] GET /identity/v3/role_assignments?user.id=39b77396e6ec432e80f4d06bc09a8605&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:18.995339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2bf68-fd7a-4a49-8ee1-b6f60a60f10a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:19.006358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294094e-703c-4036-8090-d782b4119b22 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:19.093957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc58dcc-fa74-4cb6-af51-f70fc6c00efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:19.094667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc58dcc-fa74-4cb6-af51-f70fc6c00efd None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:19.094951 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc58dcc-fa74-4cb6-af51-f70fc6c00efd None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:19.095227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc58dcc-fa74-4cb6-af51-f70fc6c00efd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:19.099649 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc58dcc-fa74-4cb6-af51-f70fc6c00efd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:19.101061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc58dcc-fa74-4cb6-af51-f70fc6c00efd None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-7fc58dcc-fa74-4cb6-af51-f70fc6c00efd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:19.122433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:19.123616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:19.125124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 360/714] 10.222.0.77 () {56 vars in 1129 bytes} [Wed Sep 14 11:48:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:19.129862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc58dcc-fa74-4cb6-af51-f70fc6c00efd None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:19.155503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:19.185906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2bf68-fd7a-4a49-8ee1-b6f60a60f10a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:19.198826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:19.231342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dca64-6d03-4d26-9735-72dcd4b5affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:19.231994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dca64-6d03-4d26-9735-72dcd4b5affd None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:19.232270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dca64-6d03-4d26-9735-72dcd4b5affd None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:19.232869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dca64-6d03-4d26-9735-72dcd4b5affd None admin] PATH_INFO: `/v3/services/network` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:19.233812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dca64-6d03-4d26-9735-72dcd4b5affd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:19.235514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dca64-6d03-4d26-9735-72dcd4b5affd None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-e48dca64-6d03-4d26-9735-72dcd4b5affd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:19.251347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:19.252370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:19.253653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 355/715] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:18 2022] GET /identity/v3/services/network => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:19.260706 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dca64-6d03-4d26-9735-72dcd4b5affd None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:19.262382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc58dcc-fa74-4cb6-af51-f70fc6c00efd None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:19.328885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cffdb-092c-4fb7-b7a6-c08254043c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:19.329506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cffdb-092c-4fb7-b7a6-c08254043c52 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:19.329782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cffdb-092c-4fb7-b7a6-c08254043c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:19.330050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cffdb-092c-4fb7-b7a6-c08254043c52 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:19.330714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cffdb-092c-4fb7-b7a6-c08254043c52 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:19.331016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cffdb-092c-4fb7-b7a6-c08254043c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:19.332392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cffdb-092c-4fb7-b7a6-c08254043c52 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:19.337847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 361/716] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Sep 14 11:48:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:19.343892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cffdb-092c-4fb7-b7a6-c08254043c52 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:19.390618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dca64-6d03-4d26-9735-72dcd4b5affd None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:19.430964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adc3a5-1541-4cf4-9b93-dbe2e7808cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:19.431917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc3a5-1541-4cf4-9b93-dbe2e7808cdf None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:19.432574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc3a5-1541-4cf4-9b93-dbe2e7808cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:19.433059 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc3a5-1541-4cf4-9b93-dbe2e7808cdf None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:19.433932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:19.434553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adc3a5-1541-4cf4-9b93-dbe2e7808cdf None admin] RBAC: Adding query filter params (name=network) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:19.435790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adc3a5-1541-4cf4-9b93-dbe2e7808cdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:19.437410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adc3a5-1541-4cf4-9b93-dbe2e7808cdf None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:19.442885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 356/717] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:19.451214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adc3a5-1541-4cf4-9b93-dbe2e7808cdf None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:19.453929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cffdb-092c-4fb7-b7a6-c08254043c52 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:19.492689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:19.515776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d2199-a48b-4677-a0d7-d19fc8b4f1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:19.516401 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2199-a48b-4677-a0d7-d19fc8b4f1ce None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:19.516728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2199-a48b-4677-a0d7-d19fc8b4f1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:19.517006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d2199-a48b-4677-a0d7-d19fc8b4f1ce None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:19.517650 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2199-a48b-4677-a0d7-d19fc8b4f1ce None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:19.517954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2199-a48b-4677-a0d7-d19fc8b4f1ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:19.519390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d2199-a48b-4677-a0d7-d19fc8b4f1ce None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:19.529171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 362/718] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Sep 14 11:48:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:19.630248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adc3a5-1541-4cf4-9b93-dbe2e7808cdf None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:19.688983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aa2d8-9925-483a-b937-c8fa7e46b181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:19.689529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aa2d8-9925-483a-b937-c8fa7e46b181 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:19.689808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aa2d8-9925-483a-b937-c8fa7e46b181 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:19.690374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aa2d8-9925-483a-b937-c8fa7e46b181 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:19.691024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aa2d8-9925-483a-b937-c8fa7e46b181 None admin] RBAC: Adding query filter params (type=network) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:19.691326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aa2d8-9925-483a-b937-c8fa7e46b181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:19.692719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aa2d8-9925-483a-b937-c8fa7e46b181 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:19.704021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 357/719] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:20.935905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990045-5837-4d37-aa18-dc8629a52eb2 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:20.936929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990045-5837-4d37-aa18-dc8629a52eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:20.937455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8990045-5837-4d37-aa18-dc8629a52eb2 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:20.939229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 363/720] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:20.945018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5276faf-128c-4df8-969e-f49cb01435d6 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:20.945810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5276faf-128c-4df8-969e-f49cb01435d6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:20.946305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5276faf-128c-4df8-969e-f49cb01435d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:20.965414 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-f5276faf-128c-4df8-969e-f49cb01435d6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:20.966904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f5276faf-128c-4df8-969e-f49cb01435d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:21.037237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 358/721] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:21.296568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ef852-e8f0-4fdf-83fe-8a319cae05e2 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:21.296755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ef852-e8f0-4fdf-83fe-8a319cae05e2 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:21.297046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ef852-e8f0-4fdf-83fe-8a319cae05e2 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:21.298724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 364/722] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:21.304202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222cd4a-e339-4de1-ba92-5336ac08efb2 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:21.304496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222cd4a-e339-4de1-ba92-5336ac08efb2 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:21.304772 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222cd4a-e339-4de1-ba92-5336ac08efb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:21.331330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c222cd4a-e339-4de1-ba92-5336ac08efb2 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:21.332861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c222cd4a-e339-4de1-ba92-5336ac08efb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:21.350683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:21.365626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ef852-e8f0-4fdf-83fe-8a319cae05e2 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:21.406856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 359/723] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:21.497956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ef852-e8f0-4fdf-83fe-8a319cae05e2 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:21.534185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c5afc-2fe7-4996-a186-817656a97fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:21.535174 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5afc-2fe7-4996-a186-817656a97fbf None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:21.535646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5afc-2fe7-4996-a186-817656a97fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:21.536131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5afc-2fe7-4996-a186-817656a97fbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:21.547024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c5afc-2fe7-4996-a186-817656a97fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-df0c5afc-2fe7-4996-a186-817656a97fbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:21.552615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:21.553517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:21.554368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:21.557504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 365/724] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:21.563566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222cd4a-e339-4de1-ba92-5336ac08efb2 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:21.692999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222cd4a-e339-4de1-ba92-5336ac08efb2 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:21.728322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70e68-d7c5-4a14-8ccf-c87080859f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:21.728973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70e68-d7c5-4a14-8ccf-c87080859f96 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:21.729403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70e68-d7c5-4a14-8ccf-c87080859f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:21.729678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70e68-d7c5-4a14-8ccf-c87080859f96 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:21.730355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70e68-d7c5-4a14-8ccf-c87080859f96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:21.730656 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70e68-d7c5-4a14-8ccf-c87080859f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:21.732017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f70e68-d7c5-4a14-8ccf-c87080859f96 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:21.740502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 360/725] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:21.745754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c5afc-2fe7-4996-a186-817656a97fbf None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:21.749697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:21.794977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70e68-d7c5-4a14-8ccf-c87080859f96 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:21.817735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:21.984526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c5afc-2fe7-4996-a186-817656a97fbf None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:22.020945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70e68-d7c5-4a14-8ccf-c87080859f96 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:22.023124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f649dc-40a9-4493-abf6-6fa8a00b7889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:22.023777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f649dc-40a9-4493-abf6-6fa8a00b7889 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.024061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f649dc-40a9-4493-abf6-6fa8a00b7889 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.024336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f649dc-40a9-4493-abf6-6fa8a00b7889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.035808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f649dc-40a9-4493-abf6-6fa8a00b7889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:22.037646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f649dc-40a9-4493-abf6-6fa8a00b7889 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-90f649dc-40a9-4493-abf6-6fa8a00b7889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:22.053524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:22.054581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:22.055460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:22.055460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:22.055460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:22.055460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 366/726] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:22.056586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6501c-52b8-42b2-908f-a472a77fd61a None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.056691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6501c-52b8-42b2-908f-a472a77fd61a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.058278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6501c-52b8-42b2-908f-a472a77fd61a None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.059663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 367/727] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:22.060937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6501c-52b8-42b2-908f-a472a77fd61a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:22.068239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cd038-c424-46fa-ab0e-bb0c971fe6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:22.068810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cd038-c424-46fa-ab0e-bb0c971fe6cf None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.069083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cd038-c424-46fa-ab0e-bb0c971fe6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.069350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cd038-c424-46fa-ab0e-bb0c971fe6cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.084976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cd038-c424-46fa-ab0e-bb0c971fe6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-cb3cd038-c424-46fa-ab0e-bb0c971fe6cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:22.090734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:22.091640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:22.092507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:22.095128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 361/728] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:22.096577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f17a2-fb7c-4a75-9136-2862be105fd9 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.097085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f17a2-fb7c-4a75-9136-2862be105fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.097560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f17a2-fb7c-4a75-9136-2862be105fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.123224 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c27f17a2-fb7c-4a75-9136-2862be105fd9 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:22.124676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c27f17a2-fb7c-4a75-9136-2862be105fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:22.132236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:22.181599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6501c-52b8-42b2-908f-a472a77fd61a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:22.217864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 362/729] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:22.219608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f17a2-fb7c-4a75-9136-2862be105fd9 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:22.228158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb681-cf76-4c48-b1e4-2a955da85c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:22.229945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb681-cf76-4c48-b1e4-2a955da85c0a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.230461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb681-cf76-4c48-b1e4-2a955da85c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.230954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb681-cf76-4c48-b1e4-2a955da85c0a None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.231815 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb681-cf76-4c48-b1e4-2a955da85c0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:22.231922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:22.232464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb681-cf76-4c48-b1e4-2a955da85c0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:22.234054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb681-cf76-4c48-b1e4-2a955da85c0a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:22.247745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 368/730] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:22.258231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb681-cf76-4c48-b1e4-2a955da85c0a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:22.400750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f17a2-fb7c-4a75-9136-2862be105fd9 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:22.442655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e80807-6dc7-420e-a980-5188ba000140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:22.443623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80807-6dc7-420e-a980-5188ba000140 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.444136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80807-6dc7-420e-a980-5188ba000140 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.444563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb681-cf76-4c48-b1e4-2a955da85c0a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:22.444836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80807-6dc7-420e-a980-5188ba000140 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.445718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e80807-6dc7-420e-a980-5188ba000140 None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:22.446337 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e80807-6dc7-420e-a980-5188ba000140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:22.448083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e80807-6dc7-420e-a980-5188ba000140 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:22.457256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 363/731] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:22.458932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f4085-77ec-4f57-85c9-bdb706366515 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.459452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f4085-77ec-4f57-85c9-bdb706366515 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.459948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f4085-77ec-4f57-85c9-bdb706366515 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.461648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 364/732] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:22.463065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f4085-77ec-4f57-85c9-bdb706366515 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:22.469047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:22.489980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cb7bf-4b49-4da0-afe9-89353da33299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:22.490649 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cb7bf-4b49-4da0-afe9-89353da33299 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.490930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cb7bf-4b49-4da0-afe9-89353da33299 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.491203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cb7bf-4b49-4da0-afe9-89353da33299 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.499640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cb7bf-4b49-4da0-afe9-89353da33299 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:22.501073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cb7bf-4b49-4da0-afe9-89353da33299 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-626cb7bf-4b49-4da0-afe9-89353da33299 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:22.512682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:22.513654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:22.514632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 369/733] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Sep 14 11:48:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:22.515727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e0915-47f2-41dc-910b-23998fd00130 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.515727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e0915-47f2-41dc-910b-23998fd00130 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.515727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e0915-47f2-41dc-910b-23998fd00130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.533981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-639e0915-47f2-41dc-910b-23998fd00130 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:22.535272 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-639e0915-47f2-41dc-910b-23998fd00130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:22.543011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:22.577521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f4085-77ec-4f57-85c9-bdb706366515 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:22.602358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 370/734] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:22.603610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59277f50-8ab6-4456-8c63-2b77fa9ca32a None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.604439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59277f50-8ab6-4456-8c63-2b77fa9ca32a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.604700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59277f50-8ab6-4456-8c63-2b77fa9ca32a None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.605922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 371/735] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:22.610686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59277f50-8ab6-4456-8c63-2b77fa9ca32a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:22.622235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c38ab1-2268-4b60-bf82-dec59eb14356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:22.622967 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c38ab1-2268-4b60-bf82-dec59eb14356 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.623253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c38ab1-2268-4b60-bf82-dec59eb14356 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.623529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c38ab1-2268-4b60-bf82-dec59eb14356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.634548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c38ab1-2268-4b60-bf82-dec59eb14356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:22.636571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c38ab1-2268-4b60-bf82-dec59eb14356 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-b2c38ab1-2268-4b60-bf82-dec59eb14356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:22.652569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:22.653505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:22.654453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:22.654453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:22.654453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:22.654453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 365/736] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:22.654453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c38ab1-2268-4b60-bf82-dec59eb14356 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:22.733330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59277f50-8ab6-4456-8c63-2b77fa9ca32a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:22.741865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:22.762049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c38ab1-2268-4b60-bf82-dec59eb14356 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:22.769175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5453bf-f766-4a87-bafc-0820f4e2b2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:22.769784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5453bf-f766-4a87-bafc-0820f4e2b2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.770063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5453bf-f766-4a87-bafc-0820f4e2b2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.770377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5453bf-f766-4a87-bafc-0820f4e2b2e3 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.771105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5453bf-f766-4a87-bafc-0820f4e2b2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:22.771408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5453bf-f766-4a87-bafc-0820f4e2b2e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:22.772836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5453bf-f766-4a87-bafc-0820f4e2b2e3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:22.780452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:22.790344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 372/737] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Sep 14 11:48:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:22.791377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07616146-e534-48ed-8a06-7fc1ab7a1c1e None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.791668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07616146-e534-48ed-8a06-7fc1ab7a1c1e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.791941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07616146-e534-48ed-8a06-7fc1ab7a1c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.801941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb03eb3-3250-4e2b-9b56-c19e8235ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:22.802672 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb03eb3-3250-4e2b-9b56-c19e8235ca73 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.802955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb03eb3-3250-4e2b-9b56-c19e8235ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.803228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb03eb3-3250-4e2b-9b56-c19e8235ca73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.810545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-07616146-e534-48ed-8a06-7fc1ab7a1c1e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:22.811880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-07616146-e534-48ed-8a06-7fc1ab7a1c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:22.815747 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb03eb3-3250-4e2b-9b56-c19e8235ca73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-8fb03eb3-3250-4e2b-9b56-c19e8235ca73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:22.820540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:22.821457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:22.822341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:22.826657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 366/738] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:22.827579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb03eb3-3250-4e2b-9b56-c19e8235ca73 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:22.890166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 373/739] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 11:48:22.891029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07616146-e534-48ed-8a06-7fc1ab7a1c1e None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:22.935813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb03eb3-3250-4e2b-9b56-c19e8235ca73 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:22.973279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3a98a-2f91-4c0f-a85c-c3befcc47e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:22.973881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3a98a-2f91-4c0f-a85c-c3befcc47e83 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:22.974157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3a98a-2f91-4c0f-a85c-c3befcc47e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:22.974460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3a98a-2f91-4c0f-a85c-c3befcc47e83 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:22.975508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3a98a-2f91-4c0f-a85c-c3befcc47e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:22.975810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3a98a-2f91-4c0f-a85c-c3befcc47e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:22.977552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3a98a-2f91-4c0f-a85c-c3befcc47e83 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:22.990962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 367/740] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:22.991765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3a98a-2f91-4c0f-a85c-c3befcc47e83 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:22.996020 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:23.004935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07616146-e534-48ed-8a06-7fc1ab7a1c1e None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:23.039486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:23.046880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7aafe-438d-4b3f-81b8-8970eef4b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:23.047194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7aafe-438d-4b3f-81b8-8970eef4b5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:23.047472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7aafe-438d-4b3f-81b8-8970eef4b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:23.047747 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7aafe-438d-4b3f-81b8-8970eef4b5d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:23.058403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7aafe-438d-4b3f-81b8-8970eef4b5d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:23.059950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7aafe-438d-4b3f-81b8-8970eef4b5d7 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-79e7aafe-438d-4b3f-81b8-8970eef4b5d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:23.075906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:23.076836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:23.077739 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:23.077739 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:23.077739 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:23.077739 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 374/741] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:23.078584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7aafe-438d-4b3f-81b8-8970eef4b5d7 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:23.121862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3a98a-2f91-4c0f-a85c-c3befcc47e83 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:23.156986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb42be6-03a3-4530-a8e7-55205ebc1569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:23.157597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb42be6-03a3-4530-a8e7-55205ebc1569 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:23.157958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb42be6-03a3-4530-a8e7-55205ebc1569 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:23.158249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb42be6-03a3-4530-a8e7-55205ebc1569 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:23.158911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb42be6-03a3-4530-a8e7-55205ebc1569 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:23.159241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb42be6-03a3-4530-a8e7-55205ebc1569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:23.160584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb42be6-03a3-4530-a8e7-55205ebc1569 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:23.169730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 368/742] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:23.170624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb42be6-03a3-4530-a8e7-55205ebc1569 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:23.190359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7aafe-438d-4b3f-81b8-8970eef4b5d7 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:23.229294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fa946-0b20-4cce-8936-7cbc6e56dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:23.229910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fa946-0b20-4cce-8936-7cbc6e56dd5f None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:23.230192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fa946-0b20-4cce-8936-7cbc6e56dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:23.230503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fa946-0b20-4cce-8936-7cbc6e56dd5f None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:23.231156 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fa946-0b20-4cce-8936-7cbc6e56dd5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:23.232538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fa946-0b20-4cce-8936-7cbc6e56dd5f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:23.265734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:23.268681 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb42be6-03a3-4530-a8e7-55205ebc1569 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:23.300633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494330-67c0-4868-b7bd-1d5d3745ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:23.301251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494330-67c0-4868-b7bd-1d5d3745ddcf None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:23.301531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494330-67c0-4868-b7bd-1d5d3745ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:23.301803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494330-67c0-4868-b7bd-1d5d3745ddcf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:23.309207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77494330-67c0-4868-b7bd-1d5d3745ddcf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:23.310661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77494330-67c0-4868-b7bd-1d5d3745ddcf None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-77494330-67c0-4868-b7bd-1d5d3745ddcf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:23.321988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:23.323133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 369/743] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Sep 14 11:48:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:23.324080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494330-67c0-4868-b7bd-1d5d3745ddcf None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:23.351734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 375/744] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:48:23 2022] POST /identity/v3/services => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:48:23.352814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fa946-0b20-4cce-8936-7cbc6e56dd5f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:23.362930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:23.439581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494330-67c0-4868-b7bd-1d5d3745ddcf None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:23.488432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fa946-0b20-4cce-8936-7cbc6e56dd5f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:23.489693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4f926-fb95-468c-a8be-06c535b66d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:23.490531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4f926-fb95-468c-a8be-06c535b66d55 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:23.490815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4f926-fb95-468c-a8be-06c535b66d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:23.491088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4f926-fb95-468c-a8be-06c535b66d55 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:23.492804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4f926-fb95-468c-a8be-06c535b66d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:23.493114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4f926-fb95-468c-a8be-06c535b66d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:23.494874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4f926-fb95-468c-a8be-06c535b66d55 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:23.520168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 370/745] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:23.520168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4f926-fb95-468c-a8be-06c535b66d55 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:23.528092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa50865-03ab-4276-ac28-2f07ab5d45e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:23.528719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa50865-03ab-4276-ac28-2f07ab5d45e1 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:23.529721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa50865-03ab-4276-ac28-2f07ab5d45e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:23.529721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa50865-03ab-4276-ac28-2f07ab5d45e1 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:23.529960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa50865-03ab-4276-ac28-2f07ab5d45e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:23.531333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa50865-03ab-4276-ac28-2f07ab5d45e1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:23.540476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:23.598443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 376/746] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:48:23 2022] POST /identity/v3/services => generated 240 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:48:23.602400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa50865-03ab-4276-ac28-2f07ab5d45e1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:23.639237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4f926-fb95-468c-a8be-06c535b66d55 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:23.686236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:23.687542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c631a-856a-473b-a41e-8fa956bd4f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:23.688333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c631a-856a-473b-a41e-8fa956bd4f95 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:23.688618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c631a-856a-473b-a41e-8fa956bd4f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:23.688891 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c631a-856a-473b-a41e-8fa956bd4f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:23.703336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c631a-856a-473b-a41e-8fa956bd4f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:23.704836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c631a-856a-473b-a41e-8fa956bd4f95 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-768c631a-856a-473b-a41e-8fa956bd4f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:23.728075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:23.729480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:23.730551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:23.730551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:23.730551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:23.730551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 371/747] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:23.730773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c631a-856a-473b-a41e-8fa956bd4f95 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:23.739864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa50865-03ab-4276-ac28-2f07ab5d45e1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:23.781793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8a9ba-94d2-4b8a-ad79-75cdfcf388c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:23.782764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8a9ba-94d2-4b8a-ad79-75cdfcf388c3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:23.783225 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8a9ba-94d2-4b8a-ad79-75cdfcf388c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:23.783726 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8a9ba-94d2-4b8a-ad79-75cdfcf388c3 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:23.784721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8a9ba-94d2-4b8a-ad79-75cdfcf388c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:23.785212 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8a9ba-94d2-4b8a-ad79-75cdfcf388c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:23.787041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8a9ba-94d2-4b8a-ad79-75cdfcf388c3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:23.808824 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:23.810128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 377/748] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Sep 14 11:48:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:23.811177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8a9ba-94d2-4b8a-ad79-75cdfcf388c3 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:23.861358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c631a-856a-473b-a41e-8fa956bd4f95 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:23.899628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad592-5796-4d87-8bf0-b463b4e59c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:23.902105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad592-5796-4d87-8bf0-b463b4e59c26 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:23.902491 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad592-5796-4d87-8bf0-b463b4e59c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:23.902835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad592-5796-4d87-8bf0-b463b4e59c26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:23.911575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ad592-5796-4d87-8bf0-b463b4e59c26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:23.913471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ad592-5796-4d87-8bf0-b463b4e59c26 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-e24ad592-5796-4d87-8bf0-b463b4e59c26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:23.929136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:23.930070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:23.930987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:23.930987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:23.930987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:23.930987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:23.930987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:23.930987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:23.930987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:23.930987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:23.930987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 372/749] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:23.931463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad592-5796-4d87-8bf0-b463b4e59c26 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:23.940912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8a9ba-94d2-4b8a-ad79-75cdfcf388c3 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:23.969433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:23.989184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf1dcb-511d-40b5-8630-db5963f57a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:23.990091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf1dcb-511d-40b5-8630-db5963f57a48 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:23.990585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf1dcb-511d-40b5-8630-db5963f57a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:23.991011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf1dcb-511d-40b5-8630-db5963f57a48 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:23.991849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf1dcb-511d-40b5-8630-db5963f57a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:23.992295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf1dcb-511d-40b5-8630-db5963f57a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:23.994721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf1dcb-511d-40b5-8630-db5963f57a48 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:24.012327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 378/750] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:24.013854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf1dcb-511d-40b5-8630-db5963f57a48 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:24.071873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad592-5796-4d87-8bf0-b463b4e59c26 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:24.101574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:24.113357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59f4e7-b011-48b2-baf8-a0a741c19b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:24.114444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59f4e7-b011-48b2-baf8-a0a741c19b6c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:24.114444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59f4e7-b011-48b2-baf8-a0a741c19b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:24.114851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59f4e7-b011-48b2-baf8-a0a741c19b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:24.161244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf1dcb-511d-40b5-8630-db5963f57a48 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:24.194400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59f4e7-b011-48b2-baf8-a0a741c19b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:24.196178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59f4e7-b011-48b2-baf8-a0a741c19b6c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:24.207586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d42bf-3e9c-4c90-a568-16e030288529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:24.208466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d42bf-3e9c-4c90-a568-16e030288529 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:24.209462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d42bf-3e9c-4c90-a568-16e030288529 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:24.209896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d42bf-3e9c-4c90-a568-16e030288529 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:24.210785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d42bf-3e9c-4c90-a568-16e030288529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:24.211704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d42bf-3e9c-4c90-a568-16e030288529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:24.214602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d42bf-3e9c-4c90-a568-16e030288529 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:24.232882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 379/751] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:24.234695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d42bf-3e9c-4c90-a568-16e030288529 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:24.297855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:24.317147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 373/752] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:48:24.318172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59f4e7-b011-48b2-baf8-a0a741c19b6c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:24.345647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:24.384221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d42bf-3e9c-4c90-a568-16e030288529 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:24.425916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59f4e7-b011-48b2-baf8-a0a741c19b6c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:24.432594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57727-e051-4937-87de-ff2fbf5c3e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:24.433448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57727-e051-4937-87de-ff2fbf5c3e5f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:24.433896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57727-e051-4937-87de-ff2fbf5c3e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:24.434350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e57727-e051-4937-87de-ff2fbf5c3e5f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:24.444992 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e57727-e051-4937-87de-ff2fbf5c3e5f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:24.447309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e57727-e051-4937-87de-ff2fbf5c3e5f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-43e57727-e051-4937-87de-ff2fbf5c3e5f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:24.465290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:24.466475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:24.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:24.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:24.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:24.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:24.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:24.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:24.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:24.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:24.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:24.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:24.469091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e2d0e-aa93-42d4-9a06-95f1dbdfe9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:24.469843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e2d0e-aa93-42d4-9a06-95f1dbdfe9a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:24.470165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 380/753] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:24.471171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57727-e051-4937-87de-ff2fbf5c3e5f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:24.474691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e2d0e-aa93-42d4-9a06-95f1dbdfe9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:24.475805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e2d0e-aa93-42d4-9a06-95f1dbdfe9a5 None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/8882a9f2764648be9bfe4606144660d1/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:24.477403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e2d0e-aa93-42d4-9a06-95f1dbdfe9a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=8882a9f2764648be9bfe4606144660d1, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:24.479824 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e2d0e-aa93-42d4-9a06-95f1dbdfe9a5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:24.558465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 374/754] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:48:24 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/8882a9f2764648be9bfe4606144660d1/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:48:24.561548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e2d0e-aa93-42d4-9a06-95f1dbdfe9a5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:24.622374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:24.627093 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e57727-e051-4937-87de-ff2fbf5c3e5f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:24.719565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705872a-a08a-4af0-b229-4c6ebfb4c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:24.723019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705872a-a08a-4af0-b229-4c6ebfb4c157 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:24.723334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705872a-a08a-4af0-b229-4c6ebfb4c157 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:24.723564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705872a-a08a-4af0-b229-4c6ebfb4c157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:24.750112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705872a-a08a-4af0-b229-4c6ebfb4c157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:24.751566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705872a-a08a-4af0-b229-4c6ebfb4c157 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:24.765083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-f705872a-a08a-4af0-b229-4c6ebfb4c157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:24.779226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:24.780189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:24.781140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:24.781140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:24.781140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:24.783252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 381/755] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:24.787451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e2d0e-aa93-42d4-9a06-95f1dbdfe9a5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:24.788582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705872a-a08a-4af0-b229-4c6ebfb4c157 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:24.834311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b16e-677d-4c14-a564-0fc80536e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:24.834852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b16e-677d-4c14-a564-0fc80536e50a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:24.835130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b16e-677d-4c14-a564-0fc80536e50a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:24.835401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b16e-677d-4c14-a564-0fc80536e50a None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:24.836136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b16e-677d-4c14-a564-0fc80536e50a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:24.836949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b16e-677d-4c14-a564-0fc80536e50a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:24.838927 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b16e-677d-4c14-a564-0fc80536e50a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:24.863499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 375/756] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Sep 14 11:48:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:24.868961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b16e-677d-4c14-a564-0fc80536e50a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:24.910167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705872a-a08a-4af0-b229-4c6ebfb4c157 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:24.946400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51be9ac-8b0e-488a-9f82-ea7a31faaaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:24.947023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be9ac-8b0e-488a-9f82-ea7a31faaaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:24.947826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be9ac-8b0e-488a-9f82-ea7a31faaaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:24.948162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be9ac-8b0e-488a-9f82-ea7a31faaaa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:24.948828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51be9ac-8b0e-488a-9f82-ea7a31faaaa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:24.949123 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51be9ac-8b0e-488a-9f82-ea7a31faaaa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:24.950577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51be9ac-8b0e-488a-9f82-ea7a31faaaa1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:24.963593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 382/757] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:24.968899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51be9ac-8b0e-488a-9f82-ea7a31faaaa1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:24.973983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b16e-677d-4c14-a564-0fc80536e50a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:24.984197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:25.014420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ef9e-1dda-4a64-88b6-5e3beaa9ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:25.014420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ef9e-1dda-4a64-88b6-5e3beaa9ff4d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:25.014420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ef9e-1dda-4a64-88b6-5e3beaa9ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:25.014420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ef9e-1dda-4a64-88b6-5e3beaa9ff4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:25.026603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:25.086985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0ef9e-1dda-4a64-88b6-5e3beaa9ff4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:25.088627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0ef9e-1dda-4a64-88b6-5e3beaa9ff4d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:25.143473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51be9ac-8b0e-488a-9f82-ea7a31faaaa1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:25.193366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 376/758] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 11:48:25.199788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ef9e-1dda-4a64-88b6-5e3beaa9ff4d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:25.210844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873678b-2cfe-46f7-817a-adcdce809c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:25.211498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873678b-2cfe-46f7-817a-adcdce809c5a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:25.211779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873678b-2cfe-46f7-817a-adcdce809c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:25.212055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873678b-2cfe-46f7-817a-adcdce809c5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:25.225291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873678b-2cfe-46f7-817a-adcdce809c5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:25.226791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873678b-2cfe-46f7-817a-adcdce809c5a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:25.246793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-7873678b-2cfe-46f7-817a-adcdce809c5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:25.253749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:25.254662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:25.255535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:25.255535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:25.255535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:25.255535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:25.255535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:25.255535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:25.255535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:25.255535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:25.263354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 383/759] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:25.268901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873678b-2cfe-46f7-817a-adcdce809c5a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:25.306336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ef9e-1dda-4a64-88b6-5e3beaa9ff4d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:25.347811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e209aa-4fc1-4980-b98e-4b8e6758c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:25.348365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e209aa-4fc1-4980-b98e-4b8e6758c620 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:25.348640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e209aa-4fc1-4980-b98e-4b8e6758c620 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:25.348908 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e209aa-4fc1-4980-b98e-4b8e6758c620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:25.364071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e209aa-4fc1-4980-b98e-4b8e6758c620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:25.365535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e209aa-4fc1-4980-b98e-4b8e6758c620 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-68e209aa-4fc1-4980-b98e-4b8e6758c620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:25.380949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:25.381914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:25.382824 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:25.382824 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:25.382824 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:25.386157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 377/760] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:25.388235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e209aa-4fc1-4980-b98e-4b8e6758c620 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:25.434488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:25.477225 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873678b-2cfe-46f7-817a-adcdce809c5a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:25.493117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:25.497632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e209aa-4fc1-4980-b98e-4b8e6758c620 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:25.540939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf36e6-9b10-40a0-9cb8-69c532cf1bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:25.542084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf36e6-9b10-40a0-9cb8-69c532cf1bfb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:25.542562 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf36e6-9b10-40a0-9cb8-69c532cf1bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:25.543415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf36e6-9b10-40a0-9cb8-69c532cf1bfb None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:25.544204 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf36e6-9b10-40a0-9cb8-69c532cf1bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:25.544621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf36e6-9b10-40a0-9cb8-69c532cf1bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:25.546167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf36e6-9b10-40a0-9cb8-69c532cf1bfb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:25.561720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 378/761] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:25.567727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf36e6-9b10-40a0-9cb8-69c532cf1bfb None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:25.631534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a70b13-b3b1-4e26-ab2f-6604d3dcc96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:25.632170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70b13-b3b1-4e26-ab2f-6604d3dcc96c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:25.632448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70b13-b3b1-4e26-ab2f-6604d3dcc96c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:25.632715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70b13-b3b1-4e26-ab2f-6604d3dcc96c None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:25.633411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a70b13-b3b1-4e26-ab2f-6604d3dcc96c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:25.633718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a70b13-b3b1-4e26-ab2f-6604d3dcc96c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:25.635240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a70b13-b3b1-4e26-ab2f-6604d3dcc96c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:25.676519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 384/762] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:25.687230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a70b13-b3b1-4e26-ab2f-6604d3dcc96c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:25.688018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf36e6-9b10-40a0-9cb8-69c532cf1bfb None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:25.731304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef42fec-e14e-49f0-9630-bff15fd89c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:25.732105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef42fec-e14e-49f0-9630-bff15fd89c1d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:25.732835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef42fec-e14e-49f0-9630-bff15fd89c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:25.733215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef42fec-e14e-49f0-9630-bff15fd89c1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:25.743159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef42fec-e14e-49f0-9630-bff15fd89c1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:25.746040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef42fec-e14e-49f0-9630-bff15fd89c1d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-4ef42fec-e14e-49f0-9630-bff15fd89c1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:25.763121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:25.764238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:25.765324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:25.765324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:25.765324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:25.765324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:25.765324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:25.765324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:25.765324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:25.765324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:25.765839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 379/763] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:25.771185 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63b42-1b60-4464-9f10-cfc89fbbd4fc None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:25.771467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63b42-1b60-4464-9f10-cfc89fbbd4fc None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:25.771742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63b42-1b60-4464-9f10-cfc89fbbd4fc None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:25.773111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 380/764] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:25.776455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab63b42-1b60-4464-9f10-cfc89fbbd4fc None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:25.797607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:25.802685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a70b13-b3b1-4e26-ab2f-6604d3dcc96c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:25.834597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:25.840481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54da5f1-bc28-4884-821a-63e7a871c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:25.841177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54da5f1-bc28-4884-821a-63e7a871c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:25.841415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54da5f1-bc28-4884-821a-63e7a871c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:25.841709 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54da5f1-bc28-4884-821a-63e7a871c1b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:25.842506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54da5f1-bc28-4884-821a-63e7a871c1b7 None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=5e2c84402fe040048c9f238ded4f549d) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:25.842819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54da5f1-bc28-4884-821a-63e7a871c1b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:25.844407 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54da5f1-bc28-4884-821a-63e7a871c1b7 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:25.851830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 385/765] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:25 2022] GET /identity/v3/role_assignments?user.id=5e2c84402fe040048c9f238ded4f549d&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:25.853125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658e06-0fb4-45d5-b626-01104857fb46 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:25.853418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658e06-0fb4-45d5-b626-01104857fb46 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:25.854364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2658e06-0fb4-45d5-b626-01104857fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:25.874690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b2658e06-0fb4-45d5-b626-01104857fb46 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:25.875875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b2658e06-0fb4-45d5-b626-01104857fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:25.897736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab63b42-1b60-4464-9f10-cfc89fbbd4fc None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:25.937126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd2c05-7756-439a-b198-1174d2e950f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:25.937912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd2c05-7756-439a-b198-1174d2e950f5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:25.938339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd2c05-7756-439a-b198-1174d2e950f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:25.938719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd2c05-7756-439a-b198-1174d2e950f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:25.939622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd2c05-7756-439a-b198-1174d2e950f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:25.940311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd2c05-7756-439a-b198-1174d2e950f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:25.941839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd2c05-7756-439a-b198-1174d2e950f5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:25.950818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 386/766] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:25.962368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 381/767] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:25.969151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2658e06-0fb4-45d5-b626-01104857fb46 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:26.095982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2658e06-0fb4-45d5-b626-01104857fb46 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:26.124038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:26.132750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07f080-6522-490b-9562-0946eaae4197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:26.133349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f080-6522-490b-9562-0946eaae4197 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:26.133630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f080-6522-490b-9562-0946eaae4197 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:26.133902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f080-6522-490b-9562-0946eaae4197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:26.134663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07f080-6522-490b-9562-0946eaae4197 None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=39b77396e6ec432e80f4d06bc09a8605) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:26.135565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07f080-6522-490b-9562-0946eaae4197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:26.137084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07f080-6522-490b-9562-0946eaae4197 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:26.143139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 387/768] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:25 2022] GET /identity/v3/role_assignments?user.id=39b77396e6ec432e80f4d06bc09a8605&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:26.263966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd2c05-7756-439a-b198-1174d2e950f5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:26.311980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5318a-6ae3-428a-9c17-d5b7f799bf0f None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:26.312527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5318a-6ae3-428a-9c17-d5b7f799bf0f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:26.312607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5318a-6ae3-428a-9c17-d5b7f799bf0f None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:26.314192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 388/769] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:26.320071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435cbe-b5cb-4d60-9b48-a6b7f65529bc None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:26.320365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435cbe-b5cb-4d60-9b48-a6b7f65529bc None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:26.320633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435cbe-b5cb-4d60-9b48-a6b7f65529bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:26.340740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-73435cbe-b5cb-4d60-9b48-a6b7f65529bc None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:26.342082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-73435cbe-b5cb-4d60-9b48-a6b7f65529bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:26.390626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:26.437096 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd2c05-7756-439a-b198-1174d2e950f5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:26.452486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 389/770] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:48:26.473217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728032a-c2d6-4b40-ad35-707bb4d5d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:26.473854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728032a-c2d6-4b40-ad35-707bb4d5d81c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:26.474133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728032a-c2d6-4b40-ad35-707bb4d5d81c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:26.474443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728032a-c2d6-4b40-ad35-707bb4d5d81c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:26.475038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728032a-c2d6-4b40-ad35-707bb4d5d81c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:26.476408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728032a-c2d6-4b40-ad35-707bb4d5d81c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-5728032a-c2d6-4b40-ad35-707bb4d5d81c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:26.485691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:26.486715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:26.487544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 382/771] 10.222.0.77 () {56 vars in 1129 bytes} [Wed Sep 14 11:48:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:26.496229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435cbe-b5cb-4d60-9b48-a6b7f65529bc None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:26.632217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435cbe-b5cb-4d60-9b48-a6b7f65529bc None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:26.654541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:26.672317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e11c3-169f-4447-bb54-e0095a14c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:26.672945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e11c3-169f-4447-bb54-e0095a14c7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:26.673225 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e11c3-169f-4447-bb54-e0095a14c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:26.673527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e11c3-169f-4447-bb54-e0095a14c7f6 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:26.674134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e11c3-169f-4447-bb54-e0095a14c7f6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:26.674459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e11c3-169f-4447-bb54-e0095a14c7f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:26.682657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e11c3-169f-4447-bb54-e0095a14c7f6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:26.686044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 390/772] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Sep 14 11:48:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:26.687544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728032a-c2d6-4b40-ad35-707bb4d5d81c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:26.762985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e11c3-169f-4447-bb54-e0095a14c7f6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:26.822933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728032a-c2d6-4b40-ad35-707bb4d5d81c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:26.881070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202eb1-344a-4145-930e-22c6afef7ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:26.883245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202eb1-344a-4145-930e-22c6afef7ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:26.883960 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202eb1-344a-4145-930e-22c6afef7ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:26.887227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202eb1-344a-4145-930e-22c6afef7ff7 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:26.888212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202eb1-344a-4145-930e-22c6afef7ff7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:26.888738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202eb1-344a-4145-930e-22c6afef7ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:26.890388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202eb1-344a-4145-930e-22c6afef7ff7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:26.900214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 383/773] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Sep 14 11:48:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:26.907177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202eb1-344a-4145-930e-22c6afef7ff7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:26.914536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:26.961073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e11c3-169f-4447-bb54-e0095a14c7f6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:27.014374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa809f-f21e-4a99-bb21-90bf822d87c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:27.015011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa809f-f21e-4a99-bb21-90bf822d87c0 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:27.015287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa809f-f21e-4a99-bb21-90bf822d87c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:27.015557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa809f-f21e-4a99-bb21-90bf822d87c0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:27.016140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa809f-f21e-4a99-bb21-90bf822d87c0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:27.017505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa809f-f21e-4a99-bb21-90bf822d87c0 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-29aa809f-f21e-4a99-bb21-90bf822d87c0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:27.028164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:27.029166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:27.030486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 391/774] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:26 2022] GET /identity/v3/services/network => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:27.035288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa809f-f21e-4a99-bb21-90bf822d87c0 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:27.094876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:27.099342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202eb1-344a-4145-930e-22c6afef7ff7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:27.152249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa809f-f21e-4a99-bb21-90bf822d87c0 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:27.168207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44680721-4b77-412f-9f21-fcdf50d076b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:27.168740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44680721-4b77-412f-9f21-fcdf50d076b4 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:27.169025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44680721-4b77-412f-9f21-fcdf50d076b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:27.169305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44680721-4b77-412f-9f21-fcdf50d076b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:27.170018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44680721-4b77-412f-9f21-fcdf50d076b4 None admin] RBAC: Adding query filter params (interface=public, service_id=9e317260c3b34f6d9341c58be7d654ae, region_id=RegionOne) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:27.170365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44680721-4b77-412f-9f21-fcdf50d076b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:27.171727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44680721-4b77-412f-9f21-fcdf50d076b4 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:27.188720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 384/775] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Sep 14 11:48:26 2022] GET /identity/v3/endpoints?service_id=9e317260c3b34f6d9341c58be7d654ae&interface=public®ion_id=RegionOne => generated 194 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:27.191836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fc9b4-a594-4804-8104-784501a99be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:27.192750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fc9b4-a594-4804-8104-784501a99be9 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:27.193250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fc9b4-a594-4804-8104-784501a99be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:27.193719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fc9b4-a594-4804-8104-784501a99be9 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:27.194593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fc9b4-a594-4804-8104-784501a99be9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:27.194889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44680721-4b77-412f-9f21-fcdf50d076b4 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:27.195309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fc9b4-a594-4804-8104-784501a99be9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:27.197000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fc9b4-a594-4804-8104-784501a99be9 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:27.202631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 392/776] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:27.208194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fc9b4-a594-4804-8104-784501a99be9 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:27.294597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:27.317272 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fc9b4-a594-4804-8104-784501a99be9 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:27.328355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44680721-4b77-412f-9f21-fcdf50d076b4 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:27.332233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:27.356730 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811abfa-74a4-46d5-954f-d981a3960aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:27.357427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811abfa-74a4-46d5-954f-d981a3960aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:27.357711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811abfa-74a4-46d5-954f-d981a3960aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:27.357984 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811abfa-74a4-46d5-954f-d981a3960aa4 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:27.358658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811abfa-74a4-46d5-954f-d981a3960aa4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:27.358961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811abfa-74a4-46d5-954f-d981a3960aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:27.360461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811abfa-74a4-46d5-954f-d981a3960aa4 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:27.372750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 393/777] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:27.372750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b04cf-3c91-4cf0-ab84-439f62b30f9e None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:27.372750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b04cf-3c91-4cf0-ab84-439f62b30f9e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:27.372750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b04cf-3c91-4cf0-ab84-439f62b30f9e None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:27.372750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 394/778] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:27.374992 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b04cf-3c91-4cf0-ab84-439f62b30f9e None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:27.376030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c0b15-42b5-4471-9263-adcc5317831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:27.376924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c0b15-42b5-4471-9263-adcc5317831d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:27.377360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c0b15-42b5-4471-9263-adcc5317831d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:27.377783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c0b15-42b5-4471-9263-adcc5317831d None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:27.378910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c0b15-42b5-4471-9263-adcc5317831d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:27.381442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c0b15-42b5-4471-9263-adcc5317831d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:27.389175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 385/779] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Sep 14 11:48:27 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:27.390634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5cac5-f2f4-473c-bbac-70d2e9c373e7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:27.391083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5cac5-f2f4-473c-bbac-70d2e9c373e7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:27.391538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5cac5-f2f4-473c-bbac-70d2e9c373e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:27.433758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-88c5cac5-f2f4-473c-bbac-70d2e9c373e7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:27.436568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-88c5cac5-f2f4-473c-bbac-70d2e9c373e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:27.573161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b04cf-3c91-4cf0-ab84-439f62b30f9e None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:27.607313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 386/780] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:27.635654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eda91c-ff07-4910-abc4-a1f8472a0814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:27.636530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eda91c-ff07-4910-abc4-a1f8472a0814 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:27.636911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eda91c-ff07-4910-abc4-a1f8472a0814 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:27.637339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eda91c-ff07-4910-abc4-a1f8472a0814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:27.638169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eda91c-ff07-4910-abc4-a1f8472a0814 None admin] RBAC: Adding query filter params (interface=public, service_id=6555374283714e4baabc477b4e30a41f, region_id=RegionOne) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:27.638676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eda91c-ff07-4910-abc4-a1f8472a0814 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:27.640128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eda91c-ff07-4910-abc4-a1f8472a0814 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:27.648165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 395/781] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Sep 14 11:48:27 2022] GET /identity/v3/endpoints?service_id=6555374283714e4baabc477b4e30a41f&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:27.654460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5cac5-f2f4-473c-bbac-70d2e9c373e7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:27.719929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:27.766909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5cac5-f2f4-473c-bbac-70d2e9c373e7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:27.804793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bdcf8-a5a6-48de-9dd8-eec7fc328196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:27.805411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bdcf8-a5a6-48de-9dd8-eec7fc328196 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:27.805709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bdcf8-a5a6-48de-9dd8-eec7fc328196 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:27.805988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bdcf8-a5a6-48de-9dd8-eec7fc328196 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:27.806691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bdcf8-a5a6-48de-9dd8-eec7fc328196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:27.808605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bdcf8-a5a6-48de-9dd8-eec7fc328196 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:27.814597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 387/782] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Sep 14 11:48:27 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:27.952314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eda91c-ff07-4910-abc4-a1f8472a0814 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:28.014869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:28.086060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eda91c-ff07-4910-abc4-a1f8472a0814 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:28.120913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06da737-1bd0-43ea-9f46-3afd25e74b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:28.121554 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06da737-1bd0-43ea-9f46-3afd25e74b88 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:28.121836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06da737-1bd0-43ea-9f46-3afd25e74b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:28.122108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06da737-1bd0-43ea-9f46-3afd25e74b88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:28.132681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06da737-1bd0-43ea-9f46-3afd25e74b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-a06da737-1bd0-43ea-9f46-3afd25e74b88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:28.138916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:28.139847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:28.140682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 396/783] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:28.146445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bdcf8-a5a6-48de-9dd8-eec7fc328196 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:28.254899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bdcf8-a5a6-48de-9dd8-eec7fc328196 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:28.287355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:28.303174 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6595c4-9538-4187-b813-353eba89e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:28.306132 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6595c4-9538-4187-b813-353eba89e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:28.306132 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6595c4-9538-4187-b813-353eba89e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:28.306132 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6595c4-9538-4187-b813-353eba89e1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:28.306132 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6595c4-9538-4187-b813-353eba89e1a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:28.306132 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6595c4-9538-4187-b813-353eba89e1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:28.307667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6595c4-9538-4187-b813-353eba89e1a0 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:28.318668 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 388/784] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:28.325328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06da737-1bd0-43ea-9f46-3afd25e74b88 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:28.433366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676742e-d786-47ba-8f8c-2f467ea91f25 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:28.433695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676742e-d786-47ba-8f8c-2f467ea91f25 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:28.433916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676742e-d786-47ba-8f8c-2f467ea91f25 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:28.435551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 389/785] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:28.441262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bb8ba-5b82-460b-8dac-a0922e85d669 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:28.441536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bb8ba-5b82-460b-8dac-a0922e85d669 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:28.441817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bb8ba-5b82-460b-8dac-a0922e85d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:28.449525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:28.452431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06da737-1bd0-43ea-9f46-3afd25e74b88 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:28.466444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-079bb8ba-5b82-460b-8dac-a0922e85d669 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:28.467674 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-079bb8ba-5b82-460b-8dac-a0922e85d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:28.522817 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f666bd-6dda-4212-b462-eac83400a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:28.523463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f666bd-6dda-4212-b462-eac83400a069 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:28.523740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f666bd-6dda-4212-b462-eac83400a069 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:28.524012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f666bd-6dda-4212-b462-eac83400a069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:28.547146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f666bd-6dda-4212-b462-eac83400a069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:28.548653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f666bd-6dda-4212-b462-eac83400a069 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:28.622366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 390/786] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-64f666bd-6dda-4212-b462-eac83400a069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:28.733278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:28.734487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:28.735676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:28.735676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:28.735676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:28.735676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 397/787] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:28.740368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bb8ba-5b82-460b-8dac-a0922e85d669 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:28.846981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bb8ba-5b82-460b-8dac-a0922e85d669 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:28.874629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:28.902071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618725ca-35f7-43c1-81f3-61a97d060c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:28.902822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618725ca-35f7-43c1-81f3-61a97d060c8a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:28.903111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618725ca-35f7-43c1-81f3-61a97d060c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:28.903385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618725ca-35f7-43c1-81f3-61a97d060c8a None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:28.904042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618725ca-35f7-43c1-81f3-61a97d060c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:28.904347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618725ca-35f7-43c1-81f3-61a97d060c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:28.905719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618725ca-35f7-43c1-81f3-61a97d060c8a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:28.920858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 391/788] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:28.926487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f666bd-6dda-4212-b462-eac83400a069 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:29.042711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f666bd-6dda-4212-b462-eac83400a069 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:29.049807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c795-d23c-4048-abac-78adcea77e55 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:29.050095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c795-d23c-4048-abac-78adcea77e55 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:29.050411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c795-d23c-4048-abac-78adcea77e55 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:29.052127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 392/789] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:29.062291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7e2f9-fc6c-48f1-add8-cd8b9cccd820 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:29.062571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7e2f9-fc6c-48f1-add8-cd8b9cccd820 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:29.062849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7e2f9-fc6c-48f1-add8-cd8b9cccd820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:29.079567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70785f7f-c429-4af5-ae21-091d12381ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:29.080553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785f7f-c429-4af5-ae21-091d12381ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:29.081028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785f7f-c429-4af5-ae21-091d12381ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:29.081509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785f7f-c429-4af5-ae21-091d12381ac6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:29.089653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70785f7f-c429-4af5-ae21-091d12381ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:29.091409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70785f7f-c429-4af5-ae21-091d12381ac6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:29.099291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b7f7e2f9-fc6c-48f1-add8-cd8b9cccd820 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:29.100461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b7f7e2f9-fc6c-48f1-add8-cd8b9cccd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-70785f7f-c429-4af5-ae21-091d12381ac6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:29.107044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:29.108002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:29.108934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:29.108934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:29.108934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:29.108934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:29.108934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:29.108934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:29.108934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:29.108934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:29.108934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:48:29.108934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:29.111507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 398/790] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Sep 14 11:48:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:29.119951 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70785f7f-c429-4af5-ae21-091d12381ac6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:29.140701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:29.210038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 393/791] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:29.211436 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7e2f9-fc6c-48f1-add8-cd8b9cccd820 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:29.240094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70785f7f-c429-4af5-ae21-091d12381ac6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:29.299482 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67e536-e180-4371-a748-45b37f66e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:29.300089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e536-e180-4371-a748-45b37f66e0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:29.300364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e536-e180-4371-a748-45b37f66e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:29.300632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e536-e180-4371-a748-45b37f66e0c1 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:29.301360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67e536-e180-4371-a748-45b37f66e0c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:29.301715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67e536-e180-4371-a748-45b37f66e0c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:29.303663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67e536-e180-4371-a748-45b37f66e0c1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:29.338310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7e2f9-fc6c-48f1-add8-cd8b9cccd820 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:29.338959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 399/792] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Sep 14 11:48:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:29.346122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67e536-e180-4371-a748-45b37f66e0c1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:29.354504 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:29.387986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb41ba2-e477-4a86-b453-1bfd0b1c23ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:29.388992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb41ba2-e477-4a86-b453-1bfd0b1c23ef None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:29.389484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb41ba2-e477-4a86-b453-1bfd0b1c23ef None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:29.389981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb41ba2-e477-4a86-b453-1bfd0b1c23ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:29.403601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb41ba2-e477-4a86-b453-1bfd0b1c23ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-eeb41ba2-e477-4a86-b453-1bfd0b1c23ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:29.409610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:29.410567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:29.411439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:29.418493 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 394/793] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:29.420896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb41ba2-e477-4a86-b453-1bfd0b1c23ef None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:29.518845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:29.549445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb41ba2-e477-4a86-b453-1bfd0b1c23ef None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:29.593607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74638105-c29f-420c-853d-48478c0cda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:29.594766 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638105-c29f-420c-853d-48478c0cda19 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:29.595587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638105-c29f-420c-853d-48478c0cda19 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:29.596308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638105-c29f-420c-853d-48478c0cda19 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:29.597713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74638105-c29f-420c-853d-48478c0cda19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:29.598203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67e536-e180-4371-a748-45b37f66e0c1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:29.598607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74638105-c29f-420c-853d-48478c0cda19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:29.600503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74638105-c29f-420c-853d-48478c0cda19 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:29.611511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 395/794] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:29.624705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74638105-c29f-420c-853d-48478c0cda19 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:29.668546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b19279-cd3e-4a7e-a992-6dc2817f2b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:29.669171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b19279-cd3e-4a7e-a992-6dc2817f2b1c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:29.669448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b19279-cd3e-4a7e-a992-6dc2817f2b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:29.669717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b19279-cd3e-4a7e-a992-6dc2817f2b1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:29.680320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:29.753946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b19279-cd3e-4a7e-a992-6dc2817f2b1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:29.755444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b19279-cd3e-4a7e-a992-6dc2817f2b1c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:29.761358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74638105-c29f-420c-853d-48478c0cda19 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:29.797550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148219e-79dd-4f2a-9cae-f3ddf0277780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:29.798556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148219e-79dd-4f2a-9cae-f3ddf0277780 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:29.799052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148219e-79dd-4f2a-9cae-f3ddf0277780 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:29.799531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148219e-79dd-4f2a-9cae-f3ddf0277780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:29.811209 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148219e-79dd-4f2a-9cae-f3ddf0277780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:29.812987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148219e-79dd-4f2a-9cae-f3ddf0277780 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:29.828597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-0148219e-79dd-4f2a-9cae-f3ddf0277780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:29.830115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:29.831075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:29.831973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:29.831973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:29.831973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:29.834921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 396/795] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:29.835938 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148219e-79dd-4f2a-9cae-f3ddf0277780 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:29.869746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 400/796] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:48:29.870698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b19279-cd3e-4a7e-a992-6dc2817f2b1c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:29.924303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:29.945484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148219e-79dd-4f2a-9cae-f3ddf0277780 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:29.982185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b19279-cd3e-4a7e-a992-6dc2817f2b1c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:29.986756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67296d5-e167-4cfc-ba8e-68cbe26a18aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:29.987754 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67296d5-e167-4cfc-ba8e-68cbe26a18aa None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:29.988246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67296d5-e167-4cfc-ba8e-68cbe26a18aa None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:29.988769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67296d5-e167-4cfc-ba8e-68cbe26a18aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.001199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67296d5-e167-4cfc-ba8e-68cbe26a18aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-f67296d5-e167-4cfc-ba8e-68cbe26a18aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:30.006448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:30.007381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:30.008239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:30.011542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 397/797] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:30.017202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67296d5-e167-4cfc-ba8e-68cbe26a18aa None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.021098 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d939b0-413d-4557-bebe-05f3fd983d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:30.021773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d939b0-413d-4557-bebe-05f3fd983d99 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.022114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d939b0-413d-4557-bebe-05f3fd983d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.022472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d939b0-413d-4557-bebe-05f3fd983d99 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.023566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d939b0-413d-4557-bebe-05f3fd983d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:30.023566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d939b0-413d-4557-bebe-05f3fd983d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:30.024921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d939b0-413d-4557-bebe-05f3fd983d99 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:30.044296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 401/798] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:30.045457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d939b0-413d-4557-bebe-05f3fd983d99 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.079312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:30.131737 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67296d5-e167-4cfc-ba8e-68cbe26a18aa None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:30.153481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d939b0-413d-4557-bebe-05f3fd983d99 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:30.173405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f21cf-fd2b-408a-be86-ec65d5399531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:30.174571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f21cf-fd2b-408a-be86-ec65d5399531 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.174848 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f21cf-fd2b-408a-be86-ec65d5399531 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.175116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f21cf-fd2b-408a-be86-ec65d5399531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.187222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:30.188976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1a41d-01ef-45c1-8106-7bfff98f641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:30.189597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1a41d-01ef-45c1-8106-7bfff98f641e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.190150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1a41d-01ef-45c1-8106-7bfff98f641e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.190373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f21cf-fd2b-408a-be86-ec65d5399531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:30.190472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1a41d-01ef-45c1-8106-7bfff98f641e None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.191116 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1a41d-01ef-45c1-8106-7bfff98f641e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:30.191423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1a41d-01ef-45c1-8106-7bfff98f641e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:30.191832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f21cf-fd2b-408a-be86-ec65d5399531 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:30.192763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1a41d-01ef-45c1-8106-7bfff98f641e None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:30.201810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 402/799] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:30.202937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1a41d-01ef-45c1-8106-7bfff98f641e None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-807f21cf-fd2b-408a-be86-ec65d5399531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:30.206818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:30.207903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:30.208804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:30.208804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:30.208804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:30.208804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 398/800] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:30.210367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad2aa2-636d-4847-a52c-7dff1d5ddc64 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.210367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad2aa2-636d-4847-a52c-7dff1d5ddc64 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.210367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad2aa2-636d-4847-a52c-7dff1d5ddc64 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.215666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 399/801] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:30.215666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad2aa2-636d-4847-a52c-7dff1d5ddc64 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.308776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:30.320225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad2aa2-636d-4847-a52c-7dff1d5ddc64 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:30.320549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1a41d-01ef-45c1-8106-7bfff98f641e None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:30.357469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20c788-6932-4367-b65b-899d00902e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:30.358104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c788-6932-4367-b65b-899d00902e9c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.358406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c788-6932-4367-b65b-899d00902e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.358679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c788-6932-4367-b65b-899d00902e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.364809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc19f9-5e0d-45b1-a1fc-fc0f7d7ade6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:30.365452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc19f9-5e0d-45b1-a1fc-fc0f7d7ade6c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.365728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc19f9-5e0d-45b1-a1fc-fc0f7d7ade6c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.365996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc19f9-5e0d-45b1-a1fc-fc0f7d7ade6c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.369599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20c788-6932-4367-b65b-899d00902e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:30.371210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20c788-6932-4367-b65b-899d00902e9c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:30.373920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc19f9-5e0d-45b1-a1fc-fc0f7d7ade6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:30.375419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc19f9-5e0d-45b1-a1fc-fc0f7d7ade6c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-36fc19f9-5e0d-45b1-a1fc-fc0f7d7ade6c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:30.386538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:30.392988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:30.394045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:30.394045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:30.394045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:30.394045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:30.394045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:30.394045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:30.394045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:30.394045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:30.394045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:30.394045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-dd20c788-6932-4367-b65b-899d00902e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:30.394623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:30.395464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:30.396325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:30.396325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:30.396325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:30.396490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 403/802] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:30.396490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc19f9-5e0d-45b1-a1fc-fc0f7d7ade6c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.396640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 400/803] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:30.396640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6390dd8-331e-4a05-a865-9999fae69017 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.396640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6390dd8-331e-4a05-a865-9999fae69017 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.396640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6390dd8-331e-4a05-a865-9999fae69017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.414247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-f6390dd8-331e-4a05-a865-9999fae69017 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:30.415515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f6390dd8-331e-4a05-a865-9999fae69017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:30.460587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:30.487440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 401/804] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:30.489245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6390dd8-331e-4a05-a865-9999fae69017 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.510260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc19f9-5e0d-45b1-a1fc-fc0f7d7ade6c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:30.544747 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf32dd0-89a6-49d7-8d78-75cba82f811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:30.545356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32dd0-89a6-49d7-8d78-75cba82f811a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.545633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32dd0-89a6-49d7-8d78-75cba82f811a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.545903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32dd0-89a6-49d7-8d78-75cba82f811a None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.546570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf32dd0-89a6-49d7-8d78-75cba82f811a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:30.546871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf32dd0-89a6-49d7-8d78-75cba82f811a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:30.548214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf32dd0-89a6-49d7-8d78-75cba82f811a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:30.560201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 404/805] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:30.561006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf32dd0-89a6-49d7-8d78-75cba82f811a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.577601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:30.614433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6390dd8-331e-4a05-a865-9999fae69017 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:30.651731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a8ae1-9669-4d3a-a672-85d4651ffd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:30.652339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8ae1-9669-4d3a-a672-85d4651ffd32 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.652680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8ae1-9669-4d3a-a672-85d4651ffd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.652948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8ae1-9669-4d3a-a672-85d4651ffd32 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.653693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a8ae1-9669-4d3a-a672-85d4651ffd32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:30.653994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a8ae1-9669-4d3a-a672-85d4651ffd32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:30.655455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a8ae1-9669-4d3a-a672-85d4651ffd32 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:30.676318 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf32dd0-89a6-49d7-8d78-75cba82f811a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:30.677504 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 402/806] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:30.678889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0973-7dd9-4e64-a1d1-e09f8bb3537e None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.679167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0973-7dd9-4e64-a1d1-e09f8bb3537e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.679439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0973-7dd9-4e64-a1d1-e09f8bb3537e None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.685170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 403/807] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:30.685170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb0973-7dd9-4e64-a1d1-e09f8bb3537e None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.712745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:30.716007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d097fa0-fe22-42bc-b28a-d90931ce18be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:30.716613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d097fa0-fe22-42bc-b28a-d90931ce18be None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.716890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d097fa0-fe22-42bc-b28a-d90931ce18be None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.717161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d097fa0-fe22-42bc-b28a-d90931ce18be None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.717797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d097fa0-fe22-42bc-b28a-d90931ce18be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:30.718290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d097fa0-fe22-42bc-b28a-d90931ce18be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:30.720546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d097fa0-fe22-42bc-b28a-d90931ce18be None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:30.738886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 405/808] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:30.738886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d097fa0-fe22-42bc-b28a-d90931ce18be None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.788307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb0973-7dd9-4e64-a1d1-e09f8bb3537e None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:30.830669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c767477-3afd-4818-9386-77d2fec30477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:30.831539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767477-3afd-4818-9386-77d2fec30477 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.831897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767477-3afd-4818-9386-77d2fec30477 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.832219 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767477-3afd-4818-9386-77d2fec30477 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.833832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:30.840482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c767477-3afd-4818-9386-77d2fec30477 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:30.841979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c767477-3afd-4818-9386-77d2fec30477 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-1c767477-3afd-4818-9386-77d2fec30477 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:30.853373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:30.854325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 404/809] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76083bf7-cadf-4bd2-ba17-6b9426209bae None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.860171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76083bf7-cadf-4bd2-ba17-6b9426209bae None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.860763 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76083bf7-cadf-4bd2-ba17-6b9426209bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.866485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d097fa0-fe22-42bc-b28a-d90931ce18be None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:30.873799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-76083bf7-cadf-4bd2-ba17-6b9426209bae None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:30.875022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-76083bf7-cadf-4bd2-ba17-6b9426209bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:30.900134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af07b-cd2c-40a5-b0af-9edd9e6aaea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:30.901620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af07b-cd2c-40a5-b0af-9edd9e6aaea6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:30.901961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af07b-cd2c-40a5-b0af-9edd9e6aaea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:30.902178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af07b-cd2c-40a5-b0af-9edd9e6aaea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:30.912333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1af07b-cd2c-40a5-b0af-9edd9e6aaea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:30.913748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1af07b-cd2c-40a5-b0af-9edd9e6aaea6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-4f1af07b-cd2c-40a5-b0af-9edd9e6aaea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:30.928069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:30.929089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:30.930016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:30.930016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:30.930016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:30.930016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 406/810] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:30.930016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af07b-cd2c-40a5-b0af-9edd9e6aaea6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.944272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 405/811] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:30.945111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76083bf7-cadf-4bd2-ba17-6b9426209bae None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:30.970641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:31.039310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af07b-cd2c-40a5-b0af-9edd9e6aaea6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.050028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76083bf7-cadf-4bd2-ba17-6b9426209bae None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.067672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:31.081725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02858ee7-22fe-410b-9ed0-0a3269fe9c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.082428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02858ee7-22fe-410b-9ed0-0a3269fe9c37 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.082675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02858ee7-22fe-410b-9ed0-0a3269fe9c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.082949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02858ee7-22fe-410b-9ed0-0a3269fe9c37 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.085427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68935d56-fc4d-4c57-8a25-2be1a72f4642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.086053 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935d56-fc4d-4c57-8a25-2be1a72f4642 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.086367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935d56-fc4d-4c57-8a25-2be1a72f4642 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.086640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68935d56-fc4d-4c57-8a25-2be1a72f4642 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.087224 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68935d56-fc4d-4c57-8a25-2be1a72f4642 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.088618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68935d56-fc4d-4c57-8a25-2be1a72f4642 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.092133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02858ee7-22fe-410b-9ed0-0a3269fe9c37 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.093817 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02858ee7-22fe-410b-9ed0-0a3269fe9c37 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-68935d56-fc4d-4c57-8a25-2be1a72f4642 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:31.098027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:31.099207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:31.100042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 406/812] 10.222.0.77 () {56 vars in 1129 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:31.100846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68935d56-fc4d-4c57-8a25-2be1a72f4642 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-02858ee7-22fe-410b-9ed0-0a3269fe9c37 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:31.111228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:31.112381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:31.113540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:31.113540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:31.113540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:31.113540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:31.113540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:31.113540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:31.113540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:31.113540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:31.113540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:31.113540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:31.120646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 407/813] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:31.121509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02858ee7-22fe-410b-9ed0-0a3269fe9c37 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.206449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:31.222135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68935d56-fc4d-4c57-8a25-2be1a72f4642 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.232196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02858ee7-22fe-410b-9ed0-0a3269fe9c37 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.256455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6596114-df1f-4cd7-bf1b-d4c1dc1a23ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.257053 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6596114-df1f-4cd7-bf1b-d4c1dc1a23ba None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.257329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6596114-df1f-4cd7-bf1b-d4c1dc1a23ba None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.257596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6596114-df1f-4cd7-bf1b-d4c1dc1a23ba None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.258311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6596114-df1f-4cd7-bf1b-d4c1dc1a23ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:31.258643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6596114-df1f-4cd7-bf1b-d4c1dc1a23ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.260641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6596114-df1f-4cd7-bf1b-d4c1dc1a23ba None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.266625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f12f3-19dc-4363-bd53-21fbbf589a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.267236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f12f3-19dc-4363-bd53-21fbbf589a95 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.267519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f12f3-19dc-4363-bd53-21fbbf589a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.267793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f12f3-19dc-4363-bd53-21fbbf589a95 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.268437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f12f3-19dc-4363-bd53-21fbbf589a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:31.268744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f12f3-19dc-4363-bd53-21fbbf589a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.270154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f12f3-19dc-4363-bd53-21fbbf589a95 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.271813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 407/814] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:31.272606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6596114-df1f-4cd7-bf1b-d4c1dc1a23ba None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.286693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 408/815] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:31.287529 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f12f3-19dc-4363-bd53-21fbbf589a95 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.335615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:31.371818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6596114-df1f-4cd7-bf1b-d4c1dc1a23ba None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.389563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f12f3-19dc-4363-bd53-21fbbf589a95 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.404728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830874c-7f02-4244-b304-9945ac1eb603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.405343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830874c-7f02-4244-b304-9945ac1eb603 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.405627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830874c-7f02-4244-b304-9945ac1eb603 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.405902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830874c-7f02-4244-b304-9945ac1eb603 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.406566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830874c-7f02-4244-b304-9945ac1eb603 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:31.406874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830874c-7f02-4244-b304-9945ac1eb603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.408240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830874c-7f02-4244-b304-9945ac1eb603 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.412834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 408/816] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:31.413633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830874c-7f02-4244-b304-9945ac1eb603 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.423794 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec335b7-7a96-4a2c-b9e6-ee6857ec748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.424429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec335b7-7a96-4a2c-b9e6-ee6857ec748a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.424707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec335b7-7a96-4a2c-b9e6-ee6857ec748a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.424982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec335b7-7a96-4a2c-b9e6-ee6857ec748a None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.425661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:31.425772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec335b7-7a96-4a2c-b9e6-ee6857ec748a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:31.426003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec335b7-7a96-4a2c-b9e6-ee6857ec748a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.427796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec335b7-7a96-4a2c-b9e6-ee6857ec748a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.445013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 409/817] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:31.445709 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec335b7-7a96-4a2c-b9e6-ee6857ec748a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.515942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830874c-7f02-4244-b304-9945ac1eb603 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.553035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daed46d-6d24-44e8-9017-0446c8d14c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.553663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daed46d-6d24-44e8-9017-0446c8d14c69 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.553947 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daed46d-6d24-44e8-9017-0446c8d14c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.554240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daed46d-6d24-44e8-9017-0446c8d14c69 None admin] PATH_INFO: `/v3/services/network` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.554836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daed46d-6d24-44e8-9017-0446c8d14c69 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.556208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daed46d-6d24-44e8-9017-0446c8d14c69 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-1daed46d-6d24-44e8-9017-0446c8d14c69 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:31.565402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:31.566570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:31.567432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 409/818] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/services/network => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:31.568406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec335b7-7a96-4a2c-b9e6-ee6857ec748a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.568564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daed46d-6d24-44e8-9017-0446c8d14c69 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.568635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:31.604126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b039b-fdc0-4a6e-973f-ab0cd2aa46fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.604743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b039b-fdc0-4a6e-973f-ab0cd2aa46fa None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.605025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b039b-fdc0-4a6e-973f-ab0cd2aa46fa None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.605293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b039b-fdc0-4a6e-973f-ab0cd2aa46fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.606064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b039b-fdc0-4a6e-973f-ab0cd2aa46fa None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=8882a9f2764648be9bfe4606144660d1) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:31.606600 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b039b-fdc0-4a6e-973f-ab0cd2aa46fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.608515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b039b-fdc0-4a6e-973f-ab0cd2aa46fa None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.614179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 410/819] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/role_assignments?user.id=8882a9f2764648be9bfe4606144660d1&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:31.615007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b039b-fdc0-4a6e-973f-ab0cd2aa46fa None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.662377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:31.691040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daed46d-6d24-44e8-9017-0446c8d14c69 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.729873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817cf88-5b55-432d-93c3-1859bca0a8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.730562 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817cf88-5b55-432d-93c3-1859bca0a8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.730848 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817cf88-5b55-432d-93c3-1859bca0a8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.731123 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817cf88-5b55-432d-93c3-1859bca0a8a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.738745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817cf88-5b55-432d-93c3-1859bca0a8a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.740222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817cf88-5b55-432d-93c3-1859bca0a8a3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.743459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b039b-fdc0-4a6e-973f-ab0cd2aa46fa None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-0817cf88-5b55-432d-93c3-1859bca0a8a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:31.754058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:31.755176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:31.756078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:31.756078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:31.756078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:31.756078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:31.756078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:31.756078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:31.756078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:31.756078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:31.758388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 410/820] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:31.760199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817cf88-5b55-432d-93c3-1859bca0a8a3 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.786621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21122b1f-7813-44b7-b9bc-543f96e7dc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.787159 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122b1f-7813-44b7-b9bc-543f96e7dc19 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.788672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122b1f-7813-44b7-b9bc-543f96e7dc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.788672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122b1f-7813-44b7-b9bc-543f96e7dc19 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.788672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21122b1f-7813-44b7-b9bc-543f96e7dc19 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:31.788672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21122b1f-7813-44b7-b9bc-543f96e7dc19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.789912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21122b1f-7813-44b7-b9bc-543f96e7dc19 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.796705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 411/821] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:31.798236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21122b1f-7813-44b7-b9bc-543f96e7dc19 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.839736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:31.895060 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817cf88-5b55-432d-93c3-1859bca0a8a3 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.915550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21122b1f-7813-44b7-b9bc-543f96e7dc19 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:31.930239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033467ab-0f54-4f1b-af5a-42fdcbdaa81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.930963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033467ab-0f54-4f1b-af5a-42fdcbdaa81e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.931249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033467ab-0f54-4f1b-af5a-42fdcbdaa81e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.932119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033467ab-0f54-4f1b-af5a-42fdcbdaa81e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.934297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:31.943973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033467ab-0f54-4f1b-af5a-42fdcbdaa81e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.945476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033467ab-0f54-4f1b-af5a-42fdcbdaa81e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.953388 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69073b6-0c9d-44ae-b581-e06207b2e1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:31.954005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69073b6-0c9d-44ae-b581-e06207b2e1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:31.954311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69073b6-0c9d-44ae-b581-e06207b2e1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:31.954590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69073b6-0c9d-44ae-b581-e06207b2e1e4 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:31.955212 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69073b6-0c9d-44ae-b581-e06207b2e1e4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:31.955511 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69073b6-0c9d-44ae-b581-e06207b2e1e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:31.956921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69073b6-0c9d-44ae-b581-e06207b2e1e4 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-033467ab-0f54-4f1b-af5a-42fdcbdaa81e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:31.960711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:31.961660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:31.962564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:31.962564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:31.962564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:31.962793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 412/822] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:31.962863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69073b6-0c9d-44ae-b581-e06207b2e1e4 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:31.967079 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 411/823] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:31.967202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033467ab-0f54-4f1b-af5a-42fdcbdaa81e None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:32.066637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:32.074528 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69073b6-0c9d-44ae-b581-e06207b2e1e4 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:32.078158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033467ab-0f54-4f1b-af5a-42fdcbdaa81e None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:32.122236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11117320-fe7b-4c48-833b-7cf9974cae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:32.122667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b91ca4-1d9d-41af-87c5-4da1b2e12920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:32.122880 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117320-fe7b-4c48-833b-7cf9974cae79 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:32.123145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117320-fe7b-4c48-833b-7cf9974cae79 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:32.123304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b91ca4-1d9d-41af-87c5-4da1b2e12920 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:32.123454 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117320-fe7b-4c48-833b-7cf9974cae79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:32.123544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b91ca4-1d9d-41af-87c5-4da1b2e12920 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:32.123800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b91ca4-1d9d-41af-87c5-4da1b2e12920 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:32.124087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11117320-fe7b-4c48-833b-7cf9974cae79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:32.124492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b91ca4-1d9d-41af-87c5-4da1b2e12920 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:32.124796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b91ca4-1d9d-41af-87c5-4da1b2e12920 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:32.125452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11117320-fe7b-4c48-833b-7cf9974cae79 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:32.126184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b91ca4-1d9d-41af-87c5-4da1b2e12920 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:32.138943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 413/824] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:32.139880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b91ca4-1d9d-41af-87c5-4da1b2e12920 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:32.234419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 412/825] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 11:48:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:48:32.235560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11117320-fe7b-4c48-833b-7cf9974cae79 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:32.258642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b91ca4-1d9d-41af-87c5-4da1b2e12920 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:32.292860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:32.303875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d368d-cbf1-4c94-aaf4-9c00ac3cf1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:32.304514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d368d-cbf1-4c94-aaf4-9c00ac3cf1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:32.304795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d368d-cbf1-4c94-aaf4-9c00ac3cf1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:32.305103 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d368d-cbf1-4c94-aaf4-9c00ac3cf1b8 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:32.305733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d368d-cbf1-4c94-aaf4-9c00ac3cf1b8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:32.306025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d368d-cbf1-4c94-aaf4-9c00ac3cf1b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:32.308713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d368d-cbf1-4c94-aaf4-9c00ac3cf1b8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:32.315484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 414/826] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:32.316867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d368d-cbf1-4c94-aaf4-9c00ac3cf1b8 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:32.336166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:32.370251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11117320-fe7b-4c48-833b-7cf9974cae79 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:32.413881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9daa6b-a5a3-45af-903e-58de03137b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:32.415207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9daa6b-a5a3-45af-903e-58de03137b70 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:32.415628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9daa6b-a5a3-45af-903e-58de03137b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:32.416609 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9daa6b-a5a3-45af-903e-58de03137b70 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:32.417268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9daa6b-a5a3-45af-903e-58de03137b70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:32.417602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9daa6b-a5a3-45af-903e-58de03137b70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:32.419783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9daa6b-a5a3-45af-903e-58de03137b70 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:32.438400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 413/827] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:32.438400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9daa6b-a5a3-45af-903e-58de03137b70 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:32.438674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d368d-cbf1-4c94-aaf4-9c00ac3cf1b8 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:32.484084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37968b7-51cd-479f-abef-c91bd527ef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:32.484830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37968b7-51cd-479f-abef-c91bd527ef24 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:32.485536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37968b7-51cd-479f-abef-c91bd527ef24 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:32.485871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37968b7-51cd-479f-abef-c91bd527ef24 None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/5e2c84402fe040048c9f238ded4f549d/roles/7667dacf895b4ae09b42a6ce839f2192` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:32.523828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37968b7-51cd-479f-abef-c91bd527ef24 None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=5e2c84402fe040048c9f238ded4f549d, role_id=7667dacf895b4ae09b42a6ce839f2192)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:32.523828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37968b7-51cd-479f-abef-c91bd527ef24 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:32.576750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9daa6b-a5a3-45af-903e-58de03137b70 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:32.578600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:32.605460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 415/828] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:48:32 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/5e2c84402fe040048c9f238ded4f549d/roles/7667dacf895b4ae09b42a6ce839f2192 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:48:32.612339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37968b7-51cd-479f-abef-c91bd527ef24 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:32.633582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13b009-7f4a-441f-ab4a-aadef7a09563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:32.634319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13b009-7f4a-441f-ab4a-aadef7a09563 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:32.635217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13b009-7f4a-441f-ab4a-aadef7a09563 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:32.635485 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13b009-7f4a-441f-ab4a-aadef7a09563 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:32.636255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13b009-7f4a-441f-ab4a-aadef7a09563 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:32.637738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13b009-7f4a-441f-ab4a-aadef7a09563 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:32.738780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:32.754581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 414/829] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 11:48:32 2022] POST /identity/v3/endpoints => generated 337 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:48:32.806672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37968b7-51cd-479f-abef-c91bd527ef24 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:32.900934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cede6-91e8-4a80-8312-fa18135776fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:32.901844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cede6-91e8-4a80-8312-fa18135776fb None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:32.902299 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cede6-91e8-4a80-8312-fa18135776fb None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:32.902721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cede6-91e8-4a80-8312-fa18135776fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:32.916355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cede6-91e8-4a80-8312-fa18135776fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:32.917827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cede6-91e8-4a80-8312-fa18135776fb None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-272cede6-91e8-4a80-8312-fa18135776fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:32.950886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:32.951940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:32.952806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:32.952806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:32.952806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:32.952806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:32.952806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:32.952806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:32.952806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:32.952806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:32.952806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 416/830] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:32.958423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13b009-7f4a-441f-ab4a-aadef7a09563 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:33.104783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13b009-7f4a-441f-ab4a-aadef7a09563 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:33.146061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93620457-6fda-494b-a411-a7adca8fa834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:33.146740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620457-6fda-494b-a411-a7adca8fa834 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:33.147026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620457-6fda-494b-a411-a7adca8fa834 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:33.147300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620457-6fda-494b-a411-a7adca8fa834 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:33.148002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93620457-6fda-494b-a411-a7adca8fa834 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:33.148309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93620457-6fda-494b-a411-a7adca8fa834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:33.149738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93620457-6fda-494b-a411-a7adca8fa834 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:33.163194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 415/831] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:33.169967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cede6-91e8-4a80-8312-fa18135776fb None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:33.278167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cede6-91e8-4a80-8312-fa18135776fb None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:33.298661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:33.318929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589df55b-3f9a-4287-9e09-70bea7e7dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:33.319609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df55b-3f9a-4287-9e09-70bea7e7dcee None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:33.319890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df55b-3f9a-4287-9e09-70bea7e7dcee None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:33.320170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df55b-3f9a-4287-9e09-70bea7e7dcee None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/39b77396e6ec432e80f4d06bc09a8605/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:33.323513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589df55b-3f9a-4287-9e09-70bea7e7dcee None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=39b77396e6ec432e80f4d06bc09a8605, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:33.324956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589df55b-3f9a-4287-9e09-70bea7e7dcee None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:33.397866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 417/832] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:48:33 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/39b77396e6ec432e80f4d06bc09a8605/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:48:34.107829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5928d-ea47-4568-bcf2-cebadbabb311 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:34.108392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5928d-ea47-4568-bcf2-cebadbabb311 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:34.108654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5928d-ea47-4568-bcf2-cebadbabb311 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:34.110629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 416/833] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:34.116079 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fca82-a10a-4805-af92-ea44d227e7f1 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:34.116499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fca82-a10a-4805-af92-ea44d227e7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:34.116830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fca82-a10a-4805-af92-ea44d227e7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:34.137654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-060fca82-a10a-4805-af92-ea44d227e7f1 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:34.138892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-060fca82-a10a-4805-af92-ea44d227e7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:34.210774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 418/834] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:34.483710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5928d-ea47-4568-bcf2-cebadbabb311 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:34.503492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:34.600942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5928d-ea47-4568-bcf2-cebadbabb311 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:34.638369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329b2d3-2278-4453-92d7-010c8510cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:34.639003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329b2d3-2278-4453-92d7-010c8510cc4a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:34.639278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329b2d3-2278-4453-92d7-010c8510cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:34.639547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329b2d3-2278-4453-92d7-010c8510cc4a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:34.640136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329b2d3-2278-4453-92d7-010c8510cc4a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:34.641544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329b2d3-2278-4453-92d7-010c8510cc4a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-6329b2d3-2278-4453-92d7-010c8510cc4a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:34.651135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:34.652155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:34.653024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 417/835] 10.222.0.77 () {56 vars in 1132 bytes} [Wed Sep 14 11:48:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:34.659727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fca82-a10a-4805-af92-ea44d227e7f1 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:34.717665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239031c-200d-49f7-b48d-4be0a23a2fd5 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:34.718012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239031c-200d-49f7-b48d-4be0a23a2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:34.718222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239031c-200d-49f7-b48d-4be0a23a2fd5 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:34.719840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 418/836] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:34.724733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e1ba9-34e9-41c5-8b29-e9f35a738577 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:34.725014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e1ba9-34e9-41c5-8b29-e9f35a738577 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:34.725287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e1ba9-34e9-41c5-8b29-e9f35a738577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:34.743553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6c5e1ba9-34e9-41c5-8b29-e9f35a738577 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:34.745385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6c5e1ba9-34e9-41c5-8b29-e9f35a738577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:34.771546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fca82-a10a-4805-af92-ea44d227e7f1 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:34.783594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:34.810411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911981c-9430-4119-8a52-d9891a2e32bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:34.811150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911981c-9430-4119-8a52-d9891a2e32bf None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:34.811437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911981c-9430-4119-8a52-d9891a2e32bf None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:34.811731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911981c-9430-4119-8a52-d9891a2e32bf None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:34.812354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911981c-9430-4119-8a52-d9891a2e32bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:34.812662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911981c-9430-4119-8a52-d9891a2e32bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:34.814109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911981c-9430-4119-8a52-d9891a2e32bf None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:34.822512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 419/837] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:34.822941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 419/838] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:48:34.825647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911981c-9430-4119-8a52-d9891a2e32bf None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:34.938546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911981c-9430-4119-8a52-d9891a2e32bf None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:34.975447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9dad4-f28d-439d-9312-a93ca6ad9e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:34.976069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9dad4-f28d-439d-9312-a93ca6ad9e7f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:34.976350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9dad4-f28d-439d-9312-a93ca6ad9e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:34.976628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9dad4-f28d-439d-9312-a93ca6ad9e7f None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:34.977259 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9dad4-f28d-439d-9312-a93ca6ad9e7f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:34.977562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9dad4-f28d-439d-9312-a93ca6ad9e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:34.978985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9dad4-f28d-439d-9312-a93ca6ad9e7f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:34.984003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 420/839] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:35.025267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836fba6-27d9-4f6a-b147-fab8a478838e None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:35.025564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836fba6-27d9-4f6a-b147-fab8a478838e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:35.025832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836fba6-27d9-4f6a-b147-fab8a478838e None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:35.027487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 420/840] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:35.033180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2eed71-5310-4a45-91e5-17fc48731146 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:35.033464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2eed71-5310-4a45-91e5-17fc48731146 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:35.033733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2eed71-5310-4a45-91e5-17fc48731146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:35.053369 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-1d2eed71-5310-4a45-91e5-17fc48731146 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:35.054620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1d2eed71-5310-4a45-91e5-17fc48731146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:35.090605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:35.116906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836fba6-27d9-4f6a-b147-fab8a478838e None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:35.133367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:35.138304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 421/841] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:35.236409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836fba6-27d9-4f6a-b147-fab8a478838e None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:35.273807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfba20b-e2b5-4a96-bc53-4ddb15f4a9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:35.274803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfba20b-e2b5-4a96-bc53-4ddb15f4a9bb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:35.279916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfba20b-e2b5-4a96-bc53-4ddb15f4a9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:35.280402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfba20b-e2b5-4a96-bc53-4ddb15f4a9bb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:35.281249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfba20b-e2b5-4a96-bc53-4ddb15f4a9bb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:35.282973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfba20b-e2b5-4a96-bc53-4ddb15f4a9bb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-6bfba20b-e2b5-4a96-bc53-4ddb15f4a9bb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:35.293167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:35.294177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 11:48:35.295066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:35.297893 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 421/842] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:48:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:35.304012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2eed71-5310-4a45-91e5-17fc48731146 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:35.413477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2eed71-5310-4a45-91e5-17fc48731146 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:35.449558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4731cb-1337-44fd-87c8-57cfe75a62e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:35.450640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4731cb-1337-44fd-87c8-57cfe75a62e8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:35.451138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4731cb-1337-44fd-87c8-57cfe75a62e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:35.451612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4731cb-1337-44fd-87c8-57cfe75a62e8 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:35.452498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4731cb-1337-44fd-87c8-57cfe75a62e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:35.453076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4731cb-1337-44fd-87c8-57cfe75a62e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:35.454803 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4731cb-1337-44fd-87c8-57cfe75a62e8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:35.460133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 422/843] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:48:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:35.461314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfba20b-e2b5-4a96-bc53-4ddb15f4a9bb None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:35.466407 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4731cb-1337-44fd-87c8-57cfe75a62e8 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:35.499027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:35.557886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:35.587610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfba20b-e2b5-4a96-bc53-4ddb15f4a9bb None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:35.588727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4731cb-1337-44fd-87c8-57cfe75a62e8 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:35.637553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dba1a-a2f3-4d0f-a071-52951a92154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:35.638564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dba1a-a2f3-4d0f-a071-52951a92154a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:35.639068 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dba1a-a2f3-4d0f-a071-52951a92154a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:35.639539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dba1a-a2f3-4d0f-a071-52951a92154a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:35.641017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db806439-8de9-4469-91c4-ccc8c86381d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:35.641660 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db806439-8de9-4469-91c4-ccc8c86381d7 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:35.641904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db806439-8de9-4469-91c4-ccc8c86381d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:35.642173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db806439-8de9-4469-91c4-ccc8c86381d7 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:35.642839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db806439-8de9-4469-91c4-ccc8c86381d7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:35.643136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db806439-8de9-4469-91c4-ccc8c86381d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:35.644495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db806439-8de9-4469-91c4-ccc8c86381d7 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:35.649064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 423/844] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:48:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:35.650444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9df9b-5e88-444b-9885-c913371ea70c None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:35.650930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9df9b-5e88-444b-9885-c913371ea70c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:35.651438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9df9b-5e88-444b-9885-c913371ea70c None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:35.654167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dba1a-a2f3-4d0f-a071-52951a92154a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:35.659323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 424/845] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:35.660804 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d036f-4efb-4c57-b7db-872a7e37ec83 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:35.661122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d036f-4efb-4c57-b7db-872a7e37ec83 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:35.661393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d036f-4efb-4c57-b7db-872a7e37ec83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-f87dba1a-a2f3-4d0f-a071-52951a92154a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:35.666120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:35.667389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:48:35.668215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:35.672063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 422/846] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:48:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:35.682157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dba1a-a2f3-4d0f-a071-52951a92154a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:35.683611 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b19d036f-4efb-4c57-b7db-872a7e37ec83 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:35.684925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b19d036f-4efb-4c57-b7db-872a7e37ec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:35.776868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 425/847] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:35.820765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dba1a-a2f3-4d0f-a071-52951a92154a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:35.860666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d8df0-cf6b-46f6-9eb4-a6e9010c391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:35.861288 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d8df0-cf6b-46f6-9eb4-a6e9010c391e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:35.861569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d8df0-cf6b-46f6-9eb4-a6e9010c391e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:35.861845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d8df0-cf6b-46f6-9eb4-a6e9010c391e None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:35.862562 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d8df0-cf6b-46f6-9eb4-a6e9010c391e None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:35.862865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d8df0-cf6b-46f6-9eb4-a6e9010c391e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:35.864237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d8df0-cf6b-46f6-9eb4-a6e9010c391e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:35.866570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:35.874619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 423/848] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:48:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:35.880569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d036f-4efb-4c57-b7db-872a7e37ec83 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:35.909905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:35.988737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d036f-4efb-4c57-b7db-872a7e37ec83 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:36.027590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171ab6f-b285-40b2-882c-faf2c5529d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:36.028245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171ab6f-b285-40b2-882c-faf2c5529d85 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:36.028527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171ab6f-b285-40b2-882c-faf2c5529d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:36.028804 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171ab6f-b285-40b2-882c-faf2c5529d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:36.041029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171ab6f-b285-40b2-882c-faf2c5529d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:36.042494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171ab6f-b285-40b2-882c-faf2c5529d85 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-b171ab6f-b285-40b2-882c-faf2c5529d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:36.058550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:36.059628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:36.061645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:36.061645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:36.061645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:36.061645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 426/849] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:36.066008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d8df0-cf6b-46f6-9eb4-a6e9010c391e None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:36.094676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171ab6f-b285-40b2-882c-faf2c5529d85 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:36.177292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d8df0-cf6b-46f6-9eb4-a6e9010c391e None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:36.183047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:36.208772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171ab6f-b285-40b2-882c-faf2c5529d85 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:36.217994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c83c1-2612-4f51-8243-36c522e12da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:36.218953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c83c1-2612-4f51-8243-36c522e12da9 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:36.219481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c83c1-2612-4f51-8243-36c522e12da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:36.219945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c83c1-2612-4f51-8243-36c522e12da9 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:36.220854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c83c1-2612-4f51-8243-36c522e12da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:36.221358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c83c1-2612-4f51-8243-36c522e12da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:36.222933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c83c1-2612-4f51-8243-36c522e12da9 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:36.237316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 424/850] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:36.246284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c83c1-2612-4f51-8243-36c522e12da9 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:36.246464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6481-85d2-45a0-9853-4d6811126ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:36.246878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6481-85d2-45a0-9853-4d6811126ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:36.247166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6481-85d2-45a0-9853-4d6811126ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:36.248350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6481-85d2-45a0-9853-4d6811126ef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:36.261382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b6481-85d2-45a0-9853-4d6811126ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-8d5b6481-85d2-45a0-9853-4d6811126ef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:36.267885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:36.268776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:48:36.270193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:36.274310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 427/851] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:36.275995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6481-85d2-45a0-9853-4d6811126ef7 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:36.312930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:36.360745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c83c1-2612-4f51-8243-36c522e12da9 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:36.402339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6481-85d2-45a0-9853-4d6811126ef7 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:36.406115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16411e4b-bc71-48af-9a8b-0519c97c0f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:36.406847 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16411e4b-bc71-48af-9a8b-0519c97c0f7c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:36.407192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16411e4b-bc71-48af-9a8b-0519c97c0f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:36.407530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16411e4b-bc71-48af-9a8b-0519c97c0f7c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:36.418255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16411e4b-bc71-48af-9a8b-0519c97c0f7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:36.420520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16411e4b-bc71-48af-9a8b-0519c97c0f7c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-16411e4b-bc71-48af-9a8b-0519c97c0f7c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:36.436238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:36.437261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:36.438269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:36.438269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:36.438269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:36.438269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:36.438269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:36.438269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:36.438269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:36.438269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:36.438269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:36.438269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:36.439957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 425/852] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Sep 14 11:48:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:36.444378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16411e4b-bc71-48af-9a8b-0519c97c0f7c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:36.446466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3aa8c-bde7-4ae1-96f5-aa958b45297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:36.447206 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3aa8c-bde7-4ae1-96f5-aa958b45297b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:36.447733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3aa8c-bde7-4ae1-96f5-aa958b45297b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:36.448090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3aa8c-bde7-4ae1-96f5-aa958b45297b None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:36.449733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3aa8c-bde7-4ae1-96f5-aa958b45297b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:36.450117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3aa8c-bde7-4ae1-96f5-aa958b45297b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:36.451588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3aa8c-bde7-4ae1-96f5-aa958b45297b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:36.458345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:36.464526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 428/853] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:36.479811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3aa8c-bde7-4ae1-96f5-aa958b45297b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:36.559811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16411e4b-bc71-48af-9a8b-0519c97c0f7c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:36.579648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:36.600474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319c545-6b7f-4b8f-bf39-f5ac0e639055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:36.601125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c545-6b7f-4b8f-bf39-f5ac0e639055 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:36.601630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c545-6b7f-4b8f-bf39-f5ac0e639055 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:36.601758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c545-6b7f-4b8f-bf39-f5ac0e639055 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:36.602478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319c545-6b7f-4b8f-bf39-f5ac0e639055 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:36.602812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319c545-6b7f-4b8f-bf39-f5ac0e639055 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:36.605510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319c545-6b7f-4b8f-bf39-f5ac0e639055 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:36.610504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3aa8c-bde7-4ae1-96f5-aa958b45297b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:36.633476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 426/854] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Sep 14 11:48:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:36.634687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319c545-6b7f-4b8f-bf39-f5ac0e639055 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:36.650995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b7a2e-d1d8-413c-996e-b5b89810bda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:36.652234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7a2e-d1d8-413c-996e-b5b89810bda4 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:36.652900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7a2e-d1d8-413c-996e-b5b89810bda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:36.653321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7a2e-d1d8-413c-996e-b5b89810bda4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:36.664618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b7a2e-d1d8-413c-996e-b5b89810bda4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:36.666874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b7a2e-d1d8-413c-996e-b5b89810bda4 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-b45b7a2e-d1d8-413c-996e-b5b89810bda4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:36.683762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:36.684917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:36.685880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:36.685880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:36.685880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:36.692681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 429/855] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:36.693502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b7a2e-d1d8-413c-996e-b5b89810bda4 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:36.750419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319c545-6b7f-4b8f-bf39-f5ac0e639055 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:36.759997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:36.788448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28d9b8-3a69-4f97-bd2b-edea87124647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:36.789087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28d9b8-3a69-4f97-bd2b-edea87124647 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:36.789369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28d9b8-3a69-4f97-bd2b-edea87124647 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:36.789640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28d9b8-3a69-4f97-bd2b-edea87124647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:36.818979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b7a2e-d1d8-413c-996e-b5b89810bda4 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:36.843522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:36.862132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789ab03-98f0-44b3-9e6f-794b43e41cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:36.862936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789ab03-98f0-44b3-9e6f-794b43e41cec None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:36.863222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789ab03-98f0-44b3-9e6f-794b43e41cec None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:36.863496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789ab03-98f0-44b3-9e6f-794b43e41cec None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:36.864148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789ab03-98f0-44b3-9e6f-794b43e41cec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:36.864450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789ab03-98f0-44b3-9e6f-794b43e41cec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:36.865830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789ab03-98f0-44b3-9e6f-794b43e41cec None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:36.873526 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28d9b8-3a69-4f97-bd2b-edea87124647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:36.875836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28d9b8-3a69-4f97-bd2b-edea87124647 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:36.886301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 430/856] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:36.887468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789ab03-98f0-44b3-9e6f-794b43e41cec None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:36.988653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 427/857] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:48:36.999305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28d9b8-3a69-4f97-bd2b-edea87124647 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:37.015835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789ab03-98f0-44b3-9e6f-794b43e41cec None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:37.033690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:37.058739 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a9a3-4dee-48d5-88d0-ca1f8c15c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:37.060065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a9a3-4dee-48d5-88d0-ca1f8c15c45a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.060642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a9a3-4dee-48d5-88d0-ca1f8c15c45a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.061092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a9a3-4dee-48d5-88d0-ca1f8c15c45a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.070003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a9a3-4dee-48d5-88d0-ca1f8c15c45a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:37.074019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a9a3-4dee-48d5-88d0-ca1f8c15c45a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-4e95a9a3-4dee-48d5-88d0-ca1f8c15c45a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:37.089042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:37.090002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:37.090982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:37.090982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:37.090982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:37.090982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:37.090982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:37.090982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:37.090982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:37.090982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:37.090982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 11:48:37.090982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:37.094914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 431/858] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:48:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:37.095746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a9a3-4dee-48d5-88d0-ca1f8c15c45a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:37.105835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:37.141985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28d9b8-3a69-4f97-bd2b-edea87124647 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:37.191320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e26b22-1ed7-4c74-864c-31d065c8fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:37.193135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e26b22-1ed7-4c74-864c-31d065c8fce3 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.194253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e26b22-1ed7-4c74-864c-31d065c8fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.194688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e26b22-1ed7-4c74-864c-31d065c8fce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.212096 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e26b22-1ed7-4c74-864c-31d065c8fce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:37.215237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e26b22-1ed7-4c74-864c-31d065c8fce3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:37.220076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a9a3-4dee-48d5-88d0-ca1f8c15c45a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-d1e26b22-1ed7-4c74-864c-31d065c8fce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:37.237062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:37.238230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:37.239340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:37.239340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:37.239340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:37.246408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 428/859] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:37.248231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e26b22-1ed7-4c74-864c-31d065c8fce3 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:37.264150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26febf8b-9a41-4000-b3c4-f69e09b7620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:37.264515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26febf8b-9a41-4000-b3c4-f69e09b7620c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.264795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26febf8b-9a41-4000-b3c4-f69e09b7620c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.265065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26febf8b-9a41-4000-b3c4-f69e09b7620c None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.265796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26febf8b-9a41-4000-b3c4-f69e09b7620c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:37.266100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26febf8b-9a41-4000-b3c4-f69e09b7620c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:37.267610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26febf8b-9a41-4000-b3c4-f69e09b7620c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:37.292690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 432/860] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Sep 14 11:48:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:37.293925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26febf8b-9a41-4000-b3c4-f69e09b7620c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:37.328948 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:37.366685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e26b22-1ed7-4c74-864c-31d065c8fce3 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:37.393571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:37.401421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55638ec-4302-4d93-9ede-3ac13c27ca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:37.402103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55638ec-4302-4d93-9ede-3ac13c27ca86 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.402387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55638ec-4302-4d93-9ede-3ac13c27ca86 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.402669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55638ec-4302-4d93-9ede-3ac13c27ca86 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.403315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55638ec-4302-4d93-9ede-3ac13c27ca86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:37.403618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55638ec-4302-4d93-9ede-3ac13c27ca86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:37.404744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26febf8b-9a41-4000-b3c4-f69e09b7620c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:37.404992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55638ec-4302-4d93-9ede-3ac13c27ca86 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:37.417631 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 429/861] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:37.418922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb4790-1ece-4af5-adc1-889eaca3ab5d None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.419223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb4790-1ece-4af5-adc1-889eaca3ab5d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.419483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb4790-1ece-4af5-adc1-889eaca3ab5d None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.420832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 430/862] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:37.425806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb4790-1ece-4af5-adc1-889eaca3ab5d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:37.445953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31294763-9341-44b5-88cd-61b6a2ec7860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:37.446894 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31294763-9341-44b5-88cd-61b6a2ec7860 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.447357 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31294763-9341-44b5-88cd-61b6a2ec7860 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.447808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31294763-9341-44b5-88cd-61b6a2ec7860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.518802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31294763-9341-44b5-88cd-61b6a2ec7860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:37.520256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31294763-9341-44b5-88cd-61b6a2ec7860 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:37.530269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb4790-1ece-4af5-adc1-889eaca3ab5d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:37.554875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:37.565165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a25b9-57e3-4e72-88ba-fe670e18506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:37.565800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a25b9-57e3-4e72-88ba-fe670e18506f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.568016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a25b9-57e3-4e72-88ba-fe670e18506f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.568016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a25b9-57e3-4e72-88ba-fe670e18506f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.574018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a25b9-57e3-4e72-88ba-fe670e18506f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:37.575480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a25b9-57e3-4e72-88ba-fe670e18506f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-572a25b9-57e3-4e72-88ba-fe670e18506f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:37.586658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:37.588160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:37.589084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:37.589084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:37.589084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:37.589084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:37.589084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:37.589084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:37.589084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:37.589084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:37.593250 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 431/863] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:37.594597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea72c0-2667-4e03-b493-da8846622e6e None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.594874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea72c0-2667-4e03-b493-da8846622e6e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.595150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea72c0-2667-4e03-b493-da8846622e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.615633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-4dea72c0-2667-4e03-b493-da8846622e6e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:37.615633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4dea72c0-2667-4e03-b493-da8846622e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:37.640724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 433/864] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:48:37.642502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31294763-9341-44b5-88cd-61b6a2ec7860 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:37.665311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:37.702234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 432/865] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:37.702234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea72c0-2667-4e03-b493-da8846622e6e None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:37.769103 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31294763-9341-44b5-88cd-61b6a2ec7860 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:37.804235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:37.809798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea72c0-2667-4e03-b493-da8846622e6e None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:37.810778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4133d6b-431d-4e7f-9c3c-c1bc5e468d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:37.811414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4133d6b-431d-4e7f-9c3c-c1bc5e468d1b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.811695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4133d6b-431d-4e7f-9c3c-c1bc5e468d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.812024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4133d6b-431d-4e7f-9c3c-c1bc5e468d1b None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.812752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4133d6b-431d-4e7f-9c3c-c1bc5e468d1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:37.813062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4133d6b-431d-4e7f-9c3c-c1bc5e468d1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:37.815100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4133d6b-431d-4e7f-9c3c-c1bc5e468d1b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:37.828236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 434/866] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:37.834158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4133d6b-431d-4e7f-9c3c-c1bc5e468d1b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:37.854176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77754c15-2880-4230-9498-55ed1f46aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:37.855354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77754c15-2880-4230-9498-55ed1f46aa19 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.855963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77754c15-2880-4230-9498-55ed1f46aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.856468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77754c15-2880-4230-9498-55ed1f46aa19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.868072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77754c15-2880-4230-9498-55ed1f46aa19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:37.870113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77754c15-2880-4230-9498-55ed1f46aa19 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-77754c15-2880-4230-9498-55ed1f46aa19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:37.886879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:37.887867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:37.888776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:37.888776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:37.888776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:37.891143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 433/867] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:37.896280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77754c15-2880-4230-9498-55ed1f46aa19 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:37.932949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:37.957125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4133d6b-431d-4e7f-9c3c-c1bc5e468d1b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:37.992547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587c386-3ea7-439e-ae02-ffe8b4880fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:37.993157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587c386-3ea7-439e-ae02-ffe8b4880fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:37.993437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587c386-3ea7-439e-ae02-ffe8b4880fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:37.994351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587c386-3ea7-439e-ae02-ffe8b4880fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:37.995079 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587c386-3ea7-439e-ae02-ffe8b4880fd4 None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=5e2c84402fe040048c9f238ded4f549d) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:37.995388 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587c386-3ea7-439e-ae02-ffe8b4880fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:37.996807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587c386-3ea7-439e-ae02-ffe8b4880fd4 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:38.002466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 435/868] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:37 2022] GET /identity/v3/role_assignments?user.id=5e2c84402fe040048c9f238ded4f549d&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:38.003610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffaa75-c74b-4cd8-a324-2d25266eb3bc None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:38.003892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffaa75-c74b-4cd8-a324-2d25266eb3bc None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:38.004163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffaa75-c74b-4cd8-a324-2d25266eb3bc None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:38.005351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 436/869] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:38.006028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffaa75-c74b-4cd8-a324-2d25266eb3bc None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:38.018977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77754c15-2880-4230-9498-55ed1f46aa19 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:38.061217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae780168-db80-4006-97dc-a37b059bf9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:38.061842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae780168-db80-4006-97dc-a37b059bf9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:38.062117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae780168-db80-4006-97dc-a37b059bf9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:38.062427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae780168-db80-4006-97dc-a37b059bf9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:38.063091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae780168-db80-4006-97dc-a37b059bf9b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:38.063391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae780168-db80-4006-97dc-a37b059bf9b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:38.065071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae780168-db80-4006-97dc-a37b059bf9b0 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:38.081484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:38.088098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 434/870] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:38.088098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f937fb-e292-4ebc-8187-3e02090c24dd None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:38.088098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f937fb-e292-4ebc-8187-3e02090c24dd None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:38.088098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f937fb-e292-4ebc-8187-3e02090c24dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:38.106074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-a9f937fb-e292-4ebc-8187-3e02090c24dd None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:38.107422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a9f937fb-e292-4ebc-8187-3e02090c24dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:38.145829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffaa75-c74b-4cd8-a324-2d25266eb3bc None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:38.188237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72aef7-6557-4956-8ce2-7835d024bd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:38.189580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72aef7-6557-4956-8ce2-7835d024bd99 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:38.189580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72aef7-6557-4956-8ce2-7835d024bd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:38.189580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72aef7-6557-4956-8ce2-7835d024bd99 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:38.190834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72aef7-6557-4956-8ce2-7835d024bd99 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:38.192389 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72aef7-6557-4956-8ce2-7835d024bd99 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:38.200124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 435/871] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:38.200978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f937fb-e292-4ebc-8187-3e02090c24dd None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:38.222809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:38.261801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 437/872] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:48:38 2022] POST /identity/v3/services => generated 269 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:48:38.322600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f937fb-e292-4ebc-8187-3e02090c24dd None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:38.371290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b0d1-ea12-43b0-b8d1-f24dd7487a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:38.371968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b0d1-ea12-43b0-b8d1-f24dd7487a8d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:38.372245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b0d1-ea12-43b0-b8d1-f24dd7487a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:38.372514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b0d1-ea12-43b0-b8d1-f24dd7487a8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:38.380163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2b0d1-ea12-43b0-b8d1-f24dd7487a8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:38.381639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2b0d1-ea12-43b0-b8d1-f24dd7487a8d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-32d2b0d1-ea12-43b0-b8d1-f24dd7487a8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:38.394746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:38.395745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:38.396614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:38.396614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:38.396614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:38.396614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:38.396614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:38.396614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:38.396614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:38.396614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:38.396614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 436/873] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:38.402388 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72aef7-6557-4956-8ce2-7835d024bd99 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:38.483368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b0d1-ea12-43b0-b8d1-f24dd7487a8d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:38.515207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72aef7-6557-4956-8ce2-7835d024bd99 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:38.530540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:38.557736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d3ad1-46e8-464b-9935-9e21146cb016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:38.558413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d3ad1-46e8-464b-9935-9e21146cb016 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:38.558701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d3ad1-46e8-464b-9935-9e21146cb016 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:38.558977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d3ad1-46e8-464b-9935-9e21146cb016 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:38.560063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d3ad1-46e8-464b-9935-9e21146cb016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:38.560291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d3ad1-46e8-464b-9935-9e21146cb016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:38.562297 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d3ad1-46e8-464b-9935-9e21146cb016 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:38.577998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 438/874] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:38.583657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:38.584993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d3ad1-46e8-464b-9935-9e21146cb016 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:38.611806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b0d1-ea12-43b0-b8d1-f24dd7487a8d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:38.657000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a0aa8-5f05-4edc-bdcf-765979cc8b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:38.657948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a0aa8-5f05-4edc-bdcf-765979cc8b8d None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:38.658416 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a0aa8-5f05-4edc-bdcf-765979cc8b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:38.658828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a0aa8-5f05-4edc-bdcf-765979cc8b8d None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:38.659618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a0aa8-5f05-4edc-bdcf-765979cc8b8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:38.661134 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a0aa8-5f05-4edc-bdcf-765979cc8b8d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:38.700894 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d3ad1-46e8-464b-9935-9e21146cb016 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:38.737862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63563527-bc6b-49e1-b921-12c8ecd448b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:38.738462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563527-bc6b-49e1-b921-12c8ecd448b3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:38.738727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563527-bc6b-49e1-b921-12c8ecd448b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:38.738996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63563527-bc6b-49e1-b921-12c8ecd448b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:38.739724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63563527-bc6b-49e1-b921-12c8ecd448b3 None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=39b77396e6ec432e80f4d06bc09a8605) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:38.740024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63563527-bc6b-49e1-b921-12c8ecd448b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:38.741698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63563527-bc6b-49e1-b921-12c8ecd448b3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:38.750293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 439/875] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:38 2022] GET /identity/v3/role_assignments?user.id=39b77396e6ec432e80f4d06bc09a8605&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:38.765736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 437/876] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:48:38 2022] POST /identity/v3/services => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:48:40.407270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7555-0bda-4997-9ac9-d43bacbcc7fa None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:40.408347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7555-0bda-4997-9ac9-d43bacbcc7fa None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:40.408837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7555-0bda-4997-9ac9-d43bacbcc7fa None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:40.410764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 440/877] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:40.420532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5519-041d-42f4-9791-3acb1fb45d79 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:40.421518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5519-041d-42f4-9791-3acb1fb45d79 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:40.422010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5519-041d-42f4-9791-3acb1fb45d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:40.442349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-f01b5519-041d-42f4-9791-3acb1fb45d79 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:40.443917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f01b5519-041d-42f4-9791-3acb1fb45d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:40.527776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 438/878] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:40.615936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a650-394e-4e47-864a-229fcf865774 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:40.615936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a650-394e-4e47-864a-229fcf865774 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:40.615936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a650-394e-4e47-864a-229fcf865774 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:40.616553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 441/879] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:40.622879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7593-3f8e-4d8d-99ee-9f67a4847b71 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:40.623420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7593-3f8e-4d8d-99ee-9f67a4847b71 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:40.623909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7593-3f8e-4d8d-99ee-9f67a4847b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:40.643234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-a20b7593-3f8e-4d8d-99ee-9f67a4847b71 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:40.644790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a20b7593-3f8e-4d8d-99ee-9f67a4847b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:40.705565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:40.720780 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 439/880] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:40.813371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a650-394e-4e47-864a-229fcf865774 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:40.859327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:40.936956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a650-394e-4e47-864a-229fcf865774 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:40.975086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03576f-c39d-485d-ba08-8863d3ee6602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:40.976073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03576f-c39d-485d-ba08-8863d3ee6602 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:40.976566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03576f-c39d-485d-ba08-8863d3ee6602 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:40.977059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03576f-c39d-485d-ba08-8863d3ee6602 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:40.988365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03576f-c39d-485d-ba08-8863d3ee6602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:40.991625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7593-3f8e-4d8d-99ee-9f67a4847b71 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-5d03576f-c39d-485d-ba08-8863d3ee6602 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:40.995234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:40.996241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:48:40.997158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:40.999964 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 442/881] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Sep 14 11:48:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:41.005946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03576f-c39d-485d-ba08-8863d3ee6602 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.092108 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7593-3f8e-4d8d-99ee-9f67a4847b71 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.107403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:41.111236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03576f-c39d-485d-ba08-8863d3ee6602 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.126551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838f7ea-03c5-42c9-9049-322fa7633c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.127237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838f7ea-03c5-42c9-9049-322fa7633c2a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.127517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838f7ea-03c5-42c9-9049-322fa7633c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.127789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838f7ea-03c5-42c9-9049-322fa7633c2a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.128373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838f7ea-03c5-42c9-9049-322fa7633c2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:41.129735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838f7ea-03c5-42c9-9049-322fa7633c2a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-e838f7ea-03c5-42c9-9049-322fa7633c2a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:41.139555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:41.140545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:41.141440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 440/882] 10.222.0.77 () {56 vars in 1132 bytes} [Wed Sep 14 11:48:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:41.142261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61aee4-f924-4565-9b1c-4df5fe02bb25 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.142834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61aee4-f924-4565-9b1c-4df5fe02bb25 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.142834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61aee4-f924-4565-9b1c-4df5fe02bb25 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.143965 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 441/883] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:41.144970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a35a4-8879-4266-a7d5-940441228531 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.145388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a35a4-8879-4266-a7d5-940441228531 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.145669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a35a4-8879-4266-a7d5-940441228531 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.146985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 442/884] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:41.147614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a35a4-8879-4266-a7d5-940441228531 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.148726 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83bdf6-3881-4e3f-8f89-ebd62cb6e2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.149335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83bdf6-3881-4e3f-8f89-ebd62cb6e2dc None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.149631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83bdf6-3881-4e3f-8f89-ebd62cb6e2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.150487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83bdf6-3881-4e3f-8f89-ebd62cb6e2dc None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.151183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83bdf6-3881-4e3f-8f89-ebd62cb6e2dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:41.151486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83bdf6-3881-4e3f-8f89-ebd62cb6e2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:41.152837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83bdf6-3881-4e3f-8f89-ebd62cb6e2dc None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:41.161154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 443/885] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:41.162364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644e957-f65c-47a3-8789-f031ad5cf056 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.162740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644e957-f65c-47a3-8789-f031ad5cf056 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.162925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644e957-f65c-47a3-8789-f031ad5cf056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.180038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9644e957-f65c-47a3-8789-f031ad5cf056 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:41.181437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9644e957-f65c-47a3-8789-f031ad5cf056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:41.208014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:41.247925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 444/886] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:41.249164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa8b8b-c303-44b6-bf96-be8fad999488 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.249457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa8b8b-c303-44b6-bf96-be8fad999488 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.249729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa8b8b-c303-44b6-bf96-be8fad999488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.266856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a35a4-8879-4266-a7d5-940441228531 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.267348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9eaa8b8b-c303-44b6-bf96-be8fad999488 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:41.268841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9eaa8b8b-c303-44b6-bf96-be8fad999488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:41.301409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb567ea-2a92-42a7-ae4f-e8e86673e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.302014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb567ea-2a92-42a7-ae4f-e8e86673e1ef None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.302322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb567ea-2a92-42a7-ae4f-e8e86673e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.302597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb567ea-2a92-42a7-ae4f-e8e86673e1ef None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.303222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb567ea-2a92-42a7-ae4f-e8e86673e1ef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:41.303525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb567ea-2a92-42a7-ae4f-e8e86673e1ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:41.304878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb567ea-2a92-42a7-ae4f-e8e86673e1ef None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:41.310980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 443/887] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:41.311765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb567ea-2a92-42a7-ae4f-e8e86673e1ef None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.345644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 445/888] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:41.347102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa8b8b-c303-44b6-bf96-be8fad999488 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.381572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:41.435083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb567ea-2a92-42a7-ae4f-e8e86673e1ef None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.462007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:41.475713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa8b8b-c303-44b6-bf96-be8fad999488 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.481196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe481290-496f-4c72-b65e-a32e451a8204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.481831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe481290-496f-4c72-b65e-a32e451a8204 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.484651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe481290-496f-4c72-b65e-a32e451a8204 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.484651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe481290-496f-4c72-b65e-a32e451a8204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.496793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe481290-496f-4c72-b65e-a32e451a8204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:41.498306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe481290-496f-4c72-b65e-a32e451a8204 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:41.515192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32935fb4-4c57-40ef-8579-7083488c8d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.516139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935fb4-4c57-40ef-8579-7083488c8d5d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.516680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935fb4-4c57-40ef-8579-7083488c8d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.517178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935fb4-4c57-40ef-8579-7083488c8d5d None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-fe481290-496f-4c72-b65e-a32e451a8204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:41.517845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:41.518803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:41.520265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:41.520265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:41.520265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:41.520265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 444/889] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:41.520265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe481290-496f-4c72-b65e-a32e451a8204 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.521058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32935fb4-4c57-40ef-8579-7083488c8d5d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:41.521587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32935fb4-4c57-40ef-8579-7083488c8d5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:41.523206 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32935fb4-4c57-40ef-8579-7083488c8d5d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:41.530044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 446/890] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:41.531280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32935fb4-4c57-40ef-8579-7083488c8d5d None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.624889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe481290-496f-4c72-b65e-a32e451a8204 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.635540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:41.651533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32935fb4-4c57-40ef-8579-7083488c8d5d None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.657767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf639e-095a-4131-880e-e6e8a241d841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.658456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf639e-095a-4131-880e-e6e8a241d841 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.658740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf639e-095a-4131-880e-e6e8a241d841 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.659012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf639e-095a-4131-880e-e6e8a241d841 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.659592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf639e-095a-4131-880e-e6e8a241d841 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:41.660949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf639e-095a-4131-880e-e6e8a241d841 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-a9bf639e-095a-4131-880e-e6e8a241d841 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:41.670400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:41.671413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:41.672233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 445/891] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:41.673636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf639e-095a-4131-880e-e6e8a241d841 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.689371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95379-ebaf-4d3e-9270-2be73917030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.690266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95379-ebaf-4d3e-9270-2be73917030f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.690591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95379-ebaf-4d3e-9270-2be73917030f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.690869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec95379-ebaf-4d3e-9270-2be73917030f None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.691504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec95379-ebaf-4d3e-9270-2be73917030f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:41.691806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec95379-ebaf-4d3e-9270-2be73917030f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:41.693150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec95379-ebaf-4d3e-9270-2be73917030f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:41.704621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 447/892] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:41.705403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95379-ebaf-4d3e-9270-2be73917030f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.706875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:41.770557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf639e-095a-4131-880e-e6e8a241d841 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.803441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f2de-3a75-45aa-9213-92b917d4680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.804035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f2de-3a75-45aa-9213-92b917d4680e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.804309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f2de-3a75-45aa-9213-92b917d4680e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.804579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f2de-3a75-45aa-9213-92b917d4680e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.805267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f2de-3a75-45aa-9213-92b917d4680e None admin] RBAC: Adding query filter params (interface=public, service_id=bce41a4d4b4a4eaea31ffce55aeb4739, region_id=RegionOne) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:41.805571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f2de-3a75-45aa-9213-92b917d4680e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:41.807694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f2de-3a75-45aa-9213-92b917d4680e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:41.808863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec95379-ebaf-4d3e-9270-2be73917030f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.812684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 446/893] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/endpoints?service_id=bce41a4d4b4a4eaea31ffce55aeb4739&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:41.813465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f2de-3a75-45aa-9213-92b917d4680e None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.845845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9504d4-89c8-44aa-b170-d5c35e9d222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.846587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9504d4-89c8-44aa-b170-d5c35e9d222e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.846858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9504d4-89c8-44aa-b170-d5c35e9d222e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.847139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9504d4-89c8-44aa-b170-d5c35e9d222e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.847714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9504d4-89c8-44aa-b170-d5c35e9d222e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:41.849052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9504d4-89c8-44aa-b170-d5c35e9d222e None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-6c9504d4-89c8-44aa-b170-d5c35e9d222e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:41.858408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:41.859391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:41.860226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 448/894] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:41.861163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9504d4-89c8-44aa-b170-d5c35e9d222e None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.872253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:41.912044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:41.914885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f2de-3a75-45aa-9213-92b917d4680e None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.949352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06811f-0693-4b2b-8bef-ef8599c32e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.949952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06811f-0693-4b2b-8bef-ef8599c32e3d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.950266 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06811f-0693-4b2b-8bef-ef8599c32e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.950539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06811f-0693-4b2b-8bef-ef8599c32e3d None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:41.951170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06811f-0693-4b2b-8bef-ef8599c32e3d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:41.951470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06811f-0693-4b2b-8bef-ef8599c32e3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:41.952827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06811f-0693-4b2b-8bef-ef8599c32e3d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:41.957221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 447/895] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:41.958001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06811f-0693-4b2b-8bef-ef8599c32e3d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:41.961950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9504d4-89c8-44aa-b170-d5c35e9d222e None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:41.996642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a11a3-c9d4-4dea-ba8f-8a3fc68b2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:41.997268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a11a3-c9d4-4dea-ba8f-8a3fc68b2131 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:41.997543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a11a3-c9d4-4dea-ba8f-8a3fc68b2131 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:41.997809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a11a3-c9d4-4dea-ba8f-8a3fc68b2131 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:42.004666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a11a3-c9d4-4dea-ba8f-8a3fc68b2131 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:42.006069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a11a3-c9d4-4dea-ba8f-8a3fc68b2131 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-b59a11a3-c9d4-4dea-ba8f-8a3fc68b2131 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:42.017926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:42.019092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:42.020194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 449/896] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:42.021983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a11a3-c9d4-4dea-ba8f-8a3fc68b2131 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:42.064138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06811f-0693-4b2b-8bef-ef8599c32e3d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:42.087882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:42.098768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffe0f0-4c56-4b48-9d05-5dae4a8174e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:42.099357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffe0f0-4c56-4b48-9d05-5dae4a8174e0 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:42.102109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffe0f0-4c56-4b48-9d05-5dae4a8174e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:42.102109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffe0f0-4c56-4b48-9d05-5dae4a8174e0 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:42.102109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffe0f0-4c56-4b48-9d05-5dae4a8174e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:42.102109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffe0f0-4c56-4b48-9d05-5dae4a8174e0 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:42.107955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 448/897] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Sep 14 11:48:41 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 11:48:42.108746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffe0f0-4c56-4b48-9d05-5dae4a8174e0 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:42.121482 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a11a3-c9d4-4dea-ba8f-8a3fc68b2131 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:42.151332 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:42.164120 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09425d6-0fd6-4bc2-b49b-39eb086b7976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:42.164837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09425d6-0fd6-4bc2-b49b-39eb086b7976 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:42.165122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09425d6-0fd6-4bc2-b49b-39eb086b7976 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:42.165746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09425d6-0fd6-4bc2-b49b-39eb086b7976 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:42.166462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09425d6-0fd6-4bc2-b49b-39eb086b7976 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:42.166830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09425d6-0fd6-4bc2-b49b-39eb086b7976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:42.168251 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09425d6-0fd6-4bc2-b49b-39eb086b7976 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:42.179914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 450/898] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Sep 14 11:48:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:42.179914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09425d6-0fd6-4bc2-b49b-39eb086b7976 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:42.240277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffe0f0-4c56-4b48-9d05-5dae4a8174e0 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:42.277995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465ecf6-a227-4de3-8ee9-2f9c64e53627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:42.278549 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465ecf6-a227-4de3-8ee9-2f9c64e53627 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:42.278828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465ecf6-a227-4de3-8ee9-2f9c64e53627 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:42.279098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465ecf6-a227-4de3-8ee9-2f9c64e53627 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:42.279735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465ecf6-a227-4de3-8ee9-2f9c64e53627 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:42.280029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465ecf6-a227-4de3-8ee9-2f9c64e53627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:42.281391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465ecf6-a227-4de3-8ee9-2f9c64e53627 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:42.286439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 449/899] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:48:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:42.287298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465ecf6-a227-4de3-8ee9-2f9c64e53627 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:42.302097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09425d6-0fd6-4bc2-b49b-39eb086b7976 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:42.338275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:42.344557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473305e2-7833-43a7-9a78-9af30872d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:42.345216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473305e2-7833-43a7-9a78-9af30872d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:42.345454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473305e2-7833-43a7-9a78-9af30872d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:42.345730 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473305e2-7833-43a7-9a78-9af30872d2a9 None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:42.346551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473305e2-7833-43a7-9a78-9af30872d2a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:42.359920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473305e2-7833-43a7-9a78-9af30872d2a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:42.359920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473305e2-7833-43a7-9a78-9af30872d2a9 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:42.371397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 451/900] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Sep 14 11:48:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:42.371397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473305e2-7833-43a7-9a78-9af30872d2a9 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:42.393697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:42.402987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465ecf6-a227-4de3-8ee9-2f9c64e53627 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:42.438800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4138d-32bb-442b-8e68-822080b5f0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:42.439462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4138d-32bb-442b-8e68-822080b5f0bb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:42.439983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4138d-32bb-442b-8e68-822080b5f0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:42.440237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4138d-32bb-442b-8e68-822080b5f0bb None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:42.440871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4138d-32bb-442b-8e68-822080b5f0bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:42.441173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4138d-32bb-442b-8e68-822080b5f0bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:42.443266 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4138d-32bb-442b-8e68-822080b5f0bb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:42.448215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 450/901] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Sep 14 11:48:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:42.448873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4138d-32bb-442b-8e68-822080b5f0bb None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:42.492510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473305e2-7833-43a7-9a78-9af30872d2a9 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:42.534081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de409689-ae1f-4e1b-8552-451c733b6cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:42.534731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de409689-ae1f-4e1b-8552-451c733b6cad None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:42.535013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de409689-ae1f-4e1b-8552-451c733b6cad None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:42.535291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de409689-ae1f-4e1b-8552-451c733b6cad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:42.536247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de409689-ae1f-4e1b-8552-451c733b6cad None admin] RBAC: Adding query filter params (interface=public, service_id=db17bc51a229415aab99253b582c6083, region_id=RegionOne) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:42.536444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de409689-ae1f-4e1b-8552-451c733b6cad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:42.537899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de409689-ae1f-4e1b-8552-451c733b6cad None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:42.549124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 452/902] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Sep 14 11:48:42 2022] GET /identity/v3/endpoints?service_id=db17bc51a229415aab99253b582c6083&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:42.550375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de409689-ae1f-4e1b-8552-451c733b6cad None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:42.612506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4138d-32bb-442b-8e68-822080b5f0bb None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:42.626646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:42.662038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115aa98-8610-4d2c-b137-0e37498b7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:42.662682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115aa98-8610-4d2c-b137-0e37498b7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:42.662961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115aa98-8610-4d2c-b137-0e37498b7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:42.663234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115aa98-8610-4d2c-b137-0e37498b7ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:42.682392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de409689-ae1f-4e1b-8552-451c733b6cad None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:42.698996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:42.721062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ab51a-2429-4bd1-a9ea-7bc53d9ba6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:42.721678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ab51a-2429-4bd1-a9ea-7bc53d9ba6cc None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:42.721957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ab51a-2429-4bd1-a9ea-7bc53d9ba6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:42.722250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ab51a-2429-4bd1-a9ea-7bc53d9ba6cc None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:42.722865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ab51a-2429-4bd1-a9ea-7bc53d9ba6cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:42.724270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ab51a-2429-4bd1-a9ea-7bc53d9ba6cc None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:42.738238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 453/903] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Sep 14 11:48:42 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 11:48:42.757953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115aa98-8610-4d2c-b137-0e37498b7ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:42.760121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115aa98-8610-4d2c-b137-0e37498b7ca0 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:42.875117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 451/904] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:42 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:48:42.883441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ab51a-2429-4bd1-a9ea-7bc53d9ba6cc None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:42.994956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ab51a-2429-4bd1-a9ea-7bc53d9ba6cc None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:43.013449 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:43.031698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064adb60-bee8-4dfb-a929-48e8cd952d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:43.032363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064adb60-bee8-4dfb-a929-48e8cd952d56 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:43.032649 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064adb60-bee8-4dfb-a929-48e8cd952d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:43.032926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064adb60-bee8-4dfb-a929-48e8cd952d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:43.045683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064adb60-bee8-4dfb-a929-48e8cd952d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:43.047459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064adb60-bee8-4dfb-a929-48e8cd952d56 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-064adb60-bee8-4dfb-a929-48e8cd952d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:43.063557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:43.064556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:43.065722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:43.065722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:43.065722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:43.065722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 454/905] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:43.071010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115aa98-8610-4d2c-b137-0e37498b7ca0 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:43.128930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:43.176428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115aa98-8610-4d2c-b137-0e37498b7ca0 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:43.211641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d280212-110d-41af-ba5a-857b758d2f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:43.212918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d280212-110d-41af-ba5a-857b758d2f4d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:43.213348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d280212-110d-41af-ba5a-857b758d2f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:43.213779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d280212-110d-41af-ba5a-857b758d2f4d None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:43.214498 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d280212-110d-41af-ba5a-857b758d2f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:43.214814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d280212-110d-41af-ba5a-857b758d2f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:43.216190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d280212-110d-41af-ba5a-857b758d2f4d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:43.229838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 452/906] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:43.235601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064adb60-bee8-4dfb-a929-48e8cd952d56 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:43.342109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064adb60-bee8-4dfb-a929-48e8cd952d56 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:43.377946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed63ae0-ba15-4cce-b454-0528042fca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:43.379099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63ae0-ba15-4cce-b454-0528042fca4a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:43.379608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63ae0-ba15-4cce-b454-0528042fca4a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:43.380088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63ae0-ba15-4cce-b454-0528042fca4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:43.389447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed63ae0-ba15-4cce-b454-0528042fca4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:43.391345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed63ae0-ba15-4cce-b454-0528042fca4a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-7ed63ae0-ba15-4cce-b454-0528042fca4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:43.404935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:43.405902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:43.406825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:43.406825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:43.406825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:43.406825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:43.406825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:43.406825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:43.406825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:43.406825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:43.409262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 455/907] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:43.414918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d280212-110d-41af-ba5a-857b758d2f4d None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:43.519245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d280212-110d-41af-ba5a-857b758d2f4d None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:43.537138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:43.555456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccddd18-05d5-49ff-b696-4c9e9e08c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:43.556106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccddd18-05d5-49ff-b696-4c9e9e08c4fe None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:43.556383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccddd18-05d5-49ff-b696-4c9e9e08c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:43.556659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccddd18-05d5-49ff-b696-4c9e9e08c4fe None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:43.557355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccddd18-05d5-49ff-b696-4c9e9e08c4fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:43.557728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccddd18-05d5-49ff-b696-4c9e9e08c4fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:43.559203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccddd18-05d5-49ff-b696-4c9e9e08c4fe None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:43.571985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 453/908] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:43.578051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed63ae0-ba15-4cce-b454-0528042fca4a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:43.622247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:43.692957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed63ae0-ba15-4cce-b454-0528042fca4a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:43.729116 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897415c-a16a-4bf8-bf16-605f482380ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:43.729735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897415c-a16a-4bf8-bf16-605f482380ec None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:43.730023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897415c-a16a-4bf8-bf16-605f482380ec None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:43.730325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897415c-a16a-4bf8-bf16-605f482380ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:43.731067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897415c-a16a-4bf8-bf16-605f482380ec None admin] RBAC: Adding query filter params (role.id=c9e240167ee54c9fbc8f01cfb6e7b46d, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=5e2c84402fe040048c9f238ded4f549d) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:43.731380 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897415c-a16a-4bf8-bf16-605f482380ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:43.732817 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897415c-a16a-4bf8-bf16-605f482380ec None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:43.739180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 456/909] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:43 2022] GET /identity/v3/role_assignments?user.id=5e2c84402fe040048c9f238ded4f549d&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=c9e240167ee54c9fbc8f01cfb6e7b46d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:44.373233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c019843-4cb6-4805-9530-fa400b87a764 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:44.373698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c019843-4cb6-4805-9530-fa400b87a764 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:44.373805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c019843-4cb6-4805-9530-fa400b87a764 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:44.375407 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 454/910] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:44.380845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d84e2-f179-4698-9d9e-6f5608675a7e None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:44.381141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d84e2-f179-4698-9d9e-6f5608675a7e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:44.381422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d84e2-f179-4698-9d9e-6f5608675a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:44.401519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-052d84e2-f179-4698-9d9e-6f5608675a7e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:44.402744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-052d84e2-f179-4698-9d9e-6f5608675a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:44.482347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 457/911] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:44.712924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62382280-8775-451f-9cb6-c74e759e18e5 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:44.713442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62382280-8775-451f-9cb6-c74e759e18e5 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:44.713442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62382280-8775-451f-9cb6-c74e759e18e5 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:44.715060 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 455/912] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:44.720200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7008c5-4f8e-4c4b-90f3-58c291d8436d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:44.720612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7008c5-4f8e-4c4b-90f3-58c291d8436d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:44.720778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7008c5-4f8e-4c4b-90f3-58c291d8436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:44.739280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-fc7008c5-4f8e-4c4b-90f3-58c291d8436d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:44.740450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fc7008c5-4f8e-4c4b-90f3-58c291d8436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:44.755495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62382280-8775-451f-9cb6-c74e759e18e5 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:44.761474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:44.815295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 458/913] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:44.892969 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62382280-8775-451f-9cb6-c74e759e18e5 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:44.951314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644b855-7599-4026-bdaa-84b2da19eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:44.952360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644b855-7599-4026-bdaa-84b2da19eee4 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:44.952922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644b855-7599-4026-bdaa-84b2da19eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:44.953404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644b855-7599-4026-bdaa-84b2da19eee4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:44.954533 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644b855-7599-4026-bdaa-84b2da19eee4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:44.957021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644b855-7599-4026-bdaa-84b2da19eee4 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-a644b855-7599-4026-bdaa-84b2da19eee4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:44.973579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:44.974528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 11:48:44.975443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:44.976377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 456/914] 10.222.0.77 () {56 vars in 1132 bytes} [Wed Sep 14 11:48:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:44.983664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7008c5-4f8e-4c4b-90f3-58c291d8436d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:45.095413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7008c5-4f8e-4c4b-90f3-58c291d8436d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:45.111259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644b855-7599-4026-bdaa-84b2da19eee4 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:45.139763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61333d3e-f4c4-4be2-8722-c2847f709881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:45.140451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61333d3e-f4c4-4be2-8722-c2847f709881 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:45.140854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61333d3e-f4c4-4be2-8722-c2847f709881 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:45.141130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61333d3e-f4c4-4be2-8722-c2847f709881 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:45.141778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61333d3e-f4c4-4be2-8722-c2847f709881 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:45.142081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61333d3e-f4c4-4be2-8722-c2847f709881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:45.143632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61333d3e-f4c4-4be2-8722-c2847f709881 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:45.150227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 459/915] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:45.155997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61333d3e-f4c4-4be2-8722-c2847f709881 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:45.166413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:45.190645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:45.235601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644b855-7599-4026-bdaa-84b2da19eee4 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:45.273950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61333d3e-f4c4-4be2-8722-c2847f709881 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:45.274172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc57fe-cfb5-4aa2-a2b8-782297910bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:45.275396 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc57fe-cfb5-4aa2-a2b8-782297910bb7 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:45.275808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc57fe-cfb5-4aa2-a2b8-782297910bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:45.276092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc57fe-cfb5-4aa2-a2b8-782297910bb7 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:45.276791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc57fe-cfb5-4aa2-a2b8-782297910bb7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:45.278149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc57fe-cfb5-4aa2-a2b8-782297910bb7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:45.313397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752cac4-917c-4914-8415-e22bcfb599d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:45.314002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752cac4-917c-4914-8415-e22bcfb599d8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:45.314454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752cac4-917c-4914-8415-e22bcfb599d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:45.314928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752cac4-917c-4914-8415-e22bcfb599d8 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:45.315549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752cac4-917c-4914-8415-e22bcfb599d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:45.315849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752cac4-917c-4914-8415-e22bcfb599d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:45.317191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752cac4-917c-4914-8415-e22bcfb599d8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:45.322499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 460/916] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:45.323461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a3e0-5784-4f21-895f-8d888554f81d None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:45.323752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a3e0-5784-4f21-895f-8d888554f81d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:45.324023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27a3e0-5784-4f21-895f-8d888554f81d None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:45.325371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 461/917] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:45.327968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27a3e0-5784-4f21-895f-8d888554f81d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:45.340114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 457/918] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:48:45 2022] POST /identity/v3/services => generated 241 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:48:45.341746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c4dd7-abc8-44d6-97e4-e9624dfda12c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:45.342276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c4dd7-abc8-44d6-97e4-e9624dfda12c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:45.342927 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c4dd7-abc8-44d6-97e4-e9624dfda12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:45.369065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b52c4dd7-abc8-44d6-97e4-e9624dfda12c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:45.371784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b52c4dd7-abc8-44d6-97e4-e9624dfda12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:45.437534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:45.460752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27a3e0-5784-4f21-895f-8d888554f81d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:45.469155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 458/919] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:45.504918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc705e9-732c-4439-9092-5224d79976ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:45.505515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc705e9-732c-4439-9092-5224d79976ac None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:45.505799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc705e9-732c-4439-9092-5224d79976ac None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:45.506077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc705e9-732c-4439-9092-5224d79976ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:45.506862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc705e9-732c-4439-9092-5224d79976ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:45.508272 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc705e9-732c-4439-9092-5224d79976ac None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:45.622916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 462/920] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 11:48:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:48:45.743584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c4dd7-abc8-44d6-97e4-e9624dfda12c None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:45.777847 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:45.857876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c4dd7-abc8-44d6-97e4-e9624dfda12c None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:45.906317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02151449-f141-4ceb-b4cd-27eadd653c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:45.906955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151449-f141-4ceb-b4cd-27eadd653c64 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:45.907228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151449-f141-4ceb-b4cd-27eadd653c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:45.907491 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151449-f141-4ceb-b4cd-27eadd653c64 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:45.908070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02151449-f141-4ceb-b4cd-27eadd653c64 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:45.909420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02151449-f141-4ceb-b4cd-27eadd653c64 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-02151449-f141-4ceb-b4cd-27eadd653c64 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:45.919284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:45.920519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:45.921538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 459/921] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:48:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:45.928475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc705e9-732c-4439-9092-5224d79976ac None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:45.989126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188377d-fb36-42a3-836b-0be023f87a84 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:45.989448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188377d-fb36-42a3-836b-0be023f87a84 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:45.989667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188377d-fb36-42a3-836b-0be023f87a84 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:45.991286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 460/922] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:48:45.996827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cd698-5361-4df3-ab17-a01e1493d61f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:45.997113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cd698-5361-4df3-ab17-a01e1493d61f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:45.997386 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cd698-5361-4df3-ab17-a01e1493d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:46.015330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-0a3cd698-5361-4df3-ab17-a01e1493d61f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:46.016521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0a3cd698-5361-4df3-ab17-a01e1493d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:46.042871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc705e9-732c-4439-9092-5224d79976ac None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:46.080118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcedae1-6abe-4648-ad67-e08b9121d1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:46.081090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcedae1-6abe-4648-ad67-e08b9121d1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:46.081676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcedae1-6abe-4648-ad67-e08b9121d1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:46.082094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcedae1-6abe-4648-ad67-e08b9121d1c0 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:46.082892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcedae1-6abe-4648-ad67-e08b9121d1c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:46.083337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcedae1-6abe-4648-ad67-e08b9121d1c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:46.084870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcedae1-6abe-4648-ad67-e08b9121d1c0 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:46.086195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:46.094409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 463/923] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:48:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:46.096529 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcedae1-6abe-4648-ad67-e08b9121d1c0 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:46.102232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 461/924] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:46.202841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcedae1-6abe-4648-ad67-e08b9121d1c0 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:46.238445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125c408-30f2-4411-b97a-928fc383380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:46.239060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125c408-30f2-4411-b97a-928fc383380c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:46.239340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125c408-30f2-4411-b97a-928fc383380c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:46.239617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125c408-30f2-4411-b97a-928fc383380c None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:46.240222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125c408-30f2-4411-b97a-928fc383380c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:46.240519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125c408-30f2-4411-b97a-928fc383380c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:46.242221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125c408-30f2-4411-b97a-928fc383380c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:46.247862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 464/925] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Sep 14 11:48:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:46.255280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cd698-5361-4df3-ab17-a01e1493d61f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:46.279277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:46.367973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cd698-5361-4df3-ab17-a01e1493d61f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:46.409081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a13ba6-bcd6-406f-a57f-d164911f76e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:46.409682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a13ba6-bcd6-406f-a57f-d164911f76e7 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:46.409957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a13ba6-bcd6-406f-a57f-d164911f76e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:46.410247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a13ba6-bcd6-406f-a57f-d164911f76e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:46.410918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a13ba6-bcd6-406f-a57f-d164911f76e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:46.412278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a13ba6-bcd6-406f-a57f-d164911f76e7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:46.434379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125c408-30f2-4411-b97a-928fc383380c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:46.500202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:46.518296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 462/926] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 11:48:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:48:46.552812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125c408-30f2-4411-b97a-928fc383380c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:46.601475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8120d-8b75-4581-81dd-04502779e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:46.602608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8120d-8b75-4581-81dd-04502779e3ba None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:46.603251 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8120d-8b75-4581-81dd-04502779e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:46.603891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8120d-8b75-4581-81dd-04502779e3ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:46.616683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8120d-8b75-4581-81dd-04502779e3ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-1ac8120d-8b75-4581-81dd-04502779e3ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:46.623639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:46.624641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:48:46.625995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:46.628819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 465/927] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Sep 14 11:48:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:46.635899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a13ba6-bcd6-406f-a57f-d164911f76e7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:46.767400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:46.791075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a13ba6-bcd6-406f-a57f-d164911f76e7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:46.828016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2e59-deed-4032-bf02-9228a7dbeb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:46.828736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2e59-deed-4032-bf02-9228a7dbeb71 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:46.829035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2e59-deed-4032-bf02-9228a7dbeb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:46.829359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2e59-deed-4032-bf02-9228a7dbeb71 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:46.830087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2e59-deed-4032-bf02-9228a7dbeb71 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:46.830461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2e59-deed-4032-bf02-9228a7dbeb71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:46.831873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2e59-deed-4032-bf02-9228a7dbeb71 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:46.841647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 463/928] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Sep 14 11:48:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:46.847242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8120d-8b75-4581-81dd-04502779e3ba None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:46.954198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8120d-8b75-4581-81dd-04502779e3ba None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:46.972897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:46.990104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acdf14-b54c-4bdd-a3ed-c0ebcbf7b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:46.990830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acdf14-b54c-4bdd-a3ed-c0ebcbf7b773 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:46.993799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acdf14-b54c-4bdd-a3ed-c0ebcbf7b773 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:46.993799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acdf14-b54c-4bdd-a3ed-c0ebcbf7b773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:47.003567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acdf14-b54c-4bdd-a3ed-c0ebcbf7b773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:47.005016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acdf14-b54c-4bdd-a3ed-c0ebcbf7b773 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-16acdf14-b54c-4bdd-a3ed-c0ebcbf7b773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:47.033314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:47.034363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:47.035236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:47.035236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:47.035236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:47.035236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 466/929] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:47.041389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2e59-deed-4032-bf02-9228a7dbeb71 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:47.154831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2e59-deed-4032-bf02-9228a7dbeb71 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:47.190202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79219c-e371-4fee-a831-1581742fd3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:47.191223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79219c-e371-4fee-a831-1581742fd3ef None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:47.191710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79219c-e371-4fee-a831-1581742fd3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:47.192177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79219c-e371-4fee-a831-1581742fd3ef None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:47.193017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79219c-e371-4fee-a831-1581742fd3ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:47.193513 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79219c-e371-4fee-a831-1581742fd3ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:47.195177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79219c-e371-4fee-a831-1581742fd3ef None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:47.203316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:47.221594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 464/930] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:47.221783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acdf14-b54c-4bdd-a3ed-c0ebcbf7b773 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:47.320263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acdf14-b54c-4bdd-a3ed-c0ebcbf7b773 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:47.358910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7d565-bdda-4dd5-bee8-53b414940fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:47.359922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d565-bdda-4dd5-bee8-53b414940fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:47.360406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d565-bdda-4dd5-bee8-53b414940fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:47.360881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7d565-bdda-4dd5-bee8-53b414940fd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:47.369484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7d565-bdda-4dd5-bee8-53b414940fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:47.371288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7d565-bdda-4dd5-bee8-53b414940fd3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-39b7d565-bdda-4dd5-bee8-53b414940fd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:47.388321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:47.389289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:47.390234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:47.390234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:47.390234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:47.390234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:47.390234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:47.390234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:47.390234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:47.390234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:47.390234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:47.390234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:47.396747 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 467/931] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Sep 14 11:48:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:47.405779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79219c-e371-4fee-a831-1581742fd3ef None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:47.518404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79219c-e371-4fee-a831-1581742fd3ef None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:47.559884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac9a36-5beb-4aa6-9992-87643c31b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:47.560514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9a36-5beb-4aa6-9992-87643c31b252 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:47.560787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9a36-5beb-4aa6-9992-87643c31b252 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:47.561058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9a36-5beb-4aa6-9992-87643c31b252 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:47.561802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9a36-5beb-4aa6-9992-87643c31b252 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:47.562100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9a36-5beb-4aa6-9992-87643c31b252 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:47.563569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9a36-5beb-4aa6-9992-87643c31b252 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:47.583659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 465/932] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Sep 14 11:48:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:47.589913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7d565-bdda-4dd5-bee8-53b414940fd3 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:47.625527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:47.664202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567a73c-b4ab-4120-9bae-4ef73d7e3c75 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:47.664518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567a73c-b4ab-4120-9bae-4ef73d7e3c75 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:47.664764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567a73c-b4ab-4120-9bae-4ef73d7e3c75 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:47.668047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 466/933] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:47.672098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec3f05-d5fe-40e4-9b52-4294af89df5d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:47.672382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec3f05-d5fe-40e4-9b52-4294af89df5d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:47.672662 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec3f05-d5fe-40e4-9b52-4294af89df5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:47.692316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-28ec3f05-d5fe-40e4-9b52-4294af89df5d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:47.694084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-28ec3f05-d5fe-40e4-9b52-4294af89df5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:47.710320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7d565-bdda-4dd5-bee8-53b414940fd3 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:47.749218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c121ed-2b36-4496-89cc-d7c2497fb577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:47.749858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c121ed-2b36-4496-89cc-d7c2497fb577 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:47.750140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c121ed-2b36-4496-89cc-d7c2497fb577 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:47.750564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c121ed-2b36-4496-89cc-d7c2497fb577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:47.765611 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c121ed-2b36-4496-89cc-d7c2497fb577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:47.766885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c121ed-2b36-4496-89cc-d7c2497fb577 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:47.770493 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-10c121ed-2b36-4496-89cc-d7c2497fb577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:47.782404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:47.789095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:47.790000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:47.790000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:47.790000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:47.790000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 468/934] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:47.792398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c121ed-2b36-4496-89cc-d7c2497fb577 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:47.802112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 467/935] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:48:47.887384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:47.906175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c121ed-2b36-4496-89cc-d7c2497fb577 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:47.941973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a78865-ab07-45dd-b9f8-d2d0befb6a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:47.942992 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a78865-ab07-45dd-b9f8-d2d0befb6a74 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:47.943474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a78865-ab07-45dd-b9f8-d2d0befb6a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:47.943946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a78865-ab07-45dd-b9f8-d2d0befb6a74 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:47.944790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a78865-ab07-45dd-b9f8-d2d0befb6a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:47.945293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a78865-ab07-45dd-b9f8-d2d0befb6a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:47.947499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a78865-ab07-45dd-b9f8-d2d0befb6a74 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:47.947614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc87b-ec4b-4c2e-9ced-ca835835308d None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:47.947832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc87b-ec4b-4c2e-9ced-ca835835308d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:47.948105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc87b-ec4b-4c2e-9ced-ca835835308d None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:47.949717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 468/936] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:48:47.954727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8ebcb-c42e-420e-9392-163692caf0d7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:47.955006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8ebcb-c42e-420e-9392-163692caf0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:47.955279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8ebcb-c42e-420e-9392-163692caf0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:47.965798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 469/937] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:47.972227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a78865-ab07-45dd-b9f8-d2d0befb6a74 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:47.976929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-eac8ebcb-c42e-420e-9392-163692caf0d7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:47.977621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-eac8ebcb-c42e-420e-9392-163692caf0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:48.061527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 469/938] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:48.080480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8ebcb-c42e-420e-9392-163692caf0d7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:48.097991 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a78865-ab07-45dd-b9f8-d2d0befb6a74 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:48.146911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb63a5-c742-44f1-86bd-4c79fd639453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:48.147920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb63a5-c742-44f1-86bd-4c79fd639453 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:48.148449 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb63a5-c742-44f1-86bd-4c79fd639453 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:48.148868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb63a5-c742-44f1-86bd-4c79fd639453 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:48.157903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb63a5-c742-44f1-86bd-4c79fd639453 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:48.159742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb63a5-c742-44f1-86bd-4c79fd639453 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-1edb63a5-c742-44f1-86bd-4c79fd639453 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:48.172526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:48.173579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:48.174708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:48.174708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:48.174708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:48.174708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:48.174708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:48.174708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:48.174708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:48.174708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:48.181631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 470/939] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:48.182793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb63a5-c742-44f1-86bd-4c79fd639453 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:48.186751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:48.194182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8ebcb-c42e-420e-9392-163692caf0d7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:48.212037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:48.232143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570799e-b4db-4416-8e00-e7bb2b6317ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:48.233055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570799e-b4db-4416-8e00-e7bb2b6317ac None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:48.233412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570799e-b4db-4416-8e00-e7bb2b6317ac None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:48.233759 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570799e-b4db-4416-8e00-e7bb2b6317ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:48.234458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570799e-b4db-4416-8e00-e7bb2b6317ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:48.235906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570799e-b4db-4416-8e00-e7bb2b6317ac None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-4570799e-b4db-4416-8e00-e7bb2b6317ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:48.248845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:48.251090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:48.252520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:48.255950 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 470/940] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:48.257470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570799e-b4db-4416-8e00-e7bb2b6317ac None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:48.329627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb63a5-c742-44f1-86bd-4c79fd639453 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:48.367878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a39a5-17ba-409a-8d15-2ec7b3a8ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:48.370021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a39a5-17ba-409a-8d15-2ec7b3a8ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:48.370391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a39a5-17ba-409a-8d15-2ec7b3a8ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:48.370661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a39a5-17ba-409a-8d15-2ec7b3a8ccf3 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:48.371514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a39a5-17ba-409a-8d15-2ec7b3a8ccf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:48.371824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a39a5-17ba-409a-8d15-2ec7b3a8ccf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:48.373603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a39a5-17ba-409a-8d15-2ec7b3a8ccf3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:48.377912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570799e-b4db-4416-8e00-e7bb2b6317ac None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:48.391932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 471/941] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:48.391932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a39a5-17ba-409a-8d15-2ec7b3a8ccf3 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:48.419766 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7a7cc-a42c-4b4b-9ec4-4ddba8533290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:48.420374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7a7cc-a42c-4b4b-9ec4-4ddba8533290 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:48.420655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7a7cc-a42c-4b4b-9ec4-4ddba8533290 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:48.420925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7a7cc-a42c-4b4b-9ec4-4ddba8533290 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:48.421556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7a7cc-a42c-4b4b-9ec4-4ddba8533290 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:48.421859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7a7cc-a42c-4b4b-9ec4-4ddba8533290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:48.423319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7a7cc-a42c-4b4b-9ec4-4ddba8533290 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:48.428338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 471/942] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Sep 14 11:48:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:48.429172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7a7cc-a42c-4b4b-9ec4-4ddba8533290 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:48.463530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:48.476450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:48.506701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a39a5-17ba-409a-8d15-2ec7b3a8ccf3 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:48.535974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7a7cc-a42c-4b4b-9ec4-4ddba8533290 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:48.542956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd85d5b-cf24-4b4e-830f-0ac20803f29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:48.543603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd85d5b-cf24-4b4e-830f-0ac20803f29b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:48.543882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd85d5b-cf24-4b4e-830f-0ac20803f29b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:48.544155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd85d5b-cf24-4b4e-830f-0ac20803f29b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:48.544744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd85d5b-cf24-4b4e-830f-0ac20803f29b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:48.546105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd85d5b-cf24-4b4e-830f-0ac20803f29b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-5bd85d5b-cf24-4b4e-830f-0ac20803f29b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:48.555240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:48.556850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 11:48:48.557748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:48.561758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 472/943] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:48.562614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd85d5b-cf24-4b4e-830f-0ac20803f29b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:48.574604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794d454-9203-426d-a350-d198c74e4414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:48.575274 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794d454-9203-426d-a350-d198c74e4414 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:48.575554 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794d454-9203-426d-a350-d198c74e4414 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:48.576028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794d454-9203-426d-a350-d198c74e4414 None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/5e2c84402fe040048c9f238ded4f549d/roles/c9e240167ee54c9fbc8f01cfb6e7b46d` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:48.578273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794d454-9203-426d-a350-d198c74e4414 None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=5e2c84402fe040048c9f238ded4f549d, role_id=c9e240167ee54c9fbc8f01cfb6e7b46d)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:48.579760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794d454-9203-426d-a350-d198c74e4414 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:48.658235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 472/944] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:48:48 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/5e2c84402fe040048c9f238ded4f549d/roles/c9e240167ee54c9fbc8f01cfb6e7b46d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:48:48.658235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794d454-9203-426d-a350-d198c74e4414 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:48.682609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd85d5b-cf24-4b4e-830f-0ac20803f29b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:48.716095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:48.728082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d45b36-1b89-4ae3-b291-77bbff30546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:48.729149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d45b36-1b89-4ae3-b291-77bbff30546f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:48.729437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d45b36-1b89-4ae3-b291-77bbff30546f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:48.729712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d45b36-1b89-4ae3-b291-77bbff30546f None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:48.730758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d45b36-1b89-4ae3-b291-77bbff30546f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:48.732273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d45b36-1b89-4ae3-b291-77bbff30546f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:48.733430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d45b36-1b89-4ae3-b291-77bbff30546f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:48.741107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 473/945] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Sep 14 11:48:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:48.747681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d45b36-1b89-4ae3-b291-77bbff30546f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:48.778563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794d454-9203-426d-a350-d198c74e4414 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:48.782140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:48.824158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb96c58-d206-48c0-ba5e-5f8a8ccf4372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:48.824975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb96c58-d206-48c0-ba5e-5f8a8ccf4372 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:48.825375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb96c58-d206-48c0-ba5e-5f8a8ccf4372 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:48.825749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb96c58-d206-48c0-ba5e-5f8a8ccf4372 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:48.826581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb96c58-d206-48c0-ba5e-5f8a8ccf4372 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:48.826995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb96c58-d206-48c0-ba5e-5f8a8ccf4372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:48.828832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb96c58-d206-48c0-ba5e-5f8a8ccf4372 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:48.840230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 473/946] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:48.841335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb96c58-d206-48c0-ba5e-5f8a8ccf4372 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:48.898814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d45b36-1b89-4ae3-b291-77bbff30546f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:48.944979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78fde8-3e18-47c0-8d20-791d5b686b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:48.945596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78fde8-3e18-47c0-8d20-791d5b686b9b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:48.945875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78fde8-3e18-47c0-8d20-791d5b686b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:48.946720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78fde8-3e18-47c0-8d20-791d5b686b9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:48.947589 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78fde8-3e18-47c0-8d20-791d5b686b9b None admin] RBAC: Adding query filter params (interface=public, service_id=dbca7611f17844f8bba34776acbb581e, region_id=RegionOne) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:48.947898 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78fde8-3e18-47c0-8d20-791d5b686b9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:48.949893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78fde8-3e18-47c0-8d20-791d5b686b9b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:48.960675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 474/947] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Sep 14 11:48:48 2022] GET /identity/v3/endpoints?service_id=dbca7611f17844f8bba34776acbb581e&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:48.960675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afffde-1517-4e36-b979-73ff17189796 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:48.960675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afffde-1517-4e36-b979-73ff17189796 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:48.960675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afffde-1517-4e36-b979-73ff17189796 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:48.960675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 475/948] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:48.961533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afffde-1517-4e36-b979-73ff17189796 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:48.972358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb96c58-d206-48c0-ba5e-5f8a8ccf4372 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:49.009099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dc3a1-6462-465d-93cf-05849e2b8583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:49.010014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc3a1-6462-465d-93cf-05849e2b8583 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:49.010321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc3a1-6462-465d-93cf-05849e2b8583 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:49.010757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc3a1-6462-465d-93cf-05849e2b8583 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:49.011395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dc3a1-6462-465d-93cf-05849e2b8583 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:49.011691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dc3a1-6462-465d-93cf-05849e2b8583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:49.013041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dc3a1-6462-465d-93cf-05849e2b8583 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:49.017714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 474/949] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:49.026439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb752-b5ee-4fac-8576-18727c2db4ed None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:49.026439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb752-b5ee-4fac-8576-18727c2db4ed None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:49.026439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb752-b5ee-4fac-8576-18727c2db4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:49.029955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:49.042310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-8bceb752-b5ee-4fac-8576-18727c2db4ed None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:49.044159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8bceb752-b5ee-4fac-8576-18727c2db4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:49.085087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:49.087576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afffde-1517-4e36-b979-73ff17189796 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:49.128345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd5ac7-6dcc-4100-b76e-589e03f7fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:49.128881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5ac7-6dcc-4100-b76e-589e03f7fe56 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:49.129163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5ac7-6dcc-4100-b76e-589e03f7fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:49.129440 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5ac7-6dcc-4100-b76e-589e03f7fe56 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:49.130060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd5ac7-6dcc-4100-b76e-589e03f7fe56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:49.131504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd5ac7-6dcc-4100-b76e-589e03f7fe56 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:49.138629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 476/950] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Sep 14 11:48:48 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 11:48:49.147354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 475/951] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:49.423363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd5ac7-6dcc-4100-b76e-589e03f7fe56 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:49.536433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd5ac7-6dcc-4100-b76e-589e03f7fe56 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:49.555351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:49.575136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:49.576089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:49.576589 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:49.577060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:49.577898 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:49.579753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:49.582789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: WARNING keystone.server.flask.common [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 11:48:49.630338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.sql.core [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 11:48:49.630338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 11:48:49.630338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [parameters: {'id': '4ae632edf2d14e468ab930c0d1528159', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 11:48:49.630338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81556) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ae632edf2d14e468ab930c0d1528159.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ae632edf2d14e468ab930c0d1528159. Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application conn.query(q) Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 11:48:49.635877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result.read() Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 14 11:48:49.636665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application next(self.gen) Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application yield resource Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application next(self.gen) Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise self.value Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application session.commit() Sep 14 11:48:49.637631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.session.flush() Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application compat.raise_( Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 11:48:49.638577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 11:48:49.640161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application conn.query(q) Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result.read() Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 11:48:49.642083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [parameters: {'id': '4ae632edf2d14e468ab930c0d1528159', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:49.644269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:49.646301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:49.648489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:49.648489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 14 11:48:49.648489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 14 11:48:49.648489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:49.648489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:49.648489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 14 11:48:49.648489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 14 11:48:49.648489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ae632edf2d14e468ab930c0d1528159. Sep 14 11:48:49.648489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:49.648489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 477/952] 10.222.0.77 () {60 vars in 1140 bytes} [Wed Sep 14 11:48:49 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:49.649788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceb752-b5ee-4fac-8576-18727c2db4ed None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:49.761409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceb752-b5ee-4fac-8576-18727c2db4ed None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:49.798416 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28820f-8d03-4455-a5f1-94a5e87ccd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:49.799165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28820f-8d03-4455-a5f1-94a5e87ccd19 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:49.799333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28820f-8d03-4455-a5f1-94a5e87ccd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:49.799572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28820f-8d03-4455-a5f1-94a5e87ccd19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:49.807350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28820f-8d03-4455-a5f1-94a5e87ccd19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:49.808811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28820f-8d03-4455-a5f1-94a5e87ccd19 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-1f28820f-8d03-4455-a5f1-94a5e87ccd19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:49.820875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:49.823728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:49.825957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:49.825957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:49.825957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:49.825957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:49.825957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:49.825957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:49.825957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:49.825957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:49.830256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 476/953] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:49.830444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:49.933305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d9d20-8957-4180-9bae-ee79d3286d2c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:49.971396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46d8bd-2287-442b-a704-79204284a04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:49.972396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46d8bd-2287-442b-a704-79204284a04a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:49.972879 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46d8bd-2287-442b-a704-79204284a04a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:49.973353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46d8bd-2287-442b-a704-79204284a04a None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:49.974237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46d8bd-2287-442b-a704-79204284a04a None admin] RBAC: Adding query filter params (name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:49.974764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46d8bd-2287-442b-a704-79204284a04a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:49.976593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46d8bd-2287-442b-a704-79204284a04a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:49.998262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 478/954] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:51.014602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065881d1-7177-435a-b11e-a95ee75f0fdf None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:51.015118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065881d1-7177-435a-b11e-a95ee75f0fdf None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:51.015225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065881d1-7177-435a-b11e-a95ee75f0fdf None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:51.016756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 477/955] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:51.022058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ee759-0373-4ef4-b14f-c7910d4f9617 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:51.022469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ee759-0373-4ef4-b14f-c7910d4f9617 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:51.022652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ee759-0373-4ef4-b14f-c7910d4f9617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:51.042799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-707ee759-0373-4ef4-b14f-c7910d4f9617 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:51.044338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-707ee759-0373-4ef4-b14f-c7910d4f9617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:51.071920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:51.118588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 479/956] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:51.289655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85625e6f-124c-49d4-b79d-0e0394bed59f None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:51.290111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85625e6f-124c-49d4-b79d-0e0394bed59f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:51.290520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85625e6f-124c-49d4-b79d-0e0394bed59f None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:51.292303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 478/957] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:51.298074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d6c0-97fe-451a-b5e6-9f90a525e2eb None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:51.298510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d6c0-97fe-451a-b5e6-9f90a525e2eb None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:51.298875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d6c0-97fe-451a-b5e6-9f90a525e2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:51.318369 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e3a7d6c0-97fe-451a-b5e6-9f90a525e2eb None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:51.319552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e3a7d6c0-97fe-451a-b5e6-9f90a525e2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:51.389344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 480/958] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:51.390641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d4d14-89dd-4b23-ad4e-ab3a5ce8eb81 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:51.391129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d4d14-89dd-4b23-ad4e-ab3a5ce8eb81 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:51.391691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d4d14-89dd-4b23-ad4e-ab3a5ce8eb81 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:51.393400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 479/959] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:51.398606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d4d14-89dd-4b23-ad4e-ab3a5ce8eb81 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:51.401498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69121d-bee2-472d-8581-a89780b45c97 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:51.401779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69121d-bee2-472d-8581-a89780b45c97 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:51.402049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69121d-bee2-472d-8581-a89780b45c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:51.423230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2a69121d-bee2-472d-8581-a89780b45c97 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:51.424401 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2a69121d-bee2-472d-8581-a89780b45c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:51.427940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:51.512547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 481/960] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:51.523061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d4d14-89dd-4b23-ad4e-ab3a5ce8eb81 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:51.561393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2163302-b61e-47d4-9b92-f3a41d767c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:51.562349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163302-b61e-47d4-9b92-f3a41d767c5c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:51.562834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163302-b61e-47d4-9b92-f3a41d767c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:51.563306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163302-b61e-47d4-9b92-f3a41d767c5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:51.575374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2163302-b61e-47d4-9b92-f3a41d767c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-f2163302-b61e-47d4-9b92-f3a41d767c5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:48:51.580688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:51.581599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:48:51.582536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:51.585075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 480/961] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Sep 14 11:48:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:51.591959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69121d-bee2-472d-8581-a89780b45c97 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:51.619779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:51.680292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2163302-b61e-47d4-9b92-f3a41d767c5c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:51.706553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69121d-bee2-472d-8581-a89780b45c97 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:51.756446 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b120f8-93fc-4c56-9dca-ee8366d48a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:51.757075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b120f8-93fc-4c56-9dca-ee8366d48a1b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:51.757359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b120f8-93fc-4c56-9dca-ee8366d48a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:51.757638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b120f8-93fc-4c56-9dca-ee8366d48a1b None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:51.758344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b120f8-93fc-4c56-9dca-ee8366d48a1b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:51.759517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b120f8-93fc-4c56-9dca-ee8366d48a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:51.761074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b120f8-93fc-4c56-9dca-ee8366d48a1b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:51.772832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 482/962] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Sep 14 11:48:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:51.778060 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:51.778987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b120f8-93fc-4c56-9dca-ee8366d48a1b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:51.800787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2163302-b61e-47d4-9b92-f3a41d767c5c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:51.837451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae306da1-1c6f-4d4f-9d1c-254c96175f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:51.837974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306da1-1c6f-4d4f-9d1c-254c96175f91 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:51.838273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306da1-1c6f-4d4f-9d1c-254c96175f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:51.838551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306da1-1c6f-4d4f-9d1c-254c96175f91 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:51.839284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae306da1-1c6f-4d4f-9d1c-254c96175f91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:51.840611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae306da1-1c6f-4d4f-9d1c-254c96175f91 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:51.872299 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:51.887003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b120f8-93fc-4c56-9dca-ee8366d48a1b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:51.905910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 481/963] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:48:51 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:48:51.907084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae306da1-1c6f-4d4f-9d1c-254c96175f91 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:51.941681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b756e1-9277-4186-86e6-a332fc6311f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:51.942642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b756e1-9277-4186-86e6-a332fc6311f8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:51.943008 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b756e1-9277-4186-86e6-a332fc6311f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:51.943355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b756e1-9277-4186-86e6-a332fc6311f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:51.955795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b756e1-9277-4186-86e6-a332fc6311f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:51.957772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b756e1-9277-4186-86e6-a332fc6311f8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-f0b756e1-9277-4186-86e6-a332fc6311f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:51.975908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:51.976939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:51.978475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:51.978475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:51.978475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:51.982717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 483/964] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:51.984110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b756e1-9277-4186-86e6-a332fc6311f8 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:52.039486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae306da1-1c6f-4d4f-9d1c-254c96175f91 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:52.083363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506981-8f6d-48cf-8081-4befbb284241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:52.084015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506981-8f6d-48cf-8081-4befbb284241 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.084301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506981-8f6d-48cf-8081-4befbb284241 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.084574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506981-8f6d-48cf-8081-4befbb284241 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.086439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506981-8f6d-48cf-8081-4befbb284241 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:52.088456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506981-8f6d-48cf-8081-4befbb284241 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-b9506981-8f6d-48cf-8081-4befbb284241 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:52.102310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:52.103385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:52.104226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:52.106366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 482/965] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:52.107858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b756e1-9277-4186-86e6-a332fc6311f8 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:52.113291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506981-8f6d-48cf-8081-4befbb284241 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:52.124842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:52.163032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990ca65-0053-4e67-956d-f8123b0f7e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:52.163617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990ca65-0053-4e67-956d-f8123b0f7e2b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.163897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990ca65-0053-4e67-956d-f8123b0f7e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.164167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990ca65-0053-4e67-956d-f8123b0f7e2b None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.165031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990ca65-0053-4e67-956d-f8123b0f7e2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:52.165339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990ca65-0053-4e67-956d-f8123b0f7e2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:52.167083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990ca65-0053-4e67-956d-f8123b0f7e2b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:52.169056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:52.183375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 484/966] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:52.189829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990ca65-0053-4e67-956d-f8123b0f7e2b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:52.240885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506981-8f6d-48cf-8081-4befbb284241 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:52.286355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa1089-ccba-4047-bcbb-0dd32f76193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:52.287417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1089-ccba-4047-bcbb-0dd32f76193d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.287932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1089-ccba-4047-bcbb-0dd32f76193d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.288428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1089-ccba-4047-bcbb-0dd32f76193d None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.289597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa1089-ccba-4047-bcbb-0dd32f76193d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:52.290762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa1089-ccba-4047-bcbb-0dd32f76193d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:52.293343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa1089-ccba-4047-bcbb-0dd32f76193d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:52.302323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 483/967] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Sep 14 11:48:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:52.304586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa427-1f63-4f3b-9234-733c6d2412af None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.305001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa427-1f63-4f3b-9234-733c6d2412af None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.305280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa427-1f63-4f3b-9234-733c6d2412af None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.306957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 484/968] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:52.307739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fa427-1f63-4f3b-9234-733c6d2412af None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:52.312240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990ca65-0053-4e67-956d-f8123b0f7e2b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:52.355323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff57e68-59e4-4551-99dd-de29f0478052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:52.356559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff57e68-59e4-4551-99dd-de29f0478052 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.357090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff57e68-59e4-4551-99dd-de29f0478052 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.357592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff57e68-59e4-4551-99dd-de29f0478052 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.369549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff57e68-59e4-4551-99dd-de29f0478052 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:52.371195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff57e68-59e4-4551-99dd-de29f0478052 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:52.382496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-fff57e68-59e4-4551-99dd-de29f0478052 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:52.385049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:52.386188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:52.387189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 485/969] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Sep 14 11:48:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:52.387793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24eecf-02ae-4977-a77d-a47fdb787f9f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.388382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24eecf-02ae-4977-a77d-a47fdb787f9f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.388382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24eecf-02ae-4977-a77d-a47fdb787f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.407077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-be24eecf-02ae-4977-a77d-a47fdb787f9f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:52.408305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-be24eecf-02ae-4977-a77d-a47fdb787f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:52.423847 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fa427-1f63-4f3b-9234-733c6d2412af None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:52.459007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015e6d7-5482-40f3-b1df-b8f23729877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:52.459750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015e6d7-5482-40f3-b1df-b8f23729877f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.460028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015e6d7-5482-40f3-b1df-b8f23729877f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.460298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015e6d7-5482-40f3-b1df-b8f23729877f None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.460929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015e6d7-5482-40f3-b1df-b8f23729877f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:52.461081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:52.461228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015e6d7-5482-40f3-b1df-b8f23729877f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:52.463347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015e6d7-5482-40f3-b1df-b8f23729877f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:52.473256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 485/970] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Sep 14 11:48:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:52.473256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015e6d7-5482-40f3-b1df-b8f23729877f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:52.487583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 486/971] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:52.488604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24eecf-02ae-4977-a77d-a47fdb787f9f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:52.585663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015e6d7-5482-40f3-b1df-b8f23729877f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:52.608641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24eecf-02ae-4977-a77d-a47fdb787f9f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:52.627747 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a160523-8808-44f8-8bb6-205d0734c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:52.628355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a160523-8808-44f8-8bb6-205d0734c484 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.628630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a160523-8808-44f8-8bb6-205d0734c484 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.628896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a160523-8808-44f8-8bb6-205d0734c484 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.629876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a160523-8808-44f8-8bb6-205d0734c484 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:52.630184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a160523-8808-44f8-8bb6-205d0734c484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:52.632017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a160523-8808-44f8-8bb6-205d0734c484 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:52.634376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:52.655005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 486/972] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Sep 14 11:48:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:52.655997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874c1cc-6ec2-415b-8074-47c9b58c901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:52.656615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874c1cc-6ec2-415b-8074-47c9b58c901d None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.656892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874c1cc-6ec2-415b-8074-47c9b58c901d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.657161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874c1cc-6ec2-415b-8074-47c9b58c901d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.657971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874c1cc-6ec2-415b-8074-47c9b58c901d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:52.666395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874c1cc-6ec2-415b-8074-47c9b58c901d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:52.666559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a160523-8808-44f8-8bb6-205d0734c484 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:52.744516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 487/973] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 11:48:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:48:52.780017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a160523-8808-44f8-8bb6-205d0734c484 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:52.795224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874c1cc-6ec2-415b-8074-47c9b58c901d None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:52.843080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d125ae-7b0e-498c-980b-a4c6cd4ee3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:52.844081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d125ae-7b0e-498c-980b-a4c6cd4ee3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.844575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d125ae-7b0e-498c-980b-a4c6cd4ee3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.845037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d125ae-7b0e-498c-980b-a4c6cd4ee3f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.849009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:52.929246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:52.932685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874c1cc-6ec2-415b-8074-47c9b58c901d None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:52.947923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d125ae-7b0e-498c-980b-a4c6cd4ee3f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:52.949872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d125ae-7b0e-498c-980b-a4c6cd4ee3f7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:52.973277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4fd07-2260-429a-bb7f-b68d12d3b3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:52.974350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4fd07-2260-429a-bb7f-b68d12d3b3ba None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:52.974644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4fd07-2260-429a-bb7f-b68d12d3b3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:52.974921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4fd07-2260-429a-bb7f-b68d12d3b3ba None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:52.975578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4fd07-2260-429a-bb7f-b68d12d3b3ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:52.977638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4fd07-2260-429a-bb7f-b68d12d3b3ba None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:53.020239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.sql.core [None req-71b4fd07-2260-429a-bb7f-b68d12d3b3ba None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 11:48:53.020239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 11:48:53.020239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [parameters: {'user_id': '1c00048a70114fceaadccd4cbd46dae0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 11:48:53.020239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81556) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-71b4fd07-2260-429a-bb7f-b68d12d3b3ba None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application conn.query(q) Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result.read() Sep 14 11:48:53.030891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 11:48:53.031781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application next(self.gen) Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application yield resource Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application next(self.gen) Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise self.value Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application session.commit() Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 11:48:53.032759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.session.flush() Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application compat.raise_( Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 11:48:53.033656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 11:48:53.035619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application conn.query(q) Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application result.read() Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 11:48:53.036470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [parameters: {'user_id': '1c00048a70114fceaadccd4cbd46dae0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:53.043435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 14 11:48:53.045277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 14 11:48:53.047422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 14 11:48:53.047422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 14 11:48:53.047422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 11:48:53.047422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 11:48:53.047422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 11:48:53.047422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:53.047422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 488/974] 10.222.0.77 () {60 vars in 1131 bytes} [Wed Sep 14 11:48:52 2022] POST /identity/v3/users => generated 160 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:53.051553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4fd07-2260-429a-bb7f-b68d12d3b3ba None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:53.069399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 487/975] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:48:52 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 11:48:53.075172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d125ae-7b0e-498c-980b-a4c6cd4ee3f7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:53.170767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:53.187178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d125ae-7b0e-498c-980b-a4c6cd4ee3f7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:53.187329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4fd07-2260-429a-bb7f-b68d12d3b3ba None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:53.188981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:53.224028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aa0d1-17e9-4d30-bf89-e9306c5d05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:53.224720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aa0d1-17e9-4d30-bf89-e9306c5d05e5 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:53.225009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aa0d1-17e9-4d30-bf89-e9306c5d05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:53.225282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aa0d1-17e9-4d30-bf89-e9306c5d05e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:53.233035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aa0d1-17e9-4d30-bf89-e9306c5d05e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:53.234926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aa0d1-17e9-4d30-bf89-e9306c5d05e5 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:53.236166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0c05e-e8cb-40b5-b586-5a66c2565189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:53.237194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0c05e-e8cb-40b5-b586-5a66c2565189 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:53.238152 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0c05e-e8cb-40b5-b586-5a66c2565189 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:53.238658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0c05e-e8cb-40b5-b586-5a66c2565189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-f44aa0d1-17e9-4d30-bf89-e9306c5d05e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:48:53.248111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:53.249069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:53.250403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 489/976] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:48:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:48:53.254093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0c05e-e8cb-40b5-b586-5a66c2565189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:53.254935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aa0d1-17e9-4d30-bf89-e9306c5d05e5 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:53.259994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0c05e-e8cb-40b5-b586-5a66c2565189 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-3ed0c05e-e8cb-40b5-b586-5a66c2565189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:48:53.272168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:53.273221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:48:53.275364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:48:53.275364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:48:53.275364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:53.278973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 488/977] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:53.279898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0c05e-e8cb-40b5-b586-5a66c2565189 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:53.390573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aa0d1-17e9-4d30-bf89-e9306c5d05e5 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:53.405213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0c05e-e8cb-40b5-b586-5a66c2565189 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:53.434517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb470-cefa-4d7e-9bbe-a4754904121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:53.435130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb470-cefa-4d7e-9bbe-a4754904121f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:53.435411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb470-cefa-4d7e-9bbe-a4754904121f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:53.435685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb470-cefa-4d7e-9bbe-a4754904121f None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:53.436386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbb470-cefa-4d7e-9bbe-a4754904121f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:53.436691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbb470-cefa-4d7e-9bbe-a4754904121f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:53.438169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbb470-cefa-4d7e-9bbe-a4754904121f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:53.456013 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4309b-759c-4b99-bdcd-eb20bf916684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:53.456625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4309b-759c-4b99-bdcd-eb20bf916684 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:53.456907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4309b-759c-4b99-bdcd-eb20bf916684 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:53.457180 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4309b-759c-4b99-bdcd-eb20bf916684 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:53.457824 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4309b-759c-4b99-bdcd-eb20bf916684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:53.458128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4309b-759c-4b99-bdcd-eb20bf916684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:53.459578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4309b-759c-4b99-bdcd-eb20bf916684 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:53.469640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:53.476741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 489/978] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:53.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4309b-759c-4b99-bdcd-eb20bf916684 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:53.487503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 490/979] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Sep 14 11:48:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:53.601045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4309b-759c-4b99-bdcd-eb20bf916684 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:53.640446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a115-dc09-48c6-bbb4-86f7704a5545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:53.641092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a115-dc09-48c6-bbb4-86f7704a5545 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:53.641372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a115-dc09-48c6-bbb4-86f7704a5545 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:53.641644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a115-dc09-48c6-bbb4-86f7704a5545 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:53.649465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9a115-dc09-48c6-bbb4-86f7704a5545 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:53.651154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9a115-dc09-48c6-bbb4-86f7704a5545 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-f5e9a115-dc09-48c6-bbb4-86f7704a5545 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:48:53.663798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:53.664795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:53.666140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:48:53.666140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:48:53.666140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:48:53.666140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:48:53.666140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:48:53.666140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:48:53.666140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:48:53.666140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:53.666140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 490/980] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:53.672230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb470-cefa-4d7e-9bbe-a4754904121f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:53.698028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:53.785690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb470-cefa-4d7e-9bbe-a4754904121f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:53.823719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fac9c4-45fe-4cfc-b5bc-9f7e9253c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:53.824338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fac9c4-45fe-4cfc-b5bc-9f7e9253c4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:53.824615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fac9c4-45fe-4cfc-b5bc-9f7e9253c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:53.824944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fac9c4-45fe-4cfc-b5bc-9f7e9253c4e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:53.825640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fac9c4-45fe-4cfc-b5bc-9f7e9253c4e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:53.825996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fac9c4-45fe-4cfc-b5bc-9f7e9253c4e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:53.829830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fac9c4-45fe-4cfc-b5bc-9f7e9253c4e2 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:53.843671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 491/981] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:48:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:53.849332 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a115-dc09-48c6-bbb4-86f7704a5545 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:53.912466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:53.954289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a115-dc09-48c6-bbb4-86f7704a5545 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:53.988229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389a8e8-4564-452a-848a-fd6151249a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:53.988835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a8e8-4564-452a-848a-fd6151249a2f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:53.989112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a8e8-4564-452a-848a-fd6151249a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:53.989384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a8e8-4564-452a-848a-fd6151249a2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:53.990103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a8e8-4564-452a-848a-fd6151249a2f None admin] RBAC: Adding query filter params (role.id=c9e240167ee54c9fbc8f01cfb6e7b46d, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=5e2c84402fe040048c9f238ded4f549d) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:53.990437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a8e8-4564-452a-848a-fd6151249a2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:53.991868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a8e8-4564-452a-848a-fd6151249a2f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:53.997867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 491/982] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:48:53 2022] GET /identity/v3/role_assignments?user.id=5e2c84402fe040048c9f238ded4f549d&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=c9e240167ee54c9fbc8f01cfb6e7b46d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:54.232853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c814747-d0a8-41bc-ada3-b084b2ae3617 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:54.233336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c814747-d0a8-41bc-ada3-b084b2ae3617 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:54.233336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c814747-d0a8-41bc-ada3-b084b2ae3617 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:54.234856 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 492/983] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:54.239816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c0b4-b483-4525-b134-28f066438be7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:54.240246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c0b4-b483-4525-b134-28f066438be7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:54.240389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c0b4-b483-4525-b134-28f066438be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:54.260166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-0dd7c0b4-b483-4525-b134-28f066438be7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:54.261360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0dd7c0b4-b483-4525-b134-28f066438be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:54.331650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 492/984] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:54.603129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c814747-d0a8-41bc-ada3-b084b2ae3617 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:54.688462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:54.709095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c814747-d0a8-41bc-ada3-b084b2ae3617 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:54.744096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9af81a-c37d-475e-be15-44563c52ff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:54.744751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9af81a-c37d-475e-be15-44563c52ff75 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:54.745033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9af81a-c37d-475e-be15-44563c52ff75 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:54.745310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9af81a-c37d-475e-be15-44563c52ff75 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:54.745903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9af81a-c37d-475e-be15-44563c52ff75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:54.747317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9af81a-c37d-475e-be15-44563c52ff75 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-bf9af81a-c37d-475e-be15-44563c52ff75 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:54.756614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:54.757616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 11:48:54.759891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:54.761148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 493/985] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:54.764177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7c0b4-b483-4525-b134-28f066438be7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:54.823387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:54.870237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7c0b4-b483-4525-b134-28f066438be7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:54.906066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dda51-e511-40ff-aa55-4daec8631b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:54.906773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dda51-e511-40ff-aa55-4daec8631b48 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:54.907059 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dda51-e511-40ff-aa55-4daec8631b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:54.907333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dda51-e511-40ff-aa55-4daec8631b48 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:54.907988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dda51-e511-40ff-aa55-4daec8631b48 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:54.908291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dda51-e511-40ff-aa55-4daec8631b48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:54.909706 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dda51-e511-40ff-aa55-4daec8631b48 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:54.921102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 493/986] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:54.922547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9af81a-c37d-475e-be15-44563c52ff75 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:55.019515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88fc73-afe2-4790-ba92-b24527a9eb06 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:55.019796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88fc73-afe2-4790-ba92-b24527a9eb06 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:55.020059 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88fc73-afe2-4790-ba92-b24527a9eb06 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:55.021511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 494/987] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:55.026725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66da9f-534d-4a21-9e18-cef0bebf5fd8 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:55.027008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66da9f-534d-4a21-9e18-cef0bebf5fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:55.027293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66da9f-534d-4a21-9e18-cef0bebf5fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:55.029903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9af81a-c37d-475e-be15-44563c52ff75 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:55.046380 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ec66da9f-534d-4a21-9e18-cef0bebf5fd8 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:55.047697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ec66da9f-534d-4a21-9e18-cef0bebf5fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:55.071394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f358c0-306d-42c9-828f-91c00736a15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:55.072000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f358c0-306d-42c9-828f-91c00736a15c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:55.072277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f358c0-306d-42c9-828f-91c00736a15c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:55.072544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f358c0-306d-42c9-828f-91c00736a15c None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:55.073169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f358c0-306d-42c9-828f-91c00736a15c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:55.073470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f358c0-306d-42c9-828f-91c00736a15c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:55.074843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f358c0-306d-42c9-828f-91c00736a15c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:55.080209 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 494/988] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:55.085860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f358c0-306d-42c9-828f-91c00736a15c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:55.096454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:55.130319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 495/989] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:48:55.188304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f358c0-306d-42c9-828f-91c00736a15c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:55.223093 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391d264-1c66-4870-8743-cd76777d9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:55.223694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d264-1c66-4870-8743-cd76777d9603 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:55.223970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d264-1c66-4870-8743-cd76777d9603 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:55.224239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391d264-1c66-4870-8743-cd76777d9603 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:55.224954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391d264-1c66-4870-8743-cd76777d9603 None admin] RBAC: Adding query filter params (interface=public, service_id=ffd4712e08174a6c99a51a2b529f7171, region_id=RegionOne) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:55.225261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391d264-1c66-4870-8743-cd76777d9603 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:55.226638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391d264-1c66-4870-8743-cd76777d9603 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:55.236981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 495/990] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Sep 14 11:48:55 2022] GET /identity/v3/endpoints?service_id=ffd4712e08174a6c99a51a2b529f7171&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:55.238023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66da9f-534d-4a21-9e18-cef0bebf5fd8 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:55.287573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:55.339817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66da9f-534d-4a21-9e18-cef0bebf5fd8 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:55.373720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1a3fd-4043-44d4-95c2-ca71c4f4c871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:55.374499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1a3fd-4043-44d4-95c2-ca71c4f4c871 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:55.374786 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1a3fd-4043-44d4-95c2-ca71c4f4c871 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:55.375057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1a3fd-4043-44d4-95c2-ca71c4f4c871 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:55.375666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1a3fd-4043-44d4-95c2-ca71c4f4c871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:55.377015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1a3fd-4043-44d4-95c2-ca71c4f4c871 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:55.389525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 496/991] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Sep 14 11:48:55 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 11:48:55.402446 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391d264-1c66-4870-8743-cd76777d9603 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:55.481393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:55.512826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391d264-1c66-4870-8743-cd76777d9603 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:55.549910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ef3ba-2aa9-49c6-a362-82fc6822e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:55.550584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef3ba-2aa9-49c6-a362-82fc6822e51d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:55.550865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef3ba-2aa9-49c6-a362-82fc6822e51d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:55.551137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef3ba-2aa9-49c6-a362-82fc6822e51d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:55.551723 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ef3ba-2aa9-49c6-a362-82fc6822e51d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:55.553084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ef3ba-2aa9-49c6-a362-82fc6822e51d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-ae3ef3ba-2aa9-49c6-a362-82fc6822e51d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:55.564150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:55.565428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:55.566363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 496/992] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:55.572243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1a3fd-4043-44d4-95c2-ca71c4f4c871 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:55.688680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1a3fd-4043-44d4-95c2-ca71c4f4c871 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:55.702115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:55.725940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b114cbd-19e9-4532-85d6-48709fbd9975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:55.726583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b114cbd-19e9-4532-85d6-48709fbd9975 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:55.726864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b114cbd-19e9-4532-85d6-48709fbd9975 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:55.727300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b114cbd-19e9-4532-85d6-48709fbd9975 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:55.728307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b114cbd-19e9-4532-85d6-48709fbd9975 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:55.728616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b114cbd-19e9-4532-85d6-48709fbd9975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:55.729976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b114cbd-19e9-4532-85d6-48709fbd9975 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:55.739892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 497/993] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Sep 14 11:48:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:55.741075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ef3ba-2aa9-49c6-a362-82fc6822e51d None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:55.846176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ef3ba-2aa9-49c6-a362-82fc6822e51d None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:55.882981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7917-318b-45f7-993e-95e81d0f5a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:55.884710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7917-318b-45f7-993e-95e81d0f5a38 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:55.885193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7917-318b-45f7-993e-95e81d0f5a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:55.885660 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7917-318b-45f7-993e-95e81d0f5a38 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:55.886551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7917-318b-45f7-993e-95e81d0f5a38 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:55.887070 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7917-318b-45f7-993e-95e81d0f5a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:55.888639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7917-318b-45f7-993e-95e81d0f5a38 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:55.891014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:55.899010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 497/994] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Sep 14 11:48:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:55.900911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b114cbd-19e9-4532-85d6-48709fbd9975 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:56.004222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b114cbd-19e9-4532-85d6-48709fbd9975 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:56.037376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528b387-c29a-419d-8f73-2fac94bb66ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:56.037986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528b387-c29a-419d-8f73-2fac94bb66ea None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:56.038354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528b387-c29a-419d-8f73-2fac94bb66ea None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:56.038630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528b387-c29a-419d-8f73-2fac94bb66ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:56.039340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528b387-c29a-419d-8f73-2fac94bb66ea None admin] RBAC: Adding query filter params (interface=admin, service_id=dbca7611f17844f8bba34776acbb581e, region_id=RegionOne) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:56.039679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528b387-c29a-419d-8f73-2fac94bb66ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:56.041119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528b387-c29a-419d-8f73-2fac94bb66ea None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:56.051029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 498/995] 10.222.0.77 () {56 vars in 1249 bytes} [Wed Sep 14 11:48:55 2022] GET /identity/v3/endpoints?service_id=dbca7611f17844f8bba34776acbb581e&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:56.052523 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7917-318b-45f7-993e-95e81d0f5a38 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:56.163395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7917-318b-45f7-993e-95e81d0f5a38 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:56.197843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36850605-f6a4-4dc6-b6a2-03049d0371fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:56.198492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850605-f6a4-4dc6-b6a2-03049d0371fd None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:56.198773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850605-f6a4-4dc6-b6a2-03049d0371fd None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:56.199043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850605-f6a4-4dc6-b6a2-03049d0371fd None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:56.199645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36850605-f6a4-4dc6-b6a2-03049d0371fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:56.201010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36850605-f6a4-4dc6-b6a2-03049d0371fd None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:56.210285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 498/996] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Sep 14 11:48:56 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 11:48:56.231856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20db0ad-107d-4790-b848-20547bc6cf2b None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:56.232203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20db0ad-107d-4790-b848-20547bc6cf2b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:56.232416 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20db0ad-107d-4790-b848-20547bc6cf2b None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:56.233890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 499/997] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:56.239750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237225a-7595-4485-86f8-da28f705e5a7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:56.240267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237225a-7595-4485-86f8-da28f705e5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:56.240374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237225a-7595-4485-86f8-da28f705e5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:56.261940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-a237225a-7595-4485-86f8-da28f705e5a7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:56.263504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a237225a-7595-4485-86f8-da28f705e5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:56.334899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:56.344538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 499/998] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:48:56.614382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20db0ad-107d-4790-b848-20547bc6cf2b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:56.660208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:56.721499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20db0ad-107d-4790-b848-20547bc6cf2b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:56.756395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddb61a-eb6c-4c58-8be6-667f74827e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:56.757024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddb61a-eb6c-4c58-8be6-667f74827e81 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:56.757305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddb61a-eb6c-4c58-8be6-667f74827e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:56.757580 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddb61a-eb6c-4c58-8be6-667f74827e81 None admin] PATH_INFO: `/v3/services/image` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:56.758165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddb61a-eb6c-4c58-8be6-667f74827e81 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:56.759871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddb61a-eb6c-4c58-8be6-667f74827e81 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-36ddb61a-eb6c-4c58-8be6-667f74827e81 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:56.768744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:56.769941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 11:48:56.771010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:56.775265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 500/999] 10.222.0.77 () {56 vars in 1105 bytes} [Wed Sep 14 11:48:56 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:56.776662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237225a-7595-4485-86f8-da28f705e5a7 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:56.876192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237225a-7595-4485-86f8-da28f705e5a7 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:56.910182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055bec8-4fae-4160-98c2-c7c1ad6f6b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:56.910816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055bec8-4fae-4160-98c2-c7c1ad6f6b46 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:56.911099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055bec8-4fae-4160-98c2-c7c1ad6f6b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:56.911373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055bec8-4fae-4160-98c2-c7c1ad6f6b46 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:56.912004 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055bec8-4fae-4160-98c2-c7c1ad6f6b46 None admin] RBAC: Adding query filter params (name=image) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:56.912308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055bec8-4fae-4160-98c2-c7c1ad6f6b46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:56.913668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055bec8-4fae-4160-98c2-c7c1ad6f6b46 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:56.918978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 500/1000] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:56.925035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddb61a-eb6c-4c58-8be6-667f74827e81 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:57.027558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddb61a-eb6c-4c58-8be6-667f74827e81 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:57.029873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:57.062571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0056c1e-a42f-4905-a334-65fd23d6f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:57.063178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0056c1e-a42f-4905-a334-65fd23d6f870 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:57.063453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0056c1e-a42f-4905-a334-65fd23d6f870 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:57.063724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0056c1e-a42f-4905-a334-65fd23d6f870 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:57.064348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0056c1e-a42f-4905-a334-65fd23d6f870 None admin] RBAC: Adding query filter params (type=image) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:57.064910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0056c1e-a42f-4905-a334-65fd23d6f870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:57.066290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0056c1e-a42f-4905-a334-65fd23d6f870 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:57.074393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 501/1001] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:48:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:57.595181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51ecb9-3090-428b-aba7-ebc84fda0cff None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:57.595810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51ecb9-3090-428b-aba7-ebc84fda0cff None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:57.595810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51ecb9-3090-428b-aba7-ebc84fda0cff None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:57.597039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 501/1002] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:57.603628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25344-effd-4f86-9092-ffe560f6f826 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:57.603924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25344-effd-4f86-9092-ffe560f6f826 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:57.604200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25344-effd-4f86-9092-ffe560f6f826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:57.623042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-8cb25344-effd-4f86-9092-ffe560f6f826 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:57.624241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8cb25344-effd-4f86-9092-ffe560f6f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:57.693362 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 502/1003] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:57.973659 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51ecb9-3090-428b-aba7-ebc84fda0cff None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:58.036901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:58.081655 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51ecb9-3090-428b-aba7-ebc84fda0cff None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:58.116031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225a308-9fc5-4d1a-af14-d5df2e2e2b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:58.116664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225a308-9fc5-4d1a-af14-d5df2e2e2b33 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:58.116942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225a308-9fc5-4d1a-af14-d5df2e2e2b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:58.117214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225a308-9fc5-4d1a-af14-d5df2e2e2b33 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:58.118476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225a308-9fc5-4d1a-af14-d5df2e2e2b33 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:58.120048 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225a308-9fc5-4d1a-af14-d5df2e2e2b33 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-6225a308-9fc5-4d1a-af14-d5df2e2e2b33 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:58.128824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:58.129789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 11:48:58.130995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:48:58.134288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 502/1004] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:48:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:58.137082 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb25344-effd-4f86-9092-ffe560f6f826 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:58.238618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:58.243627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb25344-effd-4f86-9092-ffe560f6f826 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:58.278501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0de00-8a18-40fc-8eec-43f82eb23a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:58.279126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0de00-8a18-40fc-8eec-43f82eb23a5d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:58.279410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0de00-8a18-40fc-8eec-43f82eb23a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:58.279682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0de00-8a18-40fc-8eec-43f82eb23a5d None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:58.280321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0de00-8a18-40fc-8eec-43f82eb23a5d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:58.280624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0de00-8a18-40fc-8eec-43f82eb23a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:58.281996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0de00-8a18-40fc-8eec-43f82eb23a5d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:58.287585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 503/1005] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:58.293656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225a308-9fc5-4d1a-af14-d5df2e2e2b33 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:58.401531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225a308-9fc5-4d1a-af14-d5df2e2e2b33 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:58.418098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1182cd-c184-49e1-ba28-e65c5f2539b2 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:58.418450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1182cd-c184-49e1-ba28-e65c5f2539b2 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:58.418675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1182cd-c184-49e1-ba28-e65c5f2539b2 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:58.420171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 504/1006] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:48:58.424721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:58.424932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ad99-a6c8-4589-ae62-a3b8797e60bc None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:58.425199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ad99-a6c8-4589-ae62-a3b8797e60bc None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:58.425657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ad99-a6c8-4589-ae62-a3b8797e60bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:58.435966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd0d5c-9e01-4057-8be1-ee761f31d7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:58.436579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd0d5c-9e01-4057-8be1-ee761f31d7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:58.436975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd0d5c-9e01-4057-8be1-ee761f31d7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:58.437203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd0d5c-9e01-4057-8be1-ee761f31d7a4 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:58.437806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd0d5c-9e01-4057-8be1-ee761f31d7a4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:58.438106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd0d5c-9e01-4057-8be1-ee761f31d7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:58.439743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd0d5c-9e01-4057-8be1-ee761f31d7a4 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:58.444039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c895ad99-a6c8-4589-ae62-a3b8797e60bc None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:58.444629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 503/1007] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Sep 14 11:48:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:58.445308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c895ad99-a6c8-4589-ae62-a3b8797e60bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:58.450769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd0d5c-9e01-4057-8be1-ee761f31d7a4 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:58.517608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 505/1008] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:48:58.556331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd0d5c-9e01-4057-8be1-ee761f31d7a4 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:58.593657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14328bb8-3624-4af3-ade2-798aeb3d122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:58.594355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14328bb8-3624-4af3-ade2-798aeb3d122a None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:58.608500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14328bb8-3624-4af3-ade2-798aeb3d122a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:58.608500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14328bb8-3624-4af3-ade2-798aeb3d122a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:58.608500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14328bb8-3624-4af3-ade2-798aeb3d122a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:58.608500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14328bb8-3624-4af3-ade2-798aeb3d122a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:58.687821 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 504/1009] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 11:48:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:48:58.786585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895ad99-a6c8-4589-ae62-a3b8797e60bc None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:58.909589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:58.918569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895ad99-a6c8-4589-ae62-a3b8797e60bc None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:58.962180 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c63fe-25cd-47c4-a849-de4ad2296922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:58.963087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c63fe-25cd-47c4-a849-de4ad2296922 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:58.963522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c63fe-25cd-47c4-a849-de4ad2296922 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:58.963941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c63fe-25cd-47c4-a849-de4ad2296922 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:58.964768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c63fe-25cd-47c4-a849-de4ad2296922 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:58.966307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c63fe-25cd-47c4-a849-de4ad2296922 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-156c63fe-25cd-47c4-a849-de4ad2296922 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:48:58.975726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:48:58.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:48:58.977782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 506/1010] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Sep 14 11:48:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:48:58.984271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14328bb8-3624-4af3-ade2-798aeb3d122a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:59.031234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:59.089495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14328bb8-3624-4af3-ade2-798aeb3d122a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:59.122962 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39092f-65ff-4c8c-a534-1f462135e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:59.123588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39092f-65ff-4c8c-a534-1f462135e2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:59.123871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39092f-65ff-4c8c-a534-1f462135e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:59.124144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39092f-65ff-4c8c-a534-1f462135e2e3 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:59.124779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39092f-65ff-4c8c-a534-1f462135e2e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:59.125082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39092f-65ff-4c8c-a534-1f462135e2e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:59.126477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39092f-65ff-4c8c-a534-1f462135e2e3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:59.136478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 505/1011] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Sep 14 11:48:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:48:59.138128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c63fe-25cd-47c4-a849-de4ad2296922 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:59.243517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c63fe-25cd-47c4-a849-de4ad2296922 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:59.277563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de8c21-3dd5-4178-b186-722514e5bc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:59.278173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de8c21-3dd5-4178-b186-722514e5bc8c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:59.278479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de8c21-3dd5-4178-b186-722514e5bc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:59.278757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de8c21-3dd5-4178-b186-722514e5bc8c None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:59.279486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de8c21-3dd5-4178-b186-722514e5bc8c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:48:59.279794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de8c21-3dd5-4178-b186-722514e5bc8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:59.281165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de8c21-3dd5-4178-b186-722514e5bc8c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:59.284200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f66f-26b2-438e-bf35-2820e7d3f520 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:59.284488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f66f-26b2-438e-bf35-2820e7d3f520 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:59.284760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f66f-26b2-438e-bf35-2820e7d3f520 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:59.286095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 506/1012] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:48:59.286715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 507/1013] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Sep 14 11:48:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:48:59.291625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b12d5-9967-429d-8c84-98b9974f7702 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:59.291912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b12d5-9967-429d-8c84-98b9974f7702 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:59.292211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b12d5-9967-429d-8c84-98b9974f7702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:59.292411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de8c21-3dd5-4178-b186-722514e5bc8c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:59.310831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:59.313262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c42b12d5-9967-429d-8c84-98b9974f7702 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:48:59.314742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c42b12d5-9967-429d-8c84-98b9974f7702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:48:59.387132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 507/1014] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:48:59 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:48:59.404291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de8c21-3dd5-4178-b186-722514e5bc8c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:59.440298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af76ac3-7250-4b8a-99ef-e78abba9cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:59.440899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76ac3-7250-4b8a-99ef-e78abba9cc9b None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:59.441174 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76ac3-7250-4b8a-99ef-e78abba9cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:59.441439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af76ac3-7250-4b8a-99ef-e78abba9cc9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:59.442091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af76ac3-7250-4b8a-99ef-e78abba9cc9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:59.443473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af76ac3-7250-4b8a-99ef-e78abba9cc9b None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:59.521398 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 508/1015] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 11:48:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:48:59.659838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b12d5-9967-429d-8c84-98b9974f7702 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:48:59.701321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:48:59.771724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b12d5-9967-429d-8c84-98b9974f7702 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:48:59.813795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922ccf4-469d-4035-94f2-3ae8de4994cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:48:59.815055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922ccf4-469d-4035-94f2-3ae8de4994cc None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:48:59.815532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922ccf4-469d-4035-94f2-3ae8de4994cc None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:48:59.816030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922ccf4-469d-4035-94f2-3ae8de4994cc None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:48:59.816860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922ccf4-469d-4035-94f2-3ae8de4994cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:48:59.818507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922ccf4-469d-4035-94f2-3ae8de4994cc None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:48:59.910340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 508/1016] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:48:59 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:49:00.971557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c8577-6bbd-4310-bdfe-4f5999ec7da5 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:00.972075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c8577-6bbd-4310-bdfe-4f5999ec7da5 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:00.972075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c8577-6bbd-4310-bdfe-4f5999ec7da5 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:00.973489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 509/1017] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:00.978638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153501c-8fa3-4976-8504-60bdc9c5441c None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:00.979041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153501c-8fa3-4976-8504-60bdc9c5441c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:00.979256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153501c-8fa3-4976-8504-60bdc9c5441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:00.997594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d153501c-8fa3-4976-8504-60bdc9c5441c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:00.998786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d153501c-8fa3-4976-8504-60bdc9c5441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:01.071651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 509/1018] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:01.339871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c8577-6bbd-4310-bdfe-4f5999ec7da5 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:01.418055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:01.441971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c8577-6bbd-4310-bdfe-4f5999ec7da5 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:01.476294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb1442-32ce-4e75-8244-63eaf3492711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:01.477683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb1442-32ce-4e75-8244-63eaf3492711 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:01.478548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb1442-32ce-4e75-8244-63eaf3492711 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:01.478848 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb1442-32ce-4e75-8244-63eaf3492711 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:01.489006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb1442-32ce-4e75-8244-63eaf3492711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-46eb1442-32ce-4e75-8244-63eaf3492711 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:49:01.494825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:01.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:49:01.496645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:49:01.498261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 510/1019] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Sep 14 11:49:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:01.501828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153501c-8fa3-4976-8504-60bdc9c5441c None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:01.520862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:01.610020 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153501c-8fa3-4976-8504-60bdc9c5441c None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:01.646513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026c326-ccde-485c-99c9-7ba1590d1685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:01.647148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c326-ccde-485c-99c9-7ba1590d1685 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:01.647428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c326-ccde-485c-99c9-7ba1590d1685 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:01.647714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c326-ccde-485c-99c9-7ba1590d1685 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:01.648376 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026c326-ccde-485c-99c9-7ba1590d1685 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:01.648700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026c326-ccde-485c-99c9-7ba1590d1685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:01.650051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026c326-ccde-485c-99c9-7ba1590d1685 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:01.663159 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 510/1020] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Sep 14 11:49:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:01.664068 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb1442-32ce-4e75-8244-63eaf3492711 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:01.707441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c702-52eb-4241-99a0-1d6b2f3609a4 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:01.708055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c702-52eb-4241-99a0-1d6b2f3609a4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:01.708627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c702-52eb-4241-99a0-1d6b2f3609a4 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:01.710289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 511/1021] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:01.715451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f87e31-6355-4d78-9934-b73008406709 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:01.715732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f87e31-6355-4d78-9934-b73008406709 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:01.716005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f87e31-6355-4d78-9934-b73008406709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:01.736240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-36f87e31-6355-4d78-9934-b73008406709 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:01.737442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-36f87e31-6355-4d78-9934-b73008406709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:01.775791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb1442-32ce-4e75-8244-63eaf3492711 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:01.809935 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ef7b3-546d-49fa-b7b0-3d96cb3b91fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:01.810590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef7b3-546d-49fa-b7b0-3d96cb3b91fa None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:01.810870 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef7b3-546d-49fa-b7b0-3d96cb3b91fa None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:01.811197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef7b3-546d-49fa-b7b0-3d96cb3b91fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:01.814324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:01.821584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 512/1022] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:49:01.826244 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ef7b3-546d-49fa-b7b0-3d96cb3b91fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:01.826244 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ef7b3-546d-49fa-b7b0-3d96cb3b91fa None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-794ef7b3-546d-49fa-b7b0-3d96cb3b91fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:49:01.840325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:01.841320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:49:01.847019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:49:01.847019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:01.847019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:49:01.847019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 511/1023] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:49:01.849116 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f87e31-6355-4d78-9934-b73008406709 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:01.862540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:01.952063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f87e31-6355-4d78-9934-b73008406709 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:01.985420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bfb9c-213b-4edf-8c69-00abb31517e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:01.986930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bfb9c-213b-4edf-8c69-00abb31517e7 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:01.987223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bfb9c-213b-4edf-8c69-00abb31517e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:01.987504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bfb9c-213b-4edf-8c69-00abb31517e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:01.988192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bfb9c-213b-4edf-8c69-00abb31517e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:01.988503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bfb9c-213b-4edf-8c69-00abb31517e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:01.989922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bfb9c-213b-4edf-8c69-00abb31517e7 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:02.009078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 513/1024] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:02.011078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ef7b3-546d-49fa-b7b0-3d96cb3b91fa None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:02.101288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bfb9c-213b-4edf-8c69-00abb31517e7 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:02.122365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ef7b3-546d-49fa-b7b0-3d96cb3b91fa None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:02.156084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d160a43-254d-4131-acfd-92b28c3667e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:02.156722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d160a43-254d-4131-acfd-92b28c3667e5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:02.156999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d160a43-254d-4131-acfd-92b28c3667e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:02.157284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d160a43-254d-4131-acfd-92b28c3667e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:02.165471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d160a43-254d-4131-acfd-92b28c3667e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:02.166925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d160a43-254d-4131-acfd-92b28c3667e5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-8d160a43-254d-4131-acfd-92b28c3667e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:49:02.177809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:02.178792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 512/1025] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Sep 14 11:49:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:02.185762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a4010-9684-4676-99b8-b04ef36634c8 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:02.186613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:02.186689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a4010-9684-4676-99b8-b04ef36634c8 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:02.186689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a4010-9684-4676-99b8-b04ef36634c8 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:02.186689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 513/1026] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:02.187562 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a4010-9684-4676-99b8-b04ef36634c8 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:02.217778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bfb9c-213b-4edf-8c69-00abb31517e7 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:02.249675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:02.253688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197afe1-5bbd-4f65-8a40-7b7a68f38160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:02.254363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197afe1-5bbd-4f65-8a40-7b7a68f38160 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:02.254623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197afe1-5bbd-4f65-8a40-7b7a68f38160 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:02.254888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197afe1-5bbd-4f65-8a40-7b7a68f38160 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:02.258736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197afe1-5bbd-4f65-8a40-7b7a68f38160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:02.258736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197afe1-5bbd-4f65-8a40-7b7a68f38160 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:02.259032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 514/1027] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:02.260145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a632-ba00-4506-b22a-6cdec96ca473 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:02.260429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a632-ba00-4506-b22a-6cdec96ca473 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:02.260687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a632-ba00-4506-b22a-6cdec96ca473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:02.278790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2c02a632-ba00-4506-b22a-6cdec96ca473 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:02.279992 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2c02a632-ba00-4506-b22a-6cdec96ca473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:02.301965 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a4010-9684-4676-99b8-b04ef36634c8 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:02.336174 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841d353-dff0-4ef0-bb92-b6af02d5ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:02.336770 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841d353-dff0-4ef0-bb92-b6af02d5ccbc None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:02.337051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841d353-dff0-4ef0-bb92-b6af02d5ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:02.337323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841d353-dff0-4ef0-bb92-b6af02d5ccbc None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:02.338044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841d353-dff0-4ef0-bb92-b6af02d5ccbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:02.338377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841d353-dff0-4ef0-bb92-b6af02d5ccbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:02.339790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841d353-dff0-4ef0-bb92-b6af02d5ccbc None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:02.346538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 515/1028] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:02.347349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02a632-ba00-4506-b22a-6cdec96ca473 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:02.370360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 514/1029] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Sep 14 11:49:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:02.371264 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841d353-dff0-4ef0-bb92-b6af02d5ccbc None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:02.424320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:02.463575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02a632-ba00-4506-b22a-6cdec96ca473 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:02.475040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841d353-dff0-4ef0-bb92-b6af02d5ccbc None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:02.484211 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:02.511574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce522e47-53db-4941-8beb-c7e0c8baf790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:02.512181 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce522e47-53db-4941-8beb-c7e0c8baf790 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:02.512455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce522e47-53db-4941-8beb-c7e0c8baf790 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:02.512720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce522e47-53db-4941-8beb-c7e0c8baf790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:02.524893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ff4d3-9398-4b04-9d9a-c74b043afab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:02.525535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ff4d3-9398-4b04-9d9a-c74b043afab1 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:02.525820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ff4d3-9398-4b04-9d9a-c74b043afab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:02.526100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ff4d3-9398-4b04-9d9a-c74b043afab1 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:02.526832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ff4d3-9398-4b04-9d9a-c74b043afab1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:02.528277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ff4d3-9398-4b04-9d9a-c74b043afab1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:02.587276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce522e47-53db-4941-8beb-c7e0c8baf790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:02.588723 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce522e47-53db-4941-8beb-c7e0c8baf790 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:02.650052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 516/1030] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:49:02 2022] POST /identity/v3/projects => generated 311 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:49:02.650052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ff4d3-9398-4b04-9d9a-c74b043afab1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:02.697371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 515/1031] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:49:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:49:02.703808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce522e47-53db-4941-8beb-c7e0c8baf790 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:02.715098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:02.766647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ff4d3-9398-4b04-9d9a-c74b043afab1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:02.788197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:02.804688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d378f82-3b51-417f-95ec-beffdd3b4cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:02.806044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378f82-3b51-417f-95ec-beffdd3b4cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:02.806448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378f82-3b51-417f-95ec-beffdd3b4cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:02.806733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378f82-3b51-417f-95ec-beffdd3b4cd5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:02.807341 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d378f82-3b51-417f-95ec-beffdd3b4cd5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:02.808781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d378f82-3b51-417f-95ec-beffdd3b4cd5 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-3d378f82-3b51-417f-95ec-beffdd3b4cd5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:02.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:02.820087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:02.821654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 517/1032] 10.222.0.77 () {56 vars in 1105 bytes} [Wed Sep 14 11:49:02 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:02.828246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce522e47-53db-4941-8beb-c7e0c8baf790 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:02.828434 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d378f82-3b51-417f-95ec-beffdd3b4cd5 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:02.873886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604ad6-e32f-4d13-b2bb-426c5844350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:02.874557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604ad6-e32f-4d13-b2bb-426c5844350f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:02.874835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604ad6-e32f-4d13-b2bb-426c5844350f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:02.875105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604ad6-e32f-4d13-b2bb-426c5844350f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:02.889763 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df604ad6-e32f-4d13-b2bb-426c5844350f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:02.891966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df604ad6-e32f-4d13-b2bb-426c5844350f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-df604ad6-e32f-4d13-b2bb-426c5844350f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:49:02.907469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:02.908649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:49:02.909738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:49:02.909738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:02.909738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:49:02.909738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 516/1033] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:49:02.916429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604ad6-e32f-4d13-b2bb-426c5844350f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:02.944429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d378f82-3b51-417f-95ec-beffdd3b4cd5 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:02.980516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8362b-6423-4492-9ee0-411c2c1cc44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:02.981049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8362b-6423-4492-9ee0-411c2c1cc44b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:02.981329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8362b-6423-4492-9ee0-411c2c1cc44b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:02.981544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:02.981648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8362b-6423-4492-9ee0-411c2c1cc44b None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:02.982247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8362b-6423-4492-9ee0-411c2c1cc44b None admin] RBAC: Adding query filter params (name=image) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:02.982553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8362b-6423-4492-9ee0-411c2c1cc44b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:02.983915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8362b-6423-4492-9ee0-411c2c1cc44b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:02.994019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 518/1034] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:02.997449 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8362b-6423-4492-9ee0-411c2c1cc44b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:03.035343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604ad6-e32f-4d13-b2bb-426c5844350f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:03.047202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:03.074667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c48f7-5aae-4a20-b1b6-fbf7d71f6dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:03.075283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c48f7-5aae-4a20-b1b6-fbf7d71f6dbc None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:03.075551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c48f7-5aae-4a20-b1b6-fbf7d71f6dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:03.075819 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c48f7-5aae-4a20-b1b6-fbf7d71f6dbc None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:03.076468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c48f7-5aae-4a20-b1b6-fbf7d71f6dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:03.076764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c48f7-5aae-4a20-b1b6-fbf7d71f6dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:03.078130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c48f7-5aae-4a20-b1b6-fbf7d71f6dbc None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:03.094702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 517/1035] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:03.095684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c48f7-5aae-4a20-b1b6-fbf7d71f6dbc None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:03.105871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8362b-6423-4492-9ee0-411c2c1cc44b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:03.145404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c2b1d-eee9-44f3-9825-26f44685a33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:03.146188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c2b1d-eee9-44f3-9825-26f44685a33a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:03.146506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c2b1d-eee9-44f3-9825-26f44685a33a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:03.146778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c2b1d-eee9-44f3-9825-26f44685a33a None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:03.147800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c2b1d-eee9-44f3-9825-26f44685a33a None admin] RBAC: Adding query filter params (type=image) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:03.148257 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c2b1d-eee9-44f3-9825-26f44685a33a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:03.150412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c2b1d-eee9-44f3-9825-26f44685a33a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:03.155660 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 519/1036] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:03.162639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c2b1d-eee9-44f3-9825-26f44685a33a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:03.220027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c48f7-5aae-4a20-b1b6-fbf7d71f6dbc None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:03.239269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:03.260597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9417db1-4ee4-4b9b-86c6-6a5bf57a40b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:03.261309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9417db1-4ee4-4b9b-86c6-6a5bf57a40b5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:03.261587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9417db1-4ee4-4b9b-86c6-6a5bf57a40b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:03.261886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9417db1-4ee4-4b9b-86c6-6a5bf57a40b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:03.272783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9417db1-4ee4-4b9b-86c6-6a5bf57a40b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:03.275420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9417db1-4ee4-4b9b-86c6-6a5bf57a40b5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:03.286974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c2b1d-eee9-44f3-9825-26f44685a33a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-a9417db1-4ee4-4b9b-86c6-6a5bf57a40b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:49:03.297977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:03.299273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:03.300324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:49:03.300324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:49:03.300324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:49:03.300324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:49:03.300324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:49:03.300324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:49:03.300324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:49:03.300324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:49:03.300324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 518/1037] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:49:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:03.305559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:03.306250 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9417db1-4ee4-4b9b-86c6-6a5bf57a40b5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:03.334743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fcc3-bcab-41ff-86ff-a0a8542997ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:03.335472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fcc3-bcab-41ff-86ff-a0a8542997ca None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:03.335752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fcc3-bcab-41ff-86ff-a0a8542997ca None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:03.336744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fcc3-bcab-41ff-86ff-a0a8542997ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:03.337972 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115fcc3-bcab-41ff-86ff-a0a8542997ca None admin] RBAC: Adding query filter params (interface=public, service_id=4a4e7fb12f0b470c961cef0a05de97f8, region_id=RegionOne) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:03.338314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115fcc3-bcab-41ff-86ff-a0a8542997ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:03.339906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115fcc3-bcab-41ff-86ff-a0a8542997ca None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:03.346970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 520/1038] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Sep 14 11:49:03 2022] GET /identity/v3/endpoints?service_id=4a4e7fb12f0b470c961cef0a05de97f8&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:03.353682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fcc3-bcab-41ff-86ff-a0a8542997ca None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:03.426890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9417db1-4ee4-4b9b-86c6-6a5bf57a40b5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:03.467495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f425bd-0718-4159-82e4-cd94721130eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:03.468107 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f425bd-0718-4159-82e4-cd94721130eb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:03.468384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f425bd-0718-4159-82e4-cd94721130eb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:03.468655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f425bd-0718-4159-82e4-cd94721130eb None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:03.469854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f425bd-0718-4159-82e4-cd94721130eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:03.470169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f425bd-0718-4159-82e4-cd94721130eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:03.471653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f425bd-0718-4159-82e4-cd94721130eb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:03.484314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fcc3-bcab-41ff-86ff-a0a8542997ca None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:03.493246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 519/1039] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:49:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:03.499452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f425bd-0718-4159-82e4-cd94721130eb None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:03.537314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7d0d7-9355-4bba-9b77-7e6b802c8a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:03.537941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d0d7-9355-4bba-9b77-7e6b802c8a7a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:03.538308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d0d7-9355-4bba-9b77-7e6b802c8a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:03.538595 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d0d7-9355-4bba-9b77-7e6b802c8a7a None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:03.539633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7d0d7-9355-4bba-9b77-7e6b802c8a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:03.541888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7d0d7-9355-4bba-9b77-7e6b802c8a7a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:03.556384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 521/1040] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Sep 14 11:49:03 2022] GET /identity/v3/services => generated 1957 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 11:49:03.556920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:03.665657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f425bd-0718-4159-82e4-cd94721130eb None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:03.709039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901dec6-cfd6-4f15-8c84-d40ad1d16428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:03.709656 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901dec6-cfd6-4f15-8c84-d40ad1d16428 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:03.709952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901dec6-cfd6-4f15-8c84-d40ad1d16428 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:03.710231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901dec6-cfd6-4f15-8c84-d40ad1d16428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:03.710979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901dec6-cfd6-4f15-8c84-d40ad1d16428 None admin] RBAC: Adding query filter params (role.id=c9e240167ee54c9fbc8f01cfb6e7b46d, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=8882a9f2764648be9bfe4606144660d1) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:03.711309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901dec6-cfd6-4f15-8c84-d40ad1d16428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:03.713281 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901dec6-cfd6-4f15-8c84-d40ad1d16428 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:03.726457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 520/1041] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:49:03 2022] GET /identity/v3/role_assignments?user.id=8882a9f2764648be9bfe4606144660d1&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=c9e240167ee54c9fbc8f01cfb6e7b46d => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:04.925946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e885-b774-4db4-b322-e74e81dbf095 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:04.926499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e885-b774-4db4-b322-e74e81dbf095 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:04.926499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e885-b774-4db4-b322-e74e81dbf095 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:04.927885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 522/1042] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:04.933698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5112fe-7394-4230-bebe-e9cbd8d26361 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:04.934078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5112fe-7394-4230-bebe-e9cbd8d26361 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:04.934369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5112fe-7394-4230-bebe-e9cbd8d26361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:04.953317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-db5112fe-7394-4230-bebe-e9cbd8d26361 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:04.954519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-db5112fe-7394-4230-bebe-e9cbd8d26361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:05.022523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 521/1043] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:05.290246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02e885-b774-4db4-b322-e74e81dbf095 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:05.334837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:05.395079 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02e885-b774-4db4-b322-e74e81dbf095 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:05.430193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abbb44-7b32-4ff4-a101-733d2651f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:05.430947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abbb44-7b32-4ff4-a101-733d2651f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:05.431301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abbb44-7b32-4ff4-a101-733d2651f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:05.431645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abbb44-7b32-4ff4-a101-733d2651f5e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:05.432850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abbb44-7b32-4ff4-a101-733d2651f5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:05.434378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abbb44-7b32-4ff4-a101-733d2651f5e9 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:05.436191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 523/1044] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:05.442118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5112fe-7394-4230-bebe-e9cbd8d26361 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:05.474940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:05.545785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5112fe-7394-4230-bebe-e9cbd8d26361 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:05.581270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32fc99-bb3b-480f-acf7-a0ffec330734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:05.582016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32fc99-bb3b-480f-acf7-a0ffec330734 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:05.582424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32fc99-bb3b-480f-acf7-a0ffec330734 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:05.582798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32fc99-bb3b-480f-acf7-a0ffec330734 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:05.583559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32fc99-bb3b-480f-acf7-a0ffec330734 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:05.585103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32fc99-bb3b-480f-acf7-a0ffec330734 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:05.692696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 522/1045] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:49:05 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:49:05.815216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bcdc5-1ff1-4dea-bdc2-078d4f78e0c6 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:05.815216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bcdc5-1ff1-4dea-bdc2-078d4f78e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:05.815216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bcdc5-1ff1-4dea-bdc2-078d4f78e0c6 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:05.815216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 524/1046] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:05.820782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6e0a-9771-4204-8290-e7ce8e7673df None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:05.821144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6e0a-9771-4204-8290-e7ce8e7673df None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:05.821339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6e0a-9771-4204-8290-e7ce8e7673df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:05.842847 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-7ada6e0a-9771-4204-8290-e7ce8e7673df None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:05.844054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7ada6e0a-9771-4204-8290-e7ce8e7673df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:05.918830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 523/1047] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:05.928396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e2a0-7516-43a7-adf0-06c52e121529 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:05.928860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e2a0-7516-43a7-adf0-06c52e121529 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:05.928949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e2a0-7516-43a7-adf0-06c52e121529 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:05.930668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 525/1048] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:05.936007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1ae1-a86e-4cb0-88be-48af144b5405 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:05.936425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1ae1-a86e-4cb0-88be-48af144b5405 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:05.936606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc1ae1-a86e-4cb0-88be-48af144b5405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:05.956911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-4bbc1ae1-a86e-4cb0-88be-48af144b5405 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:05.958109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4bbc1ae1-a86e-4cb0-88be-48af144b5405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:05.973061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:06.033336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 524/1049] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:06.193342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e2a0-7516-43a7-adf0-06c52e121529 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:06.300684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e2a0-7516-43a7-adf0-06c52e121529 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:06.302736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1ae1-a86e-4cb0-88be-48af144b5405 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:06.313360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:06.345535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deee16-88e0-4767-806d-eabc0e3b5145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:06.347173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deee16-88e0-4767-806d-eabc0e3b5145 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:06.347173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deee16-88e0-4767-806d-eabc0e3b5145 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:06.347173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deee16-88e0-4767-806d-eabc0e3b5145 None admin] PATH_INFO: `/v3/services/image` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:06.347873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deee16-88e0-4767-806d-eabc0e3b5145 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:06.349646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deee16-88e0-4767-806d-eabc0e3b5145 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-09deee16-88e0-4767-806d-eabc0e3b5145 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:06.359530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:06.360550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:06.361412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 526/1050] 10.222.0.77 () {56 vars in 1105 bytes} [Wed Sep 14 11:49:06 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:06.367520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deee16-88e0-4767-806d-eabc0e3b5145 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:06.418643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc1ae1-a86e-4cb0-88be-48af144b5405 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:06.459724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac5192-c316-488d-aab1-828002b9efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:06.460280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac5192-c316-488d-aab1-828002b9efb6 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:06.460558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac5192-c316-488d-aab1-828002b9efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:06.460829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac5192-c316-488d-aab1-828002b9efb6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:06.472833 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac5192-c316-488d-aab1-828002b9efb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-d0ac5192-c316-488d-aab1-828002b9efb6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:49:06.477728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:06.478721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:49:06.479605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 525/1051] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Sep 14 11:49:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:06.484597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac5192-c316-488d-aab1-828002b9efb6 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:06.493538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deee16-88e0-4767-806d-eabc0e3b5145 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:06.496484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:06.533582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07f42-64eb-4a5b-85e7-603410c0c3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:06.534358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07f42-64eb-4a5b-85e7-603410c0c3bb None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:06.534644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07f42-64eb-4a5b-85e7-603410c0c3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:06.534977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07f42-64eb-4a5b-85e7-603410c0c3bb None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:06.535781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e07f42-64eb-4a5b-85e7-603410c0c3bb None admin] RBAC: Adding query filter params (name=image) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:06.536133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e07f42-64eb-4a5b-85e7-603410c0c3bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:06.538272 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e07f42-64eb-4a5b-85e7-603410c0c3bb None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:06.548836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 527/1052] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:06.550729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07f42-64eb-4a5b-85e7-603410c0c3bb None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:06.593799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:06.597535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac5192-c316-488d-aab1-828002b9efb6 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:06.637620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bd7ac-dfea-4bfa-8ce4-6db4491aa3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:06.638270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bd7ac-dfea-4bfa-8ce4-6db4491aa3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:06.638560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bd7ac-dfea-4bfa-8ce4-6db4491aa3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:06.638859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bd7ac-dfea-4bfa-8ce4-6db4491aa3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:06.639528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bd7ac-dfea-4bfa-8ce4-6db4491aa3f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:06.639889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bd7ac-dfea-4bfa-8ce4-6db4491aa3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:06.641261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bd7ac-dfea-4bfa-8ce4-6db4491aa3f3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:06.649859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 526/1053] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Sep 14 11:49:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:06.655364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bd7ac-dfea-4bfa-8ce4-6db4491aa3f3 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:06.676148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07f42-64eb-4a5b-85e7-603410c0c3bb None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:06.718241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7525d-1505-4eb0-b11b-bb21ad2491e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:06.718822 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7525d-1505-4eb0-b11b-bb21ad2491e1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:06.719043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7525d-1505-4eb0-b11b-bb21ad2491e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:06.719338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7525d-1505-4eb0-b11b-bb21ad2491e1 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:06.719967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7525d-1505-4eb0-b11b-bb21ad2491e1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:06.720269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7525d-1505-4eb0-b11b-bb21ad2491e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:06.721625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7525d-1505-4eb0-b11b-bb21ad2491e1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:06.727452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 528/1054] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:06.732712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7525d-1505-4eb0-b11b-bb21ad2491e1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:06.737362 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:06.771355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bd7ac-dfea-4bfa-8ce4-6db4491aa3f3 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:06.810517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44d14-ed46-4c05-8e40-5d1e73ca24a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:06.811151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44d14-ed46-4c05-8e40-5d1e73ca24a1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:06.811433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44d14-ed46-4c05-8e40-5d1e73ca24a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:06.811704 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44d14-ed46-4c05-8e40-5d1e73ca24a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:06.823452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44d14-ed46-4c05-8e40-5d1e73ca24a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:06.824886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44d14-ed46-4c05-8e40-5d1e73ca24a1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:06.838321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-5ed44d14-ed46-4c05-8e40-5d1e73ca24a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:49:06.840465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:06.841434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:49:06.842376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:49:06.842376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:06.842376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:49:06.842376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 527/1055] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:49:06.842754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7525d-1505-4eb0-b11b-bb21ad2491e1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:06.847192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44d14-ed46-4c05-8e40-5d1e73ca24a1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:06.881735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad6b3-67fc-437f-9952-519d6a03f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:06.882535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad6b3-67fc-437f-9952-519d6a03f219 None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:06.883424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad6b3-67fc-437f-9952-519d6a03f219 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:06.884545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ad6b3-67fc-437f-9952-519d6a03f219 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:06.885246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ad6b3-67fc-437f-9952-519d6a03f219 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:06.886674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ad6b3-67fc-437f-9952-519d6a03f219 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:06.948241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44d14-ed46-4c05-8e40-5d1e73ca24a1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:06.957395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 529/1056] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 11:49:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 11:49:06.974654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:07.006905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb78062-8376-47c7-bace-5731b7bb1f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:07.007915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb78062-8376-47c7-bace-5731b7bb1f7c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:07.008350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb78062-8376-47c7-bace-5731b7bb1f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:07.008720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb78062-8376-47c7-bace-5731b7bb1f7c None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:07.009524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb78062-8376-47c7-bace-5731b7bb1f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:07.009943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb78062-8376-47c7-bace-5731b7bb1f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:07.011535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb78062-8376-47c7-bace-5731b7bb1f7c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:07.034246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 528/1057] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:07.037241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad6b3-67fc-437f-9952-519d6a03f219 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:07.151237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ad6b3-67fc-437f-9952-519d6a03f219 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:07.185097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4fcf7-7ecb-4aef-9c7e-a5c05ce0f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:07.185733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4fcf7-7ecb-4aef-9c7e-a5c05ce0f1ac None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:07.186012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4fcf7-7ecb-4aef-9c7e-a5c05ce0f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:07.186310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4fcf7-7ecb-4aef-9c7e-a5c05ce0f1ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:07.194308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4fcf7-7ecb-4aef-9c7e-a5c05ce0f1ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:07.196161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4fcf7-7ecb-4aef-9c7e-a5c05ce0f1ac None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-f9f4fcf7-7ecb-4aef-9c7e-a5c05ce0f1ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:49:07.207620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:07.208591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:07.209573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:07.209573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:07.209573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:49:07.209573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:49:07.209573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:49:07.209573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:49:07.209573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:49:07.209573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:49:07.209573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:49:07.209573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:07.213994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 530/1058] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Sep 14 11:49:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:07.215387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb78062-8376-47c7-bace-5731b7bb1f7c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:07.315135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb78062-8376-47c7-bace-5731b7bb1f7c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:07.349360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6614ed-7d55-4ec1-9420-094f5ca23799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:07.349964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6614ed-7d55-4ec1-9420-094f5ca23799 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:07.350257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6614ed-7d55-4ec1-9420-094f5ca23799 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:07.350531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6614ed-7d55-4ec1-9420-094f5ca23799 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:07.351251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6614ed-7d55-4ec1-9420-094f5ca23799 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:07.351611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6614ed-7d55-4ec1-9420-094f5ca23799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:07.353521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6614ed-7d55-4ec1-9420-094f5ca23799 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:07.375594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 529/1059] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Sep 14 11:49:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:07.376996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4fcf7-7ecb-4aef-9c7e-a5c05ce0f1ac None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:07.395952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:07.480032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4fcf7-7ecb-4aef-9c7e-a5c05ce0f1ac None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:07.513402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c6864-4927-4791-8e2e-af60d0367359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:07.514165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c6864-4927-4791-8e2e-af60d0367359 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:07.514567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c6864-4927-4791-8e2e-af60d0367359 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:07.514952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c6864-4927-4791-8e2e-af60d0367359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:07.526064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c6864-4927-4791-8e2e-af60d0367359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:07.527635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c6864-4927-4791-8e2e-af60d0367359 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-7a4c6864-4927-4791-8e2e-af60d0367359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:49:07.541926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:07.543117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:49:07.544210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:49:07.544210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:07.544210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:07.550167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 531/1060] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:49:07.551234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6614ed-7d55-4ec1-9420-094f5ca23799 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:07.587390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:07.659688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6614ed-7d55-4ec1-9420-094f5ca23799 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:07.693413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95dbe8-041e-4b79-b85d-5ce0eb3f1bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:07.694014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95dbe8-041e-4b79-b85d-5ce0eb3f1bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:07.694313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95dbe8-041e-4b79-b85d-5ce0eb3f1bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:07.694584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95dbe8-041e-4b79-b85d-5ce0eb3f1bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:07.695804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95dbe8-041e-4b79-b85d-5ce0eb3f1bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:07.696108 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95dbe8-041e-4b79-b85d-5ce0eb3f1bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:07.697455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95dbe8-041e-4b79-b85d-5ce0eb3f1bd4 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:07.713998 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 530/1061] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:07.715462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c6864-4927-4791-8e2e-af60d0367359 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:07.783923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:07.817708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c6864-4927-4791-8e2e-af60d0367359 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:07.852611 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5b56d-c470-485c-8034-f66b06e3d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:07.853151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b56d-c470-485c-8034-f66b06e3d209 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:07.853427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b56d-c470-485c-8034-f66b06e3d209 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:07.853693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b56d-c470-485c-8034-f66b06e3d209 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:07.860542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5b56d-c470-485c-8034-f66b06e3d209 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:07.862011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5b56d-c470-485c-8034-f66b06e3d209 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-95c5b56d-c470-485c-8034-f66b06e3d209 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:49:07.875122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:07.876110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:07.877006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:49:07.877006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:49:07.877006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:49:07.877006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:49:07.877006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:49:07.877006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:49:07.877006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:49:07.877006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:07.877006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 532/1062] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:49:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:49:07.884218 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95dbe8-041e-4b79-b85d-5ce0eb3f1bd4 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:07.983105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:07.989531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95dbe8-041e-4b79-b85d-5ce0eb3f1bd4 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:08.019165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cc4e3-4231-48eb-82a4-52723dc815ab None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:08.019677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cc4e3-4231-48eb-82a4-52723dc815ab None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:08.019851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cc4e3-4231-48eb-82a4-52723dc815ab None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:08.021313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 533/1063] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:08.026933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6c1ab-4bb2-4285-8a68-3d49cde744f9 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:08.027217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6c1ab-4bb2-4285-8a68-3d49cde744f9 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:08.027493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6c1ab-4bb2-4285-8a68-3d49cde744f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:08.028258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0411c-bc36-4ffc-b14a-42942ad77c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:08.029056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0411c-bc36-4ffc-b14a-42942ad77c4e None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:08.029529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0411c-bc36-4ffc-b14a-42942ad77c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:08.029972 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0411c-bc36-4ffc-b14a-42942ad77c4e None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:08.030852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0411c-bc36-4ffc-b14a-42942ad77c4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:08.031445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0411c-bc36-4ffc-b14a-42942ad77c4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:08.033019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0411c-bc36-4ffc-b14a-42942ad77c4e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:08.045995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 531/1064] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:49:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:08.050693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-51a6c1ab-4bb2-4285-8a68-3d49cde744f9 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:08.051454 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0411c-bc36-4ffc-b14a-42942ad77c4e None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:08.051898 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-51a6c1ab-4bb2-4285-8a68-3d49cde744f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:08.127806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 534/1065] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:08.161834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0411c-bc36-4ffc-b14a-42942ad77c4e None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:08.198500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30fda7-ddbf-4cc8-9649-42be65b97147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:08.199170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30fda7-ddbf-4cc8-9649-42be65b97147 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:08.199450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30fda7-ddbf-4cc8-9649-42be65b97147 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:08.199713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30fda7-ddbf-4cc8-9649-42be65b97147 None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/8882a9f2764648be9bfe4606144660d1/roles/c9e240167ee54c9fbc8f01cfb6e7b46d` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:08.201898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30fda7-ddbf-4cc8-9649-42be65b97147 None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=8882a9f2764648be9bfe4606144660d1, role_id=c9e240167ee54c9fbc8f01cfb6e7b46d)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:08.203365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30fda7-ddbf-4cc8-9649-42be65b97147 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:08.297650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 532/1066] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:49:08 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/8882a9f2764648be9bfe4606144660d1/roles/c9e240167ee54c9fbc8f01cfb6e7b46d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 11:49:08.409389 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6c1ab-4bb2-4285-8a68-3d49cde744f9 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:08.479819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:08.522584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6c1ab-4bb2-4285-8a68-3d49cde744f9 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:08.559100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61464b-240c-421f-bb91-61b3c380bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:08.559740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61464b-240c-421f-bb91-61b3c380bab8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:08.560021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61464b-240c-421f-bb91-61b3c380bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:08.560296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61464b-240c-421f-bb91-61b3c380bab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:08.571656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61464b-240c-421f-bb91-61b3c380bab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-8e61464b-240c-421f-bb91-61b3c380bab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:49:08.576539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:08.577443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:08.578324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 535/1067] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:49:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:08.583963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30fda7-ddbf-4cc8-9649-42be65b97147 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:08.604198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:08.690998 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30fda7-ddbf-4cc8-9649-42be65b97147 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:08.725018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e6951-d237-4c4f-9ead-9b171ffc388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:08.725624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6951-d237-4c4f-9ead-9b171ffc388f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:08.725959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6951-d237-4c4f-9ead-9b171ffc388f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:08.726193 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6951-d237-4c4f-9ead-9b171ffc388f None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:08.727212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e6951-d237-4c4f-9ead-9b171ffc388f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:08.727526 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e6951-d237-4c4f-9ead-9b171ffc388f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:08.728892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e6951-d237-4c4f-9ead-9b171ffc388f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:08.742800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 533/1068] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:49:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:08.744480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61464b-240c-421f-bb91-61b3c380bab8 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:08.853558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61464b-240c-421f-bb91-61b3c380bab8 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:08.871381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:08.888447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d54ea-756d-4ad8-b9f9-ff979eb98701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:08.889082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d54ea-756d-4ad8-b9f9-ff979eb98701 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:08.889360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d54ea-756d-4ad8-b9f9-ff979eb98701 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:08.889630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d54ea-756d-4ad8-b9f9-ff979eb98701 None admin] PATH_INFO: `/v3/users/09668a6ce95845e58a0712043a034965` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:08.902760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d54ea-756d-4ad8-b9f9-ff979eb98701 None admin] RBAC: Authorizing `identity:get_user(user_id=09668a6ce95845e58a0712043a034965)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:08.904241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d54ea-756d-4ad8-b9f9-ff979eb98701 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:08.910872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 536/1069] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:08 2022] GET /identity/v3/users/09668a6ce95845e58a0712043a034965 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:08.912076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e6951-d237-4c4f-9ead-9b171ffc388f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:08.993643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:09.015650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e6951-d237-4c4f-9ead-9b171ffc388f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:09.052633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb8f5f-acc9-479d-8e04-e48918103832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:09.053262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb8f5f-acc9-479d-8e04-e48918103832 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:09.053541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb8f5f-acc9-479d-8e04-e48918103832 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:09.053812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb8f5f-acc9-479d-8e04-e48918103832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:09.124410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb8f5f-acc9-479d-8e04-e48918103832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:09.125844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb8f5f-acc9-479d-8e04-e48918103832 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:09.157601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6274621-984c-413d-9f57-5ca8abd39b65 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:09.158109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6274621-984c-413d-9f57-5ca8abd39b65 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:09.158109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6274621-984c-413d-9f57-5ca8abd39b65 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:09.159483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 537/1070] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:09.165345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77a30-ad02-42aa-a383-55a3016b9314 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:09.165632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77a30-ad02-42aa-a383-55a3016b9314 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:09.165905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77a30-ad02-42aa-a383-55a3016b9314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:09.184451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-59e77a30-ad02-42aa-a383-55a3016b9314 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:09.185648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-59e77a30-ad02-42aa-a383-55a3016b9314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:09.205985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:09.228605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 534/1071] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:49:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:49:09.234628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb8f5f-acc9-479d-8e04-e48918103832 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:09.261489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 538/1072] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:49:09.333452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb8f5f-acc9-479d-8e04-e48918103832 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:09.367937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea0d4-3fb7-471f-be64-579950343d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:09.368549 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea0d4-3fb7-471f-be64-579950343d34 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:09.368822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea0d4-3fb7-471f-be64-579950343d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:09.369088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea0d4-3fb7-471f-be64-579950343d34 None admin] PATH_INFO: `/v3/projects/e271799f4a934b9e9f99b82b3086fe1c` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:09.370188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dea0d4-3fb7-471f-be64-579950343d34 None admin] RBAC: Authorizing `identity:get_project(project_id=e271799f4a934b9e9f99b82b3086fe1c)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:09.371625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dea0d4-3fb7-471f-be64-579950343d34 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:09.378336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 535/1073] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:49:09 2022] GET /identity/v3/projects/e271799f4a934b9e9f99b82b3086fe1c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:09.379368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e77a30-ad02-42aa-a383-55a3016b9314 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:09.477959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e77a30-ad02-42aa-a383-55a3016b9314 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:09.485088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:09.512457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b54660-5324-405d-8d7b-8ce4957c937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:09.512991 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b54660-5324-405d-8d7b-8ce4957c937a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:09.513265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b54660-5324-405d-8d7b-8ce4957c937a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:09.513531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b54660-5324-405d-8d7b-8ce4957c937a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:09.514270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b54660-5324-405d-8d7b-8ce4957c937a None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=e271799f4a934b9e9f99b82b3086fe1c, user.id=09668a6ce95845e58a0712043a034965) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:09.514643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b54660-5324-405d-8d7b-8ce4957c937a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:09.516049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b54660-5324-405d-8d7b-8ce4957c937a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:09.533736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 539/1074] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:49:09 2022] GET /identity/v3/role_assignments?user.id=09668a6ce95845e58a0712043a034965&scope.project.id=e271799f4a934b9e9f99b82b3086fe1c&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:09.539518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea0d4-3fb7-471f-be64-579950343d34 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:09.592857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:09.662695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea0d4-3fb7-471f-be64-579950343d34 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:09.699713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c1f15-1ce4-48bc-aba2-631e78f82c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:09.700330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c1f15-1ce4-48bc-aba2-631e78f82c52 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:09.700606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c1f15-1ce4-48bc-aba2-631e78f82c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:09.700871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c1f15-1ce4-48bc-aba2-631e78f82c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:09.770536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c1f15-1ce4-48bc-aba2-631e78f82c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:09.771900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c1f15-1ce4-48bc-aba2-631e78f82c52 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:09.817572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:09.872546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 536/1075] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:49:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:49:09.878127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b54660-5324-405d-8d7b-8ce4957c937a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:09.979367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b54660-5324-405d-8d7b-8ce4957c937a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:10.016853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b38b0-7518-4569-9efc-7d7b1e02d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:10.017489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b38b0-7518-4569-9efc-7d7b1e02d69c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:10.017766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b38b0-7518-4569-9efc-7d7b1e02d69c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:10.018033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b38b0-7518-4569-9efc-7d7b1e02d69c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:10.028321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b38b0-7518-4569-9efc-7d7b1e02d69c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:10.029682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b38b0-7518-4569-9efc-7d7b1e02d69c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-772b38b0-7518-4569-9efc-7d7b1e02d69c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:49:10.044187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:10.045183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:49:10.046117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:49:10.046117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:10.046117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:10.046117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 540/1076] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:49:10.052448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c1f15-1ce4-48bc-aba2-631e78f82c52 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:10.153628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c1f15-1ce4-48bc-aba2-631e78f82c52 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:10.188032 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269edd0-9386-4a0c-9898-637bb3eeacc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:10.188639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269edd0-9386-4a0c-9898-637bb3eeacc5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:10.188909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269edd0-9386-4a0c-9898-637bb3eeacc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:10.189173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269edd0-9386-4a0c-9898-637bb3eeacc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:10.190076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269edd0-9386-4a0c-9898-637bb3eeacc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:10.190402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269edd0-9386-4a0c-9898-637bb3eeacc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:10.191754 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269edd0-9386-4a0c-9898-637bb3eeacc5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:10.210253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 537/1077] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:10.471031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdedefa-4752-4e84-a619-7226dc1ce173 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:10.471552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdedefa-4752-4e84-a619-7226dc1ce173 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:10.471664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdedefa-4752-4e84-a619-7226dc1ce173 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:10.473063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 541/1078] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:10.478313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0ac1-a32a-4f32-ba3e-5ee84373036c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:10.478605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0ac1-a32a-4f32-ba3e-5ee84373036c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:10.478882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0ac1-a32a-4f32-ba3e-5ee84373036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:10.493146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:10.500403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-637b0ac1-a32a-4f32-ba3e-5ee84373036c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:10.510183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-637b0ac1-a32a-4f32-ba3e-5ee84373036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:10.569939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 538/1079] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:10.833355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdedefa-4752-4e84-a619-7226dc1ce173 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:10.858284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:10.935067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdedefa-4752-4e84-a619-7226dc1ce173 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:10.969940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d5709-8bb1-44fc-8cb1-7f4be7ca84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:10.970598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5709-8bb1-44fc-8cb1-7f4be7ca84fa None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:10.970881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5709-8bb1-44fc-8cb1-7f4be7ca84fa None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:10.971157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5709-8bb1-44fc-8cb1-7f4be7ca84fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:10.981444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d5709-8bb1-44fc-8cb1-7f4be7ca84fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-426d5709-8bb1-44fc-8cb1-7f4be7ca84fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:49:10.986307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:10.987535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:10.988429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 542/1080] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Sep 14 11:49:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:10.993854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0ac1-a32a-4f32-ba3e-5ee84373036c None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:11.090511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0ac1-a32a-4f32-ba3e-5ee84373036c None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:11.123692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d977ec4-5f5d-417f-8cc3-305fb18134e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:11.124311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d977ec4-5f5d-417f-8cc3-305fb18134e6 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:11.124681 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d977ec4-5f5d-417f-8cc3-305fb18134e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:11.124955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d977ec4-5f5d-417f-8cc3-305fb18134e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:11.125618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d977ec4-5f5d-417f-8cc3-305fb18134e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:11.125918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d977ec4-5f5d-417f-8cc3-305fb18134e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:11.127321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d977ec4-5f5d-417f-8cc3-305fb18134e6 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:11.129465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:11.136175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 539/1081] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Sep 14 11:49:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:11.141975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d5709-8bb1-44fc-8cb1-7f4be7ca84fa None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:11.222136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:11.240304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d5709-8bb1-44fc-8cb1-7f4be7ca84fa None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:11.273770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653246eb-3b6d-4d61-ade1-0efd2e24bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:11.274427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653246eb-3b6d-4d61-ade1-0efd2e24bef7 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:11.274711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653246eb-3b6d-4d61-ade1-0efd2e24bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:11.274985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653246eb-3b6d-4d61-ade1-0efd2e24bef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:11.285329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653246eb-3b6d-4d61-ade1-0efd2e24bef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:11.286794 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653246eb-3b6d-4d61-ade1-0efd2e24bef7 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-653246eb-3b6d-4d61-ade1-0efd2e24bef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:49:11.301296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:11.302287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:49:11.303187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:49:11.303187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:11.303187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:11.303187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 543/1082] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:11.308318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d977ec4-5f5d-417f-8cc3-305fb18134e6 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:11.407728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d977ec4-5f5d-417f-8cc3-305fb18134e6 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:11.440805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae11d67-6bc3-4108-bfc8-64cd967e54bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:11.441409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae11d67-6bc3-4108-bfc8-64cd967e54bb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:11.441688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae11d67-6bc3-4108-bfc8-64cd967e54bb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:11.441961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae11d67-6bc3-4108-bfc8-64cd967e54bb None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:11.442629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae11d67-6bc3-4108-bfc8-64cd967e54bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:11.442932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae11d67-6bc3-4108-bfc8-64cd967e54bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:11.444286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae11d67-6bc3-4108-bfc8-64cd967e54bb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:11.456279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 540/1083] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:11.462438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653246eb-3b6d-4d61-ade1-0efd2e24bef7 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:11.560893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653246eb-3b6d-4d61-ade1-0efd2e24bef7 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:11.599431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f23db-1cb6-4c81-b2e9-df9387c4542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:11.600068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f23db-1cb6-4c81-b2e9-df9387c4542b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:11.600350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f23db-1cb6-4c81-b2e9-df9387c4542b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:11.600625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f23db-1cb6-4c81-b2e9-df9387c4542b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:11.603250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:11.609451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f23db-1cb6-4c81-b2e9-df9387c4542b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:11.616492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f23db-1cb6-4c81-b2e9-df9387c4542b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-e46f23db-1cb6-4c81-b2e9-df9387c4542b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:49:11.622400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:11.623383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:11.624358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 544/1084] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Sep 14 11:49:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:11.629268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae11d67-6bc3-4108-bfc8-64cd967e54bb None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:11.681108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc4cd-032f-4f13-a376-a2509490d11e None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:11.681300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc4cd-032f-4f13-a376-a2509490d11e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:11.681570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc4cd-032f-4f13-a376-a2509490d11e None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:11.682947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 545/1085] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 11:49:11.687724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeca7cf-9255-4fdb-abd7-6c58c449835d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:11.687863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:11.688003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeca7cf-9255-4fdb-abd7-6c58c449835d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:11.688265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeca7cf-9255-4fdb-abd7-6c58c449835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:11.707791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-eeeca7cf-9255-4fdb-abd7-6c58c449835d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:11.709042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-eeeca7cf-9255-4fdb-abd7-6c58c449835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:11.729737 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae11d67-6bc3-4108-bfc8-64cd967e54bb None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:11.762670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bd617-1a09-4d1f-ad73-52f385671607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:11.763263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bd617-1a09-4d1f-ad73-52f385671607 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:11.763557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bd617-1a09-4d1f-ad73-52f385671607 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:11.763809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bd617-1a09-4d1f-ad73-52f385671607 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:11.764523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bd617-1a09-4d1f-ad73-52f385671607 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:11.764828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bd617-1a09-4d1f-ad73-52f385671607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:11.766256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bd617-1a09-4d1f-ad73-52f385671607 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:11.776445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 546/1086] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:49:11.788106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 541/1087] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Sep 14 11:49:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:11.789603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeca7cf-9255-4fdb-abd7-6c58c449835d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:11.884221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeca7cf-9255-4fdb-abd7-6c58c449835d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:11.906684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:11.916927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80731ae0-72cd-4334-8321-b428c3703027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:11.917517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80731ae0-72cd-4334-8321-b428c3703027 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:11.917792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80731ae0-72cd-4334-8321-b428c3703027 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:11.918057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80731ae0-72cd-4334-8321-b428c3703027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:11.982406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80731ae0-72cd-4334-8321-b428c3703027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:11.983769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80731ae0-72cd-4334-8321-b428c3703027 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:12.043467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bd617-1a09-4d1f-ad73-52f385671607 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:12.080592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 547/1088] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:49:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:49:12.087054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80731ae0-72cd-4334-8321-b428c3703027 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:12.110284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:12.143984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bd617-1a09-4d1f-ad73-52f385671607 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:12.160523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:12.177222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3611-a61f-40df-b17f-9965d76f015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:12.177846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3611-a61f-40df-b17f-9965d76f015a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:12.178120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3611-a61f-40df-b17f-9965d76f015a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:12.178420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3611-a61f-40df-b17f-9965d76f015a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:12.183262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80731ae0-72cd-4334-8321-b428c3703027 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:12.188225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a3611-a61f-40df-b17f-9965d76f015a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-867a3611-a61f-40df-b17f-9965d76f015a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:49:12.193235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:12.194375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:49:12.195976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 542/1089] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:49:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:49:12.201496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3611-a61f-40df-b17f-9965d76f015a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:12.221887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc528a7-bd57-4d8b-838d-b5adcfdbf700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:12.222548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc528a7-bd57-4d8b-838d-b5adcfdbf700 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:12.222824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc528a7-bd57-4d8b-838d-b5adcfdbf700 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:12.223142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc528a7-bd57-4d8b-838d-b5adcfdbf700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:12.233190 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc528a7-bd57-4d8b-838d-b5adcfdbf700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:12.234584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc528a7-bd57-4d8b-838d-b5adcfdbf700 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-5dc528a7-bd57-4d8b-838d-b5adcfdbf700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:49:12.249381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:12.250463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:49:12.251785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:49:12.251785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:49:12.251785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:12.251785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 548/1090] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:49:12.256047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc528a7-bd57-4d8b-838d-b5adcfdbf700 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:12.302980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3611-a61f-40df-b17f-9965d76f015a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:12.334111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:12.337276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1781e-824a-41b3-979b-c8da437baa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:12.337880 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1781e-824a-41b3-979b-c8da437baa15 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:12.338159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1781e-824a-41b3-979b-c8da437baa15 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:12.338463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1781e-824a-41b3-979b-c8da437baa15 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:12.339128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1781e-824a-41b3-979b-c8da437baa15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:12.339434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1781e-824a-41b3-979b-c8da437baa15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:12.340795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1781e-824a-41b3-979b-c8da437baa15 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:12.348841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 543/1091] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:49:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:12.354957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1781e-824a-41b3-979b-c8da437baa15 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:12.356493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc528a7-bd57-4d8b-838d-b5adcfdbf700 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:12.391097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974e5f2-23e5-4dce-9919-fe09a32a2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:12.391700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974e5f2-23e5-4dce-9919-fe09a32a2e6a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:12.391982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974e5f2-23e5-4dce-9919-fe09a32a2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:12.392255 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974e5f2-23e5-4dce-9919-fe09a32a2e6a None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:12.392897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974e5f2-23e5-4dce-9919-fe09a32a2e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:12.393205 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974e5f2-23e5-4dce-9919-fe09a32a2e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:12.394591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974e5f2-23e5-4dce-9919-fe09a32a2e6a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:12.394859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:12.407539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 549/1092] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:12.413227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974e5f2-23e5-4dce-9919-fe09a32a2e6a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:12.454711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1781e-824a-41b3-979b-c8da437baa15 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:12.488233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccce44b-cd08-4b17-b13f-1b1962d5f82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:12.488787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccce44b-cd08-4b17-b13f-1b1962d5f82b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:12.489065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccce44b-cd08-4b17-b13f-1b1962d5f82b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:12.489398 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccce44b-cd08-4b17-b13f-1b1962d5f82b None admin] PATH_INFO: `/v3/users/09668a6ce95845e58a0712043a034965` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:12.490569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccce44b-cd08-4b17-b13f-1b1962d5f82b None admin] RBAC: Authorizing `identity:get_user(user_id=09668a6ce95845e58a0712043a034965)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:12.492719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccce44b-cd08-4b17-b13f-1b1962d5f82b None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:12.494311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 544/1093] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:12 2022] GET /identity/v3/users/09668a6ce95845e58a0712043a034965 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:12.499853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccce44b-cd08-4b17-b13f-1b1962d5f82b None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:12.511599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974e5f2-23e5-4dce-9919-fe09a32a2e6a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:12.546453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9b1ad-bf90-48e4-be99-6bd43da8bf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:12.547080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9b1ad-bf90-48e4-be99-6bd43da8bf4a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:12.547362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9b1ad-bf90-48e4-be99-6bd43da8bf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:12.547633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9b1ad-bf90-48e4-be99-6bd43da8bf4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:12.550305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:12.554719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9b1ad-bf90-48e4-be99-6bd43da8bf4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:12.556321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9b1ad-bf90-48e4-be99-6bd43da8bf4a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-71b9b1ad-bf90-48e4-be99-6bd43da8bf4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:49:12.567651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:12.569125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:12.570060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:49:12.570060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:49:12.570060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:49:12.570060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:49:12.570060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:49:12.570060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:49:12.570060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:49:12.570060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:12.570060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 550/1094] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:49:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:49:12.574536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9b1ad-bf90-48e4-be99-6bd43da8bf4a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:12.610875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccce44b-cd08-4b17-b13f-1b1962d5f82b None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:12.618107 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:12.644817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46282d4-9088-405c-b940-7dd82ccf8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:12.645444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46282d4-9088-405c-b940-7dd82ccf8e47 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:12.645726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46282d4-9088-405c-b940-7dd82ccf8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:12.645996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46282d4-9088-405c-b940-7dd82ccf8e47 None admin] PATH_INFO: `/v3/projects/e271799f4a934b9e9f99b82b3086fe1c` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:12.647139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46282d4-9088-405c-b940-7dd82ccf8e47 None admin] RBAC: Authorizing `identity:get_project(project_id=e271799f4a934b9e9f99b82b3086fe1c)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:12.649133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46282d4-9088-405c-b940-7dd82ccf8e47 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:12.650788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 545/1095] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:49:12 2022] GET /identity/v3/projects/e271799f4a934b9e9f99b82b3086fe1c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:12.656540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46282d4-9088-405c-b940-7dd82ccf8e47 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:12.678697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9b1ad-bf90-48e4-be99-6bd43da8bf4a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:12.713027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95600032-a684-4d25-a3f3-6ed0992408a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:12.713640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95600032-a684-4d25-a3f3-6ed0992408a1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:12.713922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95600032-a684-4d25-a3f3-6ed0992408a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:12.714196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95600032-a684-4d25-a3f3-6ed0992408a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:12.714919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95600032-a684-4d25-a3f3-6ed0992408a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:12.715223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95600032-a684-4d25-a3f3-6ed0992408a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:12.716649 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95600032-a684-4d25-a3f3-6ed0992408a1 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:12.728869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 551/1096] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:49:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:12.734845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95600032-a684-4d25-a3f3-6ed0992408a1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:12.754641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46282d4-9088-405c-b940-7dd82ccf8e47 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:12.788513 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fd646-cf52-4b3b-8a86-5b7e22a11832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:12.789465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd646-cf52-4b3b-8a86-5b7e22a11832 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:12.789734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:12.789863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd646-cf52-4b3b-8a86-5b7e22a11832 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:12.789991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fd646-cf52-4b3b-8a86-5b7e22a11832 None admin] PATH_INFO: `/v3/projects/e271799f4a934b9e9f99b82b3086fe1c/users/09668a6ce95845e58a0712043a034965/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:12.792054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fd646-cf52-4b3b-8a86-5b7e22a11832 None admin] RBAC: Authorizing `identity:create_grant(project_id=e271799f4a934b9e9f99b82b3086fe1c, user_id=09668a6ce95845e58a0712043a034965, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:12.793466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fd646-cf52-4b3b-8a86-5b7e22a11832 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:12.832718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95600032-a684-4d25-a3f3-6ed0992408a1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:12.866362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b9cc6-8270-495d-b3e0-ecd4d0bf0828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:12.867615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9cc6-8270-495d-b3e0-ecd4d0bf0828 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:12.867903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9cc6-8270-495d-b3e0-ecd4d0bf0828 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:12.868173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9cc6-8270-495d-b3e0-ecd4d0bf0828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:12.868896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b9cc6-8270-495d-b3e0-ecd4d0bf0828 None admin] RBAC: Adding query filter params (role.id=c9e240167ee54c9fbc8f01cfb6e7b46d, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=8882a9f2764648be9bfe4606144660d1) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:12.869208 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b9cc6-8270-495d-b3e0-ecd4d0bf0828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:12.870660 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b9cc6-8270-495d-b3e0-ecd4d0bf0828 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:12.876281 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 552/1097] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:49:12 2022] GET /identity/v3/role_assignments?user.id=8882a9f2764648be9bfe4606144660d1&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=c9e240167ee54c9fbc8f01cfb6e7b46d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:12.881021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 546/1098] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:49:12 2022] PUT /identity/v3/projects/e271799f4a934b9e9f99b82b3086fe1c/users/09668a6ce95845e58a0712043a034965/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 11:49:15.032088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c79433-db59-4acc-9b51-76e043cf3527 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:15.032621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c79433-db59-4acc-9b51-76e043cf3527 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:15.032621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c79433-db59-4acc-9b51-76e043cf3527 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:15.033977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 553/1099] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:15.039741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90633033-ceae-4928-90d8-8cc0df3d3591 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:15.040137 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90633033-ceae-4928-90d8-8cc0df3d3591 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:15.040277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90633033-ceae-4928-90d8-8cc0df3d3591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:15.058594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-90633033-ceae-4928-90d8-8cc0df3d3591 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:15.059767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-90633033-ceae-4928-90d8-8cc0df3d3591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:15.085635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:15.124944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 547/1100] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:15.394003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c79433-db59-4acc-9b51-76e043cf3527 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:15.490393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c79433-db59-4acc-9b51-76e043cf3527 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:15.510215 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:15.523313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b18b8-6908-4870-bf8c-b9d890884304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:15.523985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b18b8-6908-4870-bf8c-b9d890884304 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:15.524260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b18b8-6908-4870-bf8c-b9d890884304 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:15.524528 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b18b8-6908-4870-bf8c-b9d890884304 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:15.534038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b18b8-6908-4870-bf8c-b9d890884304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-0a5b18b8-6908-4870-bf8c-b9d890884304 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:49:15.539463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:15.540573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:15.541839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 554/1101] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:49:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:15.546742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90633033-ceae-4928-90d8-8cc0df3d3591 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:15.643038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90633033-ceae-4928-90d8-8cc0df3d3591 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:15.675855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c9558-5c49-44c2-b240-336de264ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:15.676451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c9558-5c49-44c2-b240-336de264ba23 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:15.676726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c9558-5c49-44c2-b240-336de264ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:15.676994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c9558-5c49-44c2-b240-336de264ba23 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:15.677648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c9558-5c49-44c2-b240-336de264ba23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:15.677945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c9558-5c49-44c2-b240-336de264ba23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:15.679964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c9558-5c49-44c2-b240-336de264ba23 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:15.688029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 548/1102] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:49:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:15.694283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b18b8-6908-4870-bf8c-b9d890884304 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:15.793292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b18b8-6908-4870-bf8c-b9d890884304 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:15.827214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18c49b-aaa2-40f2-bf89-a7e6a3123730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:15.827837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18c49b-aaa2-40f2-bf89-a7e6a3123730 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:15.828117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18c49b-aaa2-40f2-bf89-a7e6a3123730 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:15.828390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18c49b-aaa2-40f2-bf89-a7e6a3123730 None admin] PATH_INFO: `/v3/users/09668a6ce95845e58a0712043a034965` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:15.829505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18c49b-aaa2-40f2-bf89-a7e6a3123730 None admin] RBAC: Authorizing `identity:get_user(user_id=09668a6ce95845e58a0712043a034965)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:15.830990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18c49b-aaa2-40f2-bf89-a7e6a3123730 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:15.832549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 555/1103] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:15 2022] GET /identity/v3/users/09668a6ce95845e58a0712043a034965 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:15.838902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c9558-5c49-44c2-b240-336de264ba23 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:15.867439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:15.938771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c9558-5c49-44c2-b240-336de264ba23 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:15.972986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3065291-1d95-40a0-a6bc-835237c85fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:15.979006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3065291-1d95-40a0-a6bc-835237c85fcd None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:15.979006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3065291-1d95-40a0-a6bc-835237c85fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:15.979006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3065291-1d95-40a0-a6bc-835237c85fcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:16.039456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3065291-1d95-40a0-a6bc-835237c85fcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:16.040890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3065291-1d95-40a0-a6bc-835237c85fcd None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:16.066484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:16.137032 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 549/1104] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:49:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:49:16.142950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18c49b-aaa2-40f2-bf89-a7e6a3123730 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:16.190701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:16.239629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18c49b-aaa2-40f2-bf89-a7e6a3123730 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:16.272500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a4e1e-d8b2-460b-b42c-0b7f6e1dd746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:16.273623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4e1e-d8b2-460b-b42c-0b7f6e1dd746 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:16.273896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4e1e-d8b2-460b-b42c-0b7f6e1dd746 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:16.274163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4e1e-d8b2-460b-b42c-0b7f6e1dd746 None admin] PATH_INFO: `/v3/projects/e271799f4a934b9e9f99b82b3086fe1c` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:16.275374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a4e1e-d8b2-460b-b42c-0b7f6e1dd746 None admin] RBAC: Authorizing `identity:get_project(project_id=e271799f4a934b9e9f99b82b3086fe1c)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:16.276903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a4e1e-d8b2-460b-b42c-0b7f6e1dd746 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:16.278539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 556/1105] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:49:16 2022] GET /identity/v3/projects/e271799f4a934b9e9f99b82b3086fe1c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:16.284791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3065291-1d95-40a0-a6bc-835237c85fcd None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:16.381092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3065291-1d95-40a0-a6bc-835237c85fcd None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:16.406301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:16.415146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6b679-f4ea-4741-9016-ecddab803dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:16.419350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6b679-f4ea-4741-9016-ecddab803dbf None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:16.419350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6b679-f4ea-4741-9016-ecddab803dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:16.419350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6b679-f4ea-4741-9016-ecddab803dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:16.419350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6b679-f4ea-4741-9016-ecddab803dbf None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=e271799f4a934b9e9f99b82b3086fe1c, user.id=09668a6ce95845e58a0712043a034965) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:16.419350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6b679-f4ea-4741-9016-ecddab803dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:16.419350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6b679-f4ea-4741-9016-ecddab803dbf None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:16.425298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 550/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:49:16 2022] GET /identity/v3/role_assignments?user.id=09668a6ce95845e58a0712043a034965&scope.project.id=e271799f4a934b9e9f99b82b3086fe1c&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:18.574751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eaf8e-09f9-46fd-996e-a118307fb766 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:18.575275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eaf8e-09f9-46fd-996e-a118307fb766 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:18.575275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eaf8e-09f9-46fd-996e-a118307fb766 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:18.576647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 557/1107] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:18.582110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbdd67-3ac7-4954-a4f7-df0e8ac7d45b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:18.582565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbdd67-3ac7-4954-a4f7-df0e8ac7d45b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:18.582687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbdd67-3ac7-4954-a4f7-df0e8ac7d45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:18.601923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-edfbdd67-3ac7-4954-a4f7-df0e8ac7d45b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:18.603148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-edfbdd67-3ac7-4954-a4f7-df0e8ac7d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:18.668135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 551/1108] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:18.954704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993eaf8e-09f9-46fd-996e-a118307fb766 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:19.054862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993eaf8e-09f9-46fd-996e-a118307fb766 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:19.071489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:19.088738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db319113-5d5c-4901-8407-10f35f4dea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:19.089367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319113-5d5c-4901-8407-10f35f4dea6e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:19.089651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319113-5d5c-4901-8407-10f35f4dea6e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:19.089925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319113-5d5c-4901-8407-10f35f4dea6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:19.091094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db319113-5d5c-4901-8407-10f35f4dea6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:19.092520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db319113-5d5c-4901-8407-10f35f4dea6e None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:19.094093 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 558/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:19.100242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbdd67-3ac7-4954-a4f7-df0e8ac7d45b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:19.196536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbdd67-3ac7-4954-a4f7-df0e8ac7d45b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:19.216187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:19.229936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec1ab9-b4a5-4e12-952e-abe0ab9798ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:19.230559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec1ab9-b4a5-4e12-952e-abe0ab9798ea None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:19.230840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec1ab9-b4a5-4e12-952e-abe0ab9798ea None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:19.231114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec1ab9-b4a5-4e12-952e-abe0ab9798ea None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:19.231768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec1ab9-b4a5-4e12-952e-abe0ab9798ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:19.233188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec1ab9-b4a5-4e12-952e-abe0ab9798ea None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:19.349258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 552/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:49:19 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:49:21.536774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762a19b-37d0-498d-bbdb-817c27c2016f None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:21.537346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762a19b-37d0-498d-bbdb-817c27c2016f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:21.537346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762a19b-37d0-498d-bbdb-817c27c2016f None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:21.539447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 559/1111] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:21.544489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcef60-f393-4a26-bee4-156461db44b1 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:21.544903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcef60-f393-4a26-bee4-156461db44b1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:21.545039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcef60-f393-4a26-bee4-156461db44b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:21.563010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-13fcef60-f393-4a26-bee4-156461db44b1 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:21.564457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-13fcef60-f393-4a26-bee4-156461db44b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:21.630517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 553/1112] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:21.902162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762a19b-37d0-498d-bbdb-817c27c2016f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:22.002326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762a19b-37d0-498d-bbdb-817c27c2016f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:22.035696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4e31e-47be-40fe-aa94-32cb43f862af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:22.036316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4e31e-47be-40fe-aa94-32cb43f862af None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:22.036593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4e31e-47be-40fe-aa94-32cb43f862af None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:22.036864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4e31e-47be-40fe-aa94-32cb43f862af None admin] PATH_INFO: `/v3/roles/08735f4fc39148328610ad98ba651850` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:22.038265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4e31e-47be-40fe-aa94-32cb43f862af None admin] RBAC: Authorizing `identity:get_role(role_id=08735f4fc39148328610ad98ba651850)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:22.039612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4e31e-47be-40fe-aa94-32cb43f862af None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:22.040945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 560/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:21 2022] GET /identity/v3/roles/08735f4fc39148328610ad98ba651850 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:22.046835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcef60-f393-4a26-bee4-156461db44b1 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:22.143521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcef60-f393-4a26-bee4-156461db44b1 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:22.151493 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:22.177088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759d3e-f6b9-4c92-8f69-11ffb0c7188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:22.177644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759d3e-f6b9-4c92-8f69-11ffb0c7188f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:22.177923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759d3e-f6b9-4c92-8f69-11ffb0c7188f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:22.178195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759d3e-f6b9-4c92-8f69-11ffb0c7188f None admin] PATH_INFO: `/v3/users/fdf2ab849ee24fa69ad0621764def69f` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:22.193614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59759d3e-f6b9-4c92-8f69-11ffb0c7188f None admin] RBAC: Authorizing `identity:get_user(user_id=fdf2ab849ee24fa69ad0621764def69f)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:22.195516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59759d3e-f6b9-4c92-8f69-11ffb0c7188f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:22.197245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 554/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:22 2022] GET /identity/v3/users/fdf2ab849ee24fa69ad0621764def69f => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:49:22.203728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4e31e-47be-40fe-aa94-32cb43f862af None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:22.255654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:22.301236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4e31e-47be-40fe-aa94-32cb43f862af None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:22.335183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aae498-d7d3-4f0c-926a-9e28def57e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:22.335946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aae498-d7d3-4f0c-926a-9e28def57e8a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:22.336223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aae498-d7d3-4f0c-926a-9e28def57e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:22.336495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aae498-d7d3-4f0c-926a-9e28def57e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:22.399673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aae498-d7d3-4f0c-926a-9e28def57e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:22.401090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aae498-d7d3-4f0c-926a-9e28def57e8a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:22.450127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:22.496137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 561/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:49:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:49:22.505815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759d3e-f6b9-4c92-8f69-11ffb0c7188f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:22.602728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759d3e-f6b9-4c92-8f69-11ffb0c7188f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:22.635840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2a23b-6a54-457f-becb-1c9affc84630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:22.636461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a23b-6a54-457f-becb-1c9affc84630 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:22.636735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a23b-6a54-457f-becb-1c9affc84630 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:22.637001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a23b-6a54-457f-becb-1c9affc84630 None admin] PATH_INFO: `/v3/projects/e271799f4a934b9e9f99b82b3086fe1c` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:22.638098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2a23b-6a54-457f-becb-1c9affc84630 None admin] RBAC: Authorizing `identity:get_project(project_id=e271799f4a934b9e9f99b82b3086fe1c)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:22.639547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2a23b-6a54-457f-becb-1c9affc84630 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:22.641163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 555/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:49:22 2022] GET /identity/v3/projects/e271799f4a934b9e9f99b82b3086fe1c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:22.647328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aae498-d7d3-4f0c-926a-9e28def57e8a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:22.744600 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aae498-d7d3-4f0c-926a-9e28def57e8a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:22.777047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d26065-041b-4c37-ba8b-116f7b51f1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:22.777640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26065-041b-4c37-ba8b-116f7b51f1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:22.777912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26065-041b-4c37-ba8b-116f7b51f1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:22.778179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26065-041b-4c37-ba8b-116f7b51f1f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:22.778945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d26065-041b-4c37-ba8b-116f7b51f1f8 None admin] RBAC: Adding query filter params (role.id=08735f4fc39148328610ad98ba651850, scope.project.id=e271799f4a934b9e9f99b82b3086fe1c, user.id=fdf2ab849ee24fa69ad0621764def69f) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:22.779246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d26065-041b-4c37-ba8b-116f7b51f1f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:22.780644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d26065-041b-4c37-ba8b-116f7b51f1f8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:22.785728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 562/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:49:22 2022] GET /identity/v3/role_assignments?user.id=fdf2ab849ee24fa69ad0621764def69f&scope.project.id=e271799f4a934b9e9f99b82b3086fe1c&role.id=08735f4fc39148328610ad98ba651850 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:24.878030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7400af-a255-48cc-95a6-70132fa0c71c None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:24.878575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7400af-a255-48cc-95a6-70132fa0c71c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:24.878665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7400af-a255-48cc-95a6-70132fa0c71c None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:24.879952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 556/1118] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:24.885348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ed99a-c4c4-43f7-93cb-22db1f3c0144 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:24.885838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ed99a-c4c4-43f7-93cb-22db1f3c0144 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:24.885937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ed99a-c4c4-43f7-93cb-22db1f3c0144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:24.903960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-792ed99a-c4c4-43f7-93cb-22db1f3c0144 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:24.905147 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-792ed99a-c4c4-43f7-93cb-22db1f3c0144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:24.916035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:24.970760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 563/1119] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:25.240019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7400af-a255-48cc-95a6-70132fa0c71c None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:25.270280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:25.338462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7400af-a255-48cc-95a6-70132fa0c71c None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:25.371031 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cb40b-5f08-4475-b387-0947f184a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:25.371645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cb40b-5f08-4475-b387-0947f184a384 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:25.371920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cb40b-5f08-4475-b387-0947f184a384 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:25.372191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cb40b-5f08-4475-b387-0947f184a384 None admin] PATH_INFO: `/v3/roles/08735f4fc39148328610ad98ba651850` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:25.373557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cb40b-5f08-4475-b387-0947f184a384 None admin] RBAC: Authorizing `identity:get_role(role_id=08735f4fc39148328610ad98ba651850)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:25.374930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cb40b-5f08-4475-b387-0947f184a384 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:25.376232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 557/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:25 2022] GET /identity/v3/roles/08735f4fc39148328610ad98ba651850 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:25.382731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ed99a-c4c4-43f7-93cb-22db1f3c0144 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:25.477284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ed99a-c4c4-43f7-93cb-22db1f3c0144 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:25.509946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340a083-f276-4b11-b717-ab6fc8d203ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:25.510528 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340a083-f276-4b11-b717-ab6fc8d203ae None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:25.510805 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340a083-f276-4b11-b717-ab6fc8d203ae None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:25.511075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340a083-f276-4b11-b717-ab6fc8d203ae None admin] PATH_INFO: `/v3/users/fdf2ab849ee24fa69ad0621764def69f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:25.512163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340a083-f276-4b11-b717-ab6fc8d203ae None admin] RBAC: Authorizing `identity:get_user(user_id=fdf2ab849ee24fa69ad0621764def69f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:25.513574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340a083-f276-4b11-b717-ab6fc8d203ae None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:25.515143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 564/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:25 2022] GET /identity/v3/users/fdf2ab849ee24fa69ad0621764def69f => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:25.521039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cb40b-5f08-4475-b387-0947f184a384 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:25.615960 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:25.619347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cb40b-5f08-4475-b387-0947f184a384 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:25.653146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed540b4-e378-40f0-8be5-16e39b8701db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:25.653773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed540b4-e378-40f0-8be5-16e39b8701db None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:25.654055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed540b4-e378-40f0-8be5-16e39b8701db None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:25.654373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed540b4-e378-40f0-8be5-16e39b8701db None admin] PATH_INFO: `/v3/projects/e271799f4a934b9e9f99b82b3086fe1c` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:25.655500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed540b4-e378-40f0-8be5-16e39b8701db None admin] RBAC: Authorizing `identity:get_project(project_id=e271799f4a934b9e9f99b82b3086fe1c)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:25.657674 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed540b4-e378-40f0-8be5-16e39b8701db None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:25.659377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 558/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:49:25 2022] GET /identity/v3/projects/e271799f4a934b9e9f99b82b3086fe1c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:25.665519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340a083-f276-4b11-b717-ab6fc8d203ae None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:25.681379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:25.763519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340a083-f276-4b11-b717-ab6fc8d203ae None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:25.795656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df3f28-7757-47e6-9ac3-4e4cf12b9f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:25.796311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df3f28-7757-47e6-9ac3-4e4cf12b9f24 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:25.796594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df3f28-7757-47e6-9ac3-4e4cf12b9f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:25.796871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df3f28-7757-47e6-9ac3-4e4cf12b9f24 None admin] PATH_INFO: `/v3/projects/e271799f4a934b9e9f99b82b3086fe1c/users/fdf2ab849ee24fa69ad0621764def69f/roles/08735f4fc39148328610ad98ba651850` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:25.799045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df3f28-7757-47e6-9ac3-4e4cf12b9f24 None admin] RBAC: Authorizing `identity:create_grant(project_id=e271799f4a934b9e9f99b82b3086fe1c, user_id=fdf2ab849ee24fa69ad0621764def69f, role_id=08735f4fc39148328610ad98ba651850)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:25.800466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df3f28-7757-47e6-9ac3-4e4cf12b9f24 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:25.967129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 565/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:49:25 2022] PUT /identity/v3/projects/e271799f4a934b9e9f99b82b3086fe1c/users/fdf2ab849ee24fa69ad0621764def69f/roles/08735f4fc39148328610ad98ba651850 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:49:28.090237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a0ff2-2a16-457d-ab3d-6020ef8a2db1 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:28.090765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a0ff2-2a16-457d-ab3d-6020ef8a2db1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:28.090765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a0ff2-2a16-457d-ab3d-6020ef8a2db1 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:28.092117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 559/1124] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:28.097392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a0648-4e07-40d1-b942-3aaa6fe1dced None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:28.097801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a0648-4e07-40d1-b942-3aaa6fe1dced None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:28.097939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a0648-4e07-40d1-b942-3aaa6fe1dced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:28.115890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-037a0648-4e07-40d1-b942-3aaa6fe1dced None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:28.117606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-037a0648-4e07-40d1-b942-3aaa6fe1dced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:28.182068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 566/1125] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:28.452460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a0ff2-2a16-457d-ab3d-6020ef8a2db1 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:28.551910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a0ff2-2a16-457d-ab3d-6020ef8a2db1 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:28.586159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e295b-973b-4de9-afc8-c4cc2a2b7690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:28.586806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e295b-973b-4de9-afc8-c4cc2a2b7690 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:28.587087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e295b-973b-4de9-afc8-c4cc2a2b7690 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:28.587362 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e295b-973b-4de9-afc8-c4cc2a2b7690 None admin] PATH_INFO: `/v3/roles/08735f4fc39148328610ad98ba651850` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:28.588749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e295b-973b-4de9-afc8-c4cc2a2b7690 None admin] RBAC: Authorizing `identity:get_role(role_id=08735f4fc39148328610ad98ba651850)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:28.590116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e295b-973b-4de9-afc8-c4cc2a2b7690 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:28.591455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 560/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:28 2022] GET /identity/v3/roles/08735f4fc39148328610ad98ba651850 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:28.597435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a0648-4e07-40d1-b942-3aaa6fe1dced None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:28.601019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:28.696293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a0648-4e07-40d1-b942-3aaa6fe1dced None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:28.730839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce564a08-6f9f-4023-afd2-3ce01744dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:28.731406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce564a08-6f9f-4023-afd2-3ce01744dcbf None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:28.731685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce564a08-6f9f-4023-afd2-3ce01744dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:28.731960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce564a08-6f9f-4023-afd2-3ce01744dcbf None admin] PATH_INFO: `/v3/users/fdf2ab849ee24fa69ad0621764def69f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:28.733070 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce564a08-6f9f-4023-afd2-3ce01744dcbf None admin] RBAC: Authorizing `identity:get_user(user_id=fdf2ab849ee24fa69ad0621764def69f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:28.734519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce564a08-6f9f-4023-afd2-3ce01744dcbf None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:28.736086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 567/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:28 2022] GET /identity/v3/users/fdf2ab849ee24fa69ad0621764def69f => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:28.741927 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e295b-973b-4de9-afc8-c4cc2a2b7690 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:28.776742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:28.841466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e295b-973b-4de9-afc8-c4cc2a2b7690 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:28.874861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3c874-b067-4afd-bec5-c1f578a59436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:28.875457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c874-b067-4afd-bec5-c1f578a59436 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:28.875735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c874-b067-4afd-bec5-c1f578a59436 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:28.876004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c874-b067-4afd-bec5-c1f578a59436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:28.947842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3c874-b067-4afd-bec5-c1f578a59436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:28.949277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3c874-b067-4afd-bec5-c1f578a59436 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:28.982475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:29.044936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 561/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:49:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:49:29.051002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce564a08-6f9f-4023-afd2-3ce01744dcbf None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:29.119950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:29.147543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce564a08-6f9f-4023-afd2-3ce01744dcbf None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:29.180919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d23ac-2064-403c-8879-230388b25d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:29.181542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d23ac-2064-403c-8879-230388b25d85 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:29.181815 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d23ac-2064-403c-8879-230388b25d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:29.182081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d23ac-2064-403c-8879-230388b25d85 None admin] PATH_INFO: `/v3/projects/e271799f4a934b9e9f99b82b3086fe1c` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:29.183211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d23ac-2064-403c-8879-230388b25d85 None admin] RBAC: Authorizing `identity:get_project(project_id=e271799f4a934b9e9f99b82b3086fe1c)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:29.184620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d23ac-2064-403c-8879-230388b25d85 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:29.186248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 568/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:49:29 2022] GET /identity/v3/projects/e271799f4a934b9e9f99b82b3086fe1c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:29.192810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3c874-b067-4afd-bec5-c1f578a59436 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:29.289251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3c874-b067-4afd-bec5-c1f578a59436 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:29.321879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f10ea2-204c-470b-a515-a5d6579e5e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:29.322492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f10ea2-204c-470b-a515-a5d6579e5e53 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:29.322772 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f10ea2-204c-470b-a515-a5d6579e5e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:29.323040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f10ea2-204c-470b-a515-a5d6579e5e53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:29.323750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f10ea2-204c-470b-a515-a5d6579e5e53 None admin] RBAC: Adding query filter params (role.id=08735f4fc39148328610ad98ba651850, scope.project.id=e271799f4a934b9e9f99b82b3086fe1c, user.id=fdf2ab849ee24fa69ad0621764def69f) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:29.324055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f10ea2-204c-470b-a515-a5d6579e5e53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:29.325455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f10ea2-204c-470b-a515-a5d6579e5e53 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:29.328191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:29.331302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 562/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:49:29 2022] GET /identity/v3/role_assignments?user.id=fdf2ab849ee24fa69ad0621764def69f&scope.project.id=e271799f4a934b9e9f99b82b3086fe1c&role.id=08735f4fc39148328610ad98ba651850 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:31.481682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6485dc0-8990-48c7-af03-401acf3b284b None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:31.482251 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6485dc0-8990-48c7-af03-401acf3b284b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:31.482372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6485dc0-8990-48c7-af03-401acf3b284b None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:31.483746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 569/1131] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:31.488891 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e32d-99d0-4a21-a174-f9ee30fbed49 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:31.489328 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e32d-99d0-4a21-a174-f9ee30fbed49 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:31.489422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e32d-99d0-4a21-a174-f9ee30fbed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:31.508242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-a369e32d-99d0-4a21-a174-f9ee30fbed49 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:31.509418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a369e32d-99d0-4a21-a174-f9ee30fbed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:31.574223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 563/1132] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:31.841330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6485dc0-8990-48c7-af03-401acf3b284b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:31.941403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6485dc0-8990-48c7-af03-401acf3b284b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:31.975892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4fef5-0ece-46ed-a62a-a9523cf374e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:31.976513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4fef5-0ece-46ed-a62a-a9523cf374e8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:31.976792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4fef5-0ece-46ed-a62a-a9523cf374e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:31.977065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4fef5-0ece-46ed-a62a-a9523cf374e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:31.978169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4fef5-0ece-46ed-a62a-a9523cf374e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:31.979611 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4fef5-0ece-46ed-a62a-a9523cf374e8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:31.981148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 570/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:31.986991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e32d-99d0-4a21-a174-f9ee30fbed49 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:32.083639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e32d-99d0-4a21-a174-f9ee30fbed49 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:32.111574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:32.117252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb073c4-6300-4168-a7a7-435967b62b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:32.121996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb073c4-6300-4168-a7a7-435967b62b6e None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:32.121996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb073c4-6300-4168-a7a7-435967b62b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:32.121996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb073c4-6300-4168-a7a7-435967b62b6e None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:32.121996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb073c4-6300-4168-a7a7-435967b62b6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:32.121996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb073c4-6300-4168-a7a7-435967b62b6e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:32.218466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 564/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:49:31 2022] POST /identity/v3/projects => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:49:34.526072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23b13-2ba7-4bcb-932a-5e46c2b8977d None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:34.526665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23b13-2ba7-4bcb-932a-5e46c2b8977d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:34.526665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23b13-2ba7-4bcb-932a-5e46c2b8977d None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:34.527989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 571/1135] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:34.533264 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510fbb0-257a-4b25-9cab-fbe3cc853b60 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:34.533686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510fbb0-257a-4b25-9cab-fbe3cc853b60 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:34.533799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510fbb0-257a-4b25-9cab-fbe3cc853b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:34.551957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2510fbb0-257a-4b25-9cab-fbe3cc853b60 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:34.553122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2510fbb0-257a-4b25-9cab-fbe3cc853b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:34.629929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 565/1136] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:34.908886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e23b13-2ba7-4bcb-932a-5e46c2b8977d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:34.920402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:35.011698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e23b13-2ba7-4bcb-932a-5e46c2b8977d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:35.043965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6ed3c-ac18-4501-b81e-b4c9f65f1c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:35.044589 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6ed3c-ac18-4501-b81e-b4c9f65f1c41 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:35.044870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6ed3c-ac18-4501-b81e-b4c9f65f1c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:35.045141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6ed3c-ac18-4501-b81e-b4c9f65f1c41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:35.046314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6ed3c-ac18-4501-b81e-b4c9f65f1c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:35.047736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6ed3c-ac18-4501-b81e-b4c9f65f1c41 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:35.049305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 572/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:49:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:35.055820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510fbb0-257a-4b25-9cab-fbe3cc853b60 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:35.151892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510fbb0-257a-4b25-9cab-fbe3cc853b60 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:35.165016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:35.184702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9686e5-ea77-4fc3-a736-a5079b48fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:35.185300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9686e5-ea77-4fc3-a736-a5079b48fc4e None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:35.185582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9686e5-ea77-4fc3-a736-a5079b48fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:35.185857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9686e5-ea77-4fc3-a736-a5079b48fc4e None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:35.186541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9686e5-ea77-4fc3-a736-a5079b48fc4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:35.188026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9686e5-ea77-4fc3-a736-a5079b48fc4e None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:35.267118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 566/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:49:35 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:49:37.452121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a964-297b-4a9e-9620-02e24dbcbc70 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:37.452674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a964-297b-4a9e-9620-02e24dbcbc70 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:37.452674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a964-297b-4a9e-9620-02e24dbcbc70 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:37.454010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 573/1139] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:37.460032 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a524118-0543-43eb-8d30-0f31af87a34c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:37.460430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a524118-0543-43eb-8d30-0f31af87a34c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:37.460578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a524118-0543-43eb-8d30-0f31af87a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:37.478866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-0a524118-0543-43eb-8d30-0f31af87a34c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:37.480041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0a524118-0543-43eb-8d30-0f31af87a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:37.543594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 567/1140] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:37.821581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12a964-297b-4a9e-9620-02e24dbcbc70 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:37.969791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:37.993394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12a964-297b-4a9e-9620-02e24dbcbc70 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:38.027353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d241-b240-4357-a5f8-4b93698734eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:38.027981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d241-b240-4357-a5f8-4b93698734eb None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:38.028255 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d241-b240-4357-a5f8-4b93698734eb None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:38.028533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d241-b240-4357-a5f8-4b93698734eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:38.038907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264d241-b240-4357-a5f8-4b93698734eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-8264d241-b240-4357-a5f8-4b93698734eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:49:38.043701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:38.044791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:38.045697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 574/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:49:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:38.053132 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a524118-0543-43eb-8d30-0f31af87a34c None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:38.168651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:38.173173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a524118-0543-43eb-8d30-0f31af87a34c None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:38.215582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92a477-c84e-4bdd-89bc-8b2deedddcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:38.216483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92a477-c84e-4bdd-89bc-8b2deedddcae None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:38.216924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92a477-c84e-4bdd-89bc-8b2deedddcae None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:38.217416 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92a477-c84e-4bdd-89bc-8b2deedddcae None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:38.218498 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92a477-c84e-4bdd-89bc-8b2deedddcae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:38.218858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92a477-c84e-4bdd-89bc-8b2deedddcae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:38.220291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92a477-c84e-4bdd-89bc-8b2deedddcae None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:38.228577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 568/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:49:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:38.234622 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d241-b240-4357-a5f8-4b93698734eb None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:38.334933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d241-b240-4357-a5f8-4b93698734eb None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:38.376262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0b90c-d96d-4aee-854e-f11ee73700c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:38.376888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0b90c-d96d-4aee-854e-f11ee73700c3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:38.377167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0b90c-d96d-4aee-854e-f11ee73700c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:38.377440 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0b90c-d96d-4aee-854e-f11ee73700c3 None admin] PATH_INFO: `/v3/users/a5b458a661cb437a9da25773fdd2feb6` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:38.380072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:38.391040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0b90c-d96d-4aee-854e-f11ee73700c3 None admin] RBAC: Authorizing `identity:get_user(user_id=a5b458a661cb437a9da25773fdd2feb6)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:38.392474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0b90c-d96d-4aee-854e-f11ee73700c3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:38.394064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 575/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:38 2022] GET /identity/v3/users/a5b458a661cb437a9da25773fdd2feb6 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:38.400059 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92a477-c84e-4bdd-89bc-8b2deedddcae None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:38.498434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92a477-c84e-4bdd-89bc-8b2deedddcae None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:38.530686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309f423-de76-4f6f-aeff-2c645e13cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:38.531282 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309f423-de76-4f6f-aeff-2c645e13cea1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:38.531561 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309f423-de76-4f6f-aeff-2c645e13cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:38.531832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309f423-de76-4f6f-aeff-2c645e13cea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:38.558758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:38.598552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309f423-de76-4f6f-aeff-2c645e13cea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:38.600521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309f423-de76-4f6f-aeff-2c645e13cea1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:38.695983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 569/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:49:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:49:38.701905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0b90c-d96d-4aee-854e-f11ee73700c3 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:38.797560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0b90c-d96d-4aee-854e-f11ee73700c3 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:38.831492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a914f-4acf-4924-aa22-9ae10206c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:38.832121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a914f-4acf-4924-aa22-9ae10206c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:38.832402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a914f-4acf-4924-aa22-9ae10206c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:38.832677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a914f-4acf-4924-aa22-9ae10206c5e3 None admin] PATH_INFO: `/v3/projects/c2ddc6e2b8d542b1a6cda0d6ce63864f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:38.833795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a914f-4acf-4924-aa22-9ae10206c5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=c2ddc6e2b8d542b1a6cda0d6ce63864f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:38.835380 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a914f-4acf-4924-aa22-9ae10206c5e3 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:38.837007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 576/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:49:38 2022] GET /identity/v3/projects/c2ddc6e2b8d542b1a6cda0d6ce63864f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:38.843234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309f423-de76-4f6f-aeff-2c645e13cea1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:38.899731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:38.941110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309f423-de76-4f6f-aeff-2c645e13cea1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:38.974501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127bec0-8389-4fbd-b547-33bb8642536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:38.975625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127bec0-8389-4fbd-b547-33bb8642536f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:38.975882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127bec0-8389-4fbd-b547-33bb8642536f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:38.976176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127bec0-8389-4fbd-b547-33bb8642536f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:38.976935 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127bec0-8389-4fbd-b547-33bb8642536f None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=c2ddc6e2b8d542b1a6cda0d6ce63864f, user.id=a5b458a661cb437a9da25773fdd2feb6) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:38.977239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127bec0-8389-4fbd-b547-33bb8642536f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:38.978776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127bec0-8389-4fbd-b547-33bb8642536f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:38.984523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 570/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:49:38 2022] GET /identity/v3/role_assignments?user.id=a5b458a661cb437a9da25773fdd2feb6&scope.project.id=c2ddc6e2b8d542b1a6cda0d6ce63864f&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:41.142019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644209f0-a63f-4b51-b13c-5dfc1992fb07 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:41.142596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644209f0-a63f-4b51-b13c-5dfc1992fb07 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:41.142688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644209f0-a63f-4b51-b13c-5dfc1992fb07 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:41.144054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 577/1147] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:41.149547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d9f7-d4c8-43e1-b024-3bd31ecdae28 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:41.149970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d9f7-d4c8-43e1-b024-3bd31ecdae28 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:41.150101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d9f7-d4c8-43e1-b024-3bd31ecdae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:41.168653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-19b2d9f7-d4c8-43e1-b024-3bd31ecdae28 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:41.169842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-19b2d9f7-d4c8-43e1-b024-3bd31ecdae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:41.234189 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 571/1148] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:41.502868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644209f0-a63f-4b51-b13c-5dfc1992fb07 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:41.565865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:41.605079 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644209f0-a63f-4b51-b13c-5dfc1992fb07 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:41.641701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c1586-9458-4728-99f4-b06411282ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:41.642370 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c1586-9458-4728-99f4-b06411282ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:41.642653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c1586-9458-4728-99f4-b06411282ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:41.642928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c1586-9458-4728-99f4-b06411282ed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:41.652892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c1586-9458-4728-99f4-b06411282ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-f53c1586-9458-4728-99f4-b06411282ed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:49:41.657671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:41.658983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:41.659985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 578/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:49:41.665883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2d9f7-d4c8-43e1-b024-3bd31ecdae28 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:41.721970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:41.766941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2d9f7-d4c8-43e1-b024-3bd31ecdae28 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:41.799071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6dc48-2040-4c63-9e64-7eca1eae3b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:41.799667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6dc48-2040-4c63-9e64-7eca1eae3b8c None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:41.799944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6dc48-2040-4c63-9e64-7eca1eae3b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:41.800214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6dc48-2040-4c63-9e64-7eca1eae3b8c None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:41.800871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6dc48-2040-4c63-9e64-7eca1eae3b8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:41.801169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6dc48-2040-4c63-9e64-7eca1eae3b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:41.802543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6dc48-2040-4c63-9e64-7eca1eae3b8c None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:41.811415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 572/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:49:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:41.817605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c1586-9458-4728-99f4-b06411282ed1 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:41.914605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c1586-9458-4728-99f4-b06411282ed1 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:41.936131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:41.948013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612575-37f5-4f4d-9d40-6e7f0a056e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:41.948610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612575-37f5-4f4d-9d40-6e7f0a056e8d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:41.948890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612575-37f5-4f4d-9d40-6e7f0a056e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:41.949163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612575-37f5-4f4d-9d40-6e7f0a056e8d None admin] PATH_INFO: `/v3/users/a5b458a661cb437a9da25773fdd2feb6` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:41.950303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612575-37f5-4f4d-9d40-6e7f0a056e8d None admin] RBAC: Authorizing `identity:get_user(user_id=a5b458a661cb437a9da25773fdd2feb6)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:41.951726 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612575-37f5-4f4d-9d40-6e7f0a056e8d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:41.953291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 579/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:41 2022] GET /identity/v3/users/a5b458a661cb437a9da25773fdd2feb6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:41.959679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6dc48-2040-4c63-9e64-7eca1eae3b8c None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:42.056873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6dc48-2040-4c63-9e64-7eca1eae3b8c None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:42.073758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:42.091895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776b111-8071-4691-b4d8-2da48dc75c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:42.092517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b111-8071-4691-b4d8-2da48dc75c95 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:42.092797 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b111-8071-4691-b4d8-2da48dc75c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:42.093071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b111-8071-4691-b4d8-2da48dc75c95 None admin] PATH_INFO: `/v3/projects/c2ddc6e2b8d542b1a6cda0d6ce63864f` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:42.094182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776b111-8071-4691-b4d8-2da48dc75c95 None admin] RBAC: Authorizing `identity:get_project(project_id=c2ddc6e2b8d542b1a6cda0d6ce63864f)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:42.095638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776b111-8071-4691-b4d8-2da48dc75c95 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:42.097340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 573/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:49:41 2022] GET /identity/v3/projects/c2ddc6e2b8d542b1a6cda0d6ce63864f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:42.103412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612575-37f5-4f4d-9d40-6e7f0a056e8d None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:42.200245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612575-37f5-4f4d-9d40-6e7f0a056e8d None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:42.233212 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea70aa-e6b4-4178-bb0d-0ecd0f7f1492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:42.233854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea70aa-e6b4-4178-bb0d-0ecd0f7f1492 None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:42.234131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea70aa-e6b4-4178-bb0d-0ecd0f7f1492 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:42.234428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea70aa-e6b4-4178-bb0d-0ecd0f7f1492 None admin] PATH_INFO: `/v3/projects/c2ddc6e2b8d542b1a6cda0d6ce63864f/users/a5b458a661cb437a9da25773fdd2feb6/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:42.236304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea70aa-e6b4-4178-bb0d-0ecd0f7f1492 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2ddc6e2b8d542b1a6cda0d6ce63864f, user_id=a5b458a661cb437a9da25773fdd2feb6, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:42.237717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea70aa-e6b4-4178-bb0d-0ecd0f7f1492 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:42.359945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 580/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:49:42 2022] PUT /identity/v3/projects/c2ddc6e2b8d542b1a6cda0d6ce63864f/users/a5b458a661cb437a9da25773fdd2feb6/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:49:44.475229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131adca3-5444-44c8-b217-4b1d85889602 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:44.475793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131adca3-5444-44c8-b217-4b1d85889602 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:44.475890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131adca3-5444-44c8-b217-4b1d85889602 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:44.477535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 574/1154] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:44.482698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1737123-31c4-4b44-87dc-f510818d0b40 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:44.483093 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1737123-31c4-4b44-87dc-f510818d0b40 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:44.483246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1737123-31c4-4b44-87dc-f510818d0b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:44.501857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d1737123-31c4-4b44-87dc-f510818d0b40 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:44.503066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d1737123-31c4-4b44-87dc-f510818d0b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:44.546850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:44.567555 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 581/1155] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:44.838836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131adca3-5444-44c8-b217-4b1d85889602 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:44.940279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131adca3-5444-44c8-b217-4b1d85889602 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:44.974028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94c2f8-3808-40a7-bdb3-b9d428ffaa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:44.975478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94c2f8-3808-40a7-bdb3-b9d428ffaa77 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:44.975819 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94c2f8-3808-40a7-bdb3-b9d428ffaa77 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:44.976091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94c2f8-3808-40a7-bdb3-b9d428ffaa77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:44.986639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94c2f8-3808-40a7-bdb3-b9d428ffaa77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-1b94c2f8-3808-40a7-bdb3-b9d428ffaa77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:49:44.991863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:44.992983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:49:44.993892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 575/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:44.999258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1737123-31c4-4b44-87dc-f510818d0b40 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:45.107406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1737123-31c4-4b44-87dc-f510818d0b40 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:45.140282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0192c-e1aa-4534-99be-2f46a0c0236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:45.140889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0192c-e1aa-4534-99be-2f46a0c0236f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:45.141170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0192c-e1aa-4534-99be-2f46a0c0236f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:45.141440 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0192c-e1aa-4534-99be-2f46a0c0236f None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:45.142107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0192c-e1aa-4534-99be-2f46a0c0236f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:45.142436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0192c-e1aa-4534-99be-2f46a0c0236f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:45.143797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0192c-e1aa-4534-99be-2f46a0c0236f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:45.152444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 582/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:45.158497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94c2f8-3808-40a7-bdb3-b9d428ffaa77 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:45.204361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:45.259415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94c2f8-3808-40a7-bdb3-b9d428ffaa77 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:45.291803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee222b19-ebba-4141-9ec7-b8da36765ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:45.292417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee222b19-ebba-4141-9ec7-b8da36765ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:45.292696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee222b19-ebba-4141-9ec7-b8da36765ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:45.292963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee222b19-ebba-4141-9ec7-b8da36765ae1 None admin] PATH_INFO: `/v3/users/a5b458a661cb437a9da25773fdd2feb6` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:45.294072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee222b19-ebba-4141-9ec7-b8da36765ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=a5b458a661cb437a9da25773fdd2feb6)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:45.295518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee222b19-ebba-4141-9ec7-b8da36765ae1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:45.297072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 576/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:49:45 2022] GET /identity/v3/users/a5b458a661cb437a9da25773fdd2feb6 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:45.303492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0192c-e1aa-4534-99be-2f46a0c0236f None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:45.347574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:45.401888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0192c-e1aa-4534-99be-2f46a0c0236f None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:45.435059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbac5a-b88f-461d-9d6d-534a2a0136ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:45.435659 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbac5a-b88f-461d-9d6d-534a2a0136ed None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:45.435937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbac5a-b88f-461d-9d6d-534a2a0136ed None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:45.436208 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbac5a-b88f-461d-9d6d-534a2a0136ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:45.502143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbac5a-b88f-461d-9d6d-534a2a0136ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:45.503628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbac5a-b88f-461d-9d6d-534a2a0136ed None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:45.543390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:45.599449 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 583/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:49:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:49:45.606004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee222b19-ebba-4141-9ec7-b8da36765ae1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:45.706240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee222b19-ebba-4141-9ec7-b8da36765ae1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:45.718713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:45.739278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f8504-4547-4f1b-866c-f21fcdabc46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:45.739905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f8504-4547-4f1b-866c-f21fcdabc46d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:45.740719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f8504-4547-4f1b-866c-f21fcdabc46d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:45.741004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f8504-4547-4f1b-866c-f21fcdabc46d None admin] PATH_INFO: `/v3/projects/c2ddc6e2b8d542b1a6cda0d6ce63864f` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:45.742129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f8504-4547-4f1b-866c-f21fcdabc46d None admin] RBAC: Authorizing `identity:get_project(project_id=c2ddc6e2b8d542b1a6cda0d6ce63864f)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:45.743590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f8504-4547-4f1b-866c-f21fcdabc46d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:45.745208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 577/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:49:45 2022] GET /identity/v3/projects/c2ddc6e2b8d542b1a6cda0d6ce63864f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:45.751334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbac5a-b88f-461d-9d6d-534a2a0136ed None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:45.849221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbac5a-b88f-461d-9d6d-534a2a0136ed None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:45.883646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a02c76-95ef-462d-bbef-3540f3188e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:45.884252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a02c76-95ef-462d-bbef-3540f3188e25 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:45.884547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a02c76-95ef-462d-bbef-3540f3188e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:45.884819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a02c76-95ef-462d-bbef-3540f3188e25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:45.885569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a02c76-95ef-462d-bbef-3540f3188e25 None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=c2ddc6e2b8d542b1a6cda0d6ce63864f, user.id=a5b458a661cb437a9da25773fdd2feb6) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:45.885897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a02c76-95ef-462d-bbef-3540f3188e25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:45.887411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a02c76-95ef-462d-bbef-3540f3188e25 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:45.893215 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 584/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:49:45 2022] GET /identity/v3/role_assignments?user.id=a5b458a661cb437a9da25773fdd2feb6&scope.project.id=c2ddc6e2b8d542b1a6cda0d6ce63864f&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:48.107673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273be6ae-a1f7-4b16-9d8e-56d9e6fd6b33 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:48.108228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273be6ae-a1f7-4b16-9d8e-56d9e6fd6b33 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:48.108228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273be6ae-a1f7-4b16-9d8e-56d9e6fd6b33 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:48.109563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 578/1162] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:48.114960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a05d3e-f6d4-4101-b001-4febbbc3ea83 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:48.115490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a05d3e-f6d4-4101-b001-4febbbc3ea83 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:48.115829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a05d3e-f6d4-4101-b001-4febbbc3ea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:48.128475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:48.134373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-49a05d3e-f6d4-4101-b001-4febbbc3ea83 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:48.138271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-49a05d3e-f6d4-4101-b001-4febbbc3ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:48.200148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 585/1163] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:48.469938 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273be6ae-a1f7-4b16-9d8e-56d9e6fd6b33 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:48.569841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273be6ae-a1f7-4b16-9d8e-56d9e6fd6b33 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:48.603684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828874-f825-481e-9cd4-1793a29e0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:48.604286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828874-f825-481e-9cd4-1793a29e0bdb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:48.604568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828874-f825-481e-9cd4-1793a29e0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:48.604839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828874-f825-481e-9cd4-1793a29e0bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:48.652589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:48.671003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0828874-f825-481e-9cd4-1793a29e0bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:48.681250 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0828874-f825-481e-9cd4-1793a29e0bdb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:48.768717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 579/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:49:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:49:48.775098 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a05d3e-f6d4-4101-b001-4febbbc3ea83 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:48.871372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a05d3e-f6d4-4101-b001-4febbbc3ea83 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:48.905134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e62856-f3ca-4c1f-8081-57c95064599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:48.905758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62856-f3ca-4c1f-8081-57c95064599b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:48.906038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62856-f3ca-4c1f-8081-57c95064599b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:48.906343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62856-f3ca-4c1f-8081-57c95064599b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:48.908893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:48.913331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e62856-f3ca-4c1f-8081-57c95064599b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:48.914797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e62856-f3ca-4c1f-8081-57c95064599b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-f0e62856-f3ca-4c1f-8081-57c95064599b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:49:48.925825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:49:48.926942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:49:48.928273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 586/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Sep 14 11:49:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:49:48.933086 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828874-f825-481e-9cd4-1793a29e0bdb None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:49.013017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:49.038306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828874-f825-481e-9cd4-1793a29e0bdb None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:49.074194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25913e1c-94ca-4acf-ada8-639d21c105a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:49.074829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913e1c-94ca-4acf-ada8-639d21c105a4 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:49.075112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913e1c-94ca-4acf-ada8-639d21c105a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:49.075384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913e1c-94ca-4acf-ada8-639d21c105a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:49.076024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913e1c-94ca-4acf-ada8-639d21c105a4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:49:49.076326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913e1c-94ca-4acf-ada8-639d21c105a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:49.077684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913e1c-94ca-4acf-ada8-639d21c105a4 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:49.084817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 580/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Sep 14 11:49:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:51.214176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665c670-f384-47f9-8ab8-ecb809f24aba None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:51.214744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665c670-f384-47f9-8ab8-ecb809f24aba None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:51.214744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665c670-f384-47f9-8ab8-ecb809f24aba None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:51.216118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 587/1167] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:51.221488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c149b5f-88b2-4551-b147-747165e3389d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:51.221934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c149b5f-88b2-4551-b147-747165e3389d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:51.222035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c149b5f-88b2-4551-b147-747165e3389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:51.240734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6c149b5f-88b2-4551-b147-747165e3389d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:51.241904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6c149b5f-88b2-4551-b147-747165e3389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:51.305139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 581/1168] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:51.569608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665c670-f384-47f9-8ab8-ecb809f24aba None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:51.668490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665c670-f384-47f9-8ab8-ecb809f24aba None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:51.701177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e40b79-8c59-49aa-b802-8d4755979a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:51.701773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e40b79-8c59-49aa-b802-8d4755979a4a None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:51.702049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e40b79-8c59-49aa-b802-8d4755979a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:51.702352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e40b79-8c59-49aa-b802-8d4755979a4a None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:51.703021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e40b79-8c59-49aa-b802-8d4755979a4a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:51.704356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e40b79-8c59-49aa-b802-8d4755979a4a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:51.783610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 588/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Wed Sep 14 11:49:51 2022] POST /identity/v3/domains => generated 267 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:49:53.956023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a886b-6c40-4d2f-97f3-83dc483ce1e6 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:53.956558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a886b-6c40-4d2f-97f3-83dc483ce1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:53.956558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a886b-6c40-4d2f-97f3-83dc483ce1e6 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:53.957906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 582/1170] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:53.963881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a57a3a-e89a-4dff-bcc9-818510b6b8f1 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:53.964300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a57a3a-e89a-4dff-bcc9-818510b6b8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:53.964399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a57a3a-e89a-4dff-bcc9-818510b6b8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:53.982265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c1a57a3a-e89a-4dff-bcc9-818510b6b8f1 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:53.983442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c1a57a3a-e89a-4dff-bcc9-818510b6b8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:54.032728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:54.048922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 589/1171] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:54.317158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a886b-6c40-4d2f-97f3-83dc483ce1e6 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:54.391785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:54.416896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a886b-6c40-4d2f-97f3-83dc483ce1e6 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:54.450775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c2a5f-42e0-45f9-8923-d02a5f5aa173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:54.451389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c2a5f-42e0-45f9-8923-d02a5f5aa173 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:54.451666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c2a5f-42e0-45f9-8923-d02a5f5aa173 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:54.451936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c2a5f-42e0-45f9-8923-d02a5f5aa173 None admin] PATH_INFO: `/v3/domains/2eccd03d33ed4b068aabf350d385e3ca` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:54.462605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c2a5f-42e0-45f9-8923-d02a5f5aa173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2eccd03d33ed4b068aabf350d385e3ca)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:54.464042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c2a5f-42e0-45f9-8923-d02a5f5aa173 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:54.465596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 583/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Wed Sep 14 11:49:54 2022] GET /identity/v3/domains/2eccd03d33ed4b068aabf350d385e3ca => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:54.471531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a57a3a-e89a-4dff-bcc9-818510b6b8f1 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:54.565599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a57a3a-e89a-4dff-bcc9-818510b6b8f1 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:54.598370 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86aef5c-f751-40bf-a3f2-82c96a1c0afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:54.598906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aef5c-f751-40bf-a3f2-82c96a1c0afd None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:54.599750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aef5c-f751-40bf-a3f2-82c96a1c0afd None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:54.600078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86aef5c-f751-40bf-a3f2-82c96a1c0afd None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:54.600805 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aef5c-f751-40bf-a3f2-82c96a1c0afd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:54.602228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86aef5c-f751-40bf-a3f2-82c96a1c0afd None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:54.743676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 590/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:49:54 2022] POST /identity/v3/projects => generated 361 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:49:56.900114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246bc6-5086-45b6-afd3-eaea0c0e319f None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:56.900629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246bc6-5086-45b6-afd3-eaea0c0e319f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:56.900629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246bc6-5086-45b6-afd3-eaea0c0e319f None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:56.901910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 584/1174] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:56.907134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa493d1-673f-49ae-b551-db2361298607 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:56.907561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa493d1-673f-49ae-b551-db2361298607 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:56.907701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa493d1-673f-49ae-b551-db2361298607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:56.926399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-4aa493d1-673f-49ae-b551-db2361298607 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:56.928163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4aa493d1-673f-49ae-b551-db2361298607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:56.956744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:56.992962 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 591/1175] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:49:57.263117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd246bc6-5086-45b6-afd3-eaea0c0e319f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:57.361292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd246bc6-5086-45b6-afd3-eaea0c0e319f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:57.393213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d81998-6182-485e-b1d9-17f2b11e8e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:57.393824 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d81998-6182-485e-b1d9-17f2b11e8e6a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:57.394098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d81998-6182-485e-b1d9-17f2b11e8e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:57.394400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d81998-6182-485e-b1d9-17f2b11e8e6a None admin] PATH_INFO: `/v3/domains/2eccd03d33ed4b068aabf350d385e3ca` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:57.395487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d81998-6182-485e-b1d9-17f2b11e8e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=2eccd03d33ed4b068aabf350d385e3ca)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:57.397694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d81998-6182-485e-b1d9-17f2b11e8e6a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:57.399252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 585/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Wed Sep 14 11:49:57 2022] GET /identity/v3/domains/2eccd03d33ed4b068aabf350d385e3ca => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:49:57.405035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa493d1-673f-49ae-b551-db2361298607 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:49:57.500257 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa493d1-673f-49ae-b551-db2361298607 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:49:57.532317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aaee9-971b-4918-a19a-e2bca81ec8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:49:57.532847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aaee9-971b-4918-a19a-e2bca81ec8db None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:57.533120 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aaee9-971b-4918-a19a-e2bca81ec8db None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:57.533389 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aaee9-971b-4918-a19a-e2bca81ec8db None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:57.534024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aaee9-971b-4918-a19a-e2bca81ec8db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:49:57.535468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aaee9-971b-4918-a19a-e2bca81ec8db None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:49:57.623268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 592/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:49:57 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:49:59.795070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712df124-5528-48da-b41e-feff2034247a None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:59.795615 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712df124-5528-48da-b41e-feff2034247a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:59.795615 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712df124-5528-48da-b41e-feff2034247a None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:59.796949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 586/1178] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:49:59.802678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eceb16-f107-4d46-80b5-66c901a5eb2d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:49:59.803328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eceb16-f107-4d46-80b5-66c901a5eb2d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:49:59.803328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eceb16-f107-4d46-80b5-66c901a5eb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:49:59.822738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-85eceb16-f107-4d46-80b5-66c901a5eb2d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:49:59.823926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-85eceb16-f107-4d46-80b5-66c901a5eb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:49:59.840684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:49:59.888440 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 593/1179] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:49:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:50:00.157251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712df124-5528-48da-b41e-feff2034247a None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:00.160156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:00.257853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712df124-5528-48da-b41e-feff2034247a None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:00.291254 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2bac9-fed3-4085-a4d2-ba4b637ed386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:00.291878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2bac9-fed3-4085-a4d2-ba4b637ed386 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:00.292155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2bac9-fed3-4085-a4d2-ba4b637ed386 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:00.292428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2bac9-fed3-4085-a4d2-ba4b637ed386 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:00.302875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2bac9-fed3-4085-a4d2-ba4b637ed386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-a2f2bac9-fed3-4085-a4d2-ba4b637ed386 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:50:00.307671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:50:00.308775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:50:00.309634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 587/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:50:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:50:00.314994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eceb16-f107-4d46-80b5-66c901a5eb2d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:00.411229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eceb16-f107-4d46-80b5-66c901a5eb2d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:00.444267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878de8be-e15c-4367-8dd8-f77fefef2b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:00.444861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878de8be-e15c-4367-8dd8-f77fefef2b45 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:00.445141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878de8be-e15c-4367-8dd8-f77fefef2b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:00.445416 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878de8be-e15c-4367-8dd8-f77fefef2b45 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:00.446074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878de8be-e15c-4367-8dd8-f77fefef2b45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:50:00.446406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878de8be-e15c-4367-8dd8-f77fefef2b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:00.447761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878de8be-e15c-4367-8dd8-f77fefef2b45 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:00.455507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 594/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:50:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:00.462017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2bac9-fed3-4085-a4d2-ba4b637ed386 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:00.522676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:00.562570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2bac9-fed3-4085-a4d2-ba4b637ed386 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:00.603098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e7628-2b65-4e79-a76b-0e54401277a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:00.603724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7628-2b65-4e79-a76b-0e54401277a1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:00.604005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7628-2b65-4e79-a76b-0e54401277a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:00.604275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7628-2b65-4e79-a76b-0e54401277a1 None admin] PATH_INFO: `/v3/users/575275c31a0a4a339e71c75913ec2b2e` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:00.617811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e7628-2b65-4e79-a76b-0e54401277a1 None admin] RBAC: Authorizing `identity:get_user(user_id=575275c31a0a4a339e71c75913ec2b2e)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:00.619270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e7628-2b65-4e79-a76b-0e54401277a1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:00.620876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 588/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:50:00 2022] GET /identity/v3/users/575275c31a0a4a339e71c75913ec2b2e => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:00.626566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878de8be-e15c-4367-8dd8-f77fefef2b45 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:00.644350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:00.723092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878de8be-e15c-4367-8dd8-f77fefef2b45 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:00.755429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496db175-dcf3-4aab-a53b-ced2b07a13fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:00.756018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496db175-dcf3-4aab-a53b-ced2b07a13fb None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:00.756294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496db175-dcf3-4aab-a53b-ced2b07a13fb None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:00.756561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496db175-dcf3-4aab-a53b-ced2b07a13fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:00.820160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496db175-dcf3-4aab-a53b-ced2b07a13fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:00.821583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496db175-dcf3-4aab-a53b-ced2b07a13fb None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:00.837402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:00.918834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 595/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:50:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:50:00.924991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e7628-2b65-4e79-a76b-0e54401277a1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:01.021639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e7628-2b65-4e79-a76b-0e54401277a1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:01.040248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:01.054031 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1fef3-c552-4fee-bef1-7677a02874cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:01.054673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1fef3-c552-4fee-bef1-7677a02874cb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:01.054952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1fef3-c552-4fee-bef1-7677a02874cb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:01.055217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1fef3-c552-4fee-bef1-7677a02874cb None admin] PATH_INFO: `/v3/projects/e324ffd1e30d48ba9fd4723ae155ab1b` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:01.056306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1fef3-c552-4fee-bef1-7677a02874cb None admin] RBAC: Authorizing `identity:get_project(project_id=e324ffd1e30d48ba9fd4723ae155ab1b)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:01.057803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1fef3-c552-4fee-bef1-7677a02874cb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:01.059431 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 589/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:50:00 2022] GET /identity/v3/projects/e324ffd1e30d48ba9fd4723ae155ab1b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:01.065902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496db175-dcf3-4aab-a53b-ced2b07a13fb None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:01.173468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496db175-dcf3-4aab-a53b-ced2b07a13fb None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:01.190323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:01.207578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d8dc0-66a4-4654-b9ff-6f94bfc19a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:01.213155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8dc0-66a4-4654-b9ff-6f94bfc19a90 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:01.213155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8dc0-66a4-4654-b9ff-6f94bfc19a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:01.213155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8dc0-66a4-4654-b9ff-6f94bfc19a90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:01.213155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d8dc0-66a4-4654-b9ff-6f94bfc19a90 None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=e324ffd1e30d48ba9fd4723ae155ab1b, user.id=575275c31a0a4a339e71c75913ec2b2e) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:50:01.213155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d8dc0-66a4-4654-b9ff-6f94bfc19a90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:01.213155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d8dc0-66a4-4654-b9ff-6f94bfc19a90 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:01.216993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 596/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:50:01 2022] GET /identity/v3/role_assignments?user.id=575275c31a0a4a339e71c75913ec2b2e&scope.project.id=e324ffd1e30d48ba9fd4723ae155ab1b&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:03.309961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e779a-32c6-46c1-8053-614fd7e46e12 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:03.311211 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e779a-32c6-46c1-8053-614fd7e46e12 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:03.312812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e779a-32c6-46c1-8053-614fd7e46e12 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:03.314924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 590/1186] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:50:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:50:03.321083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb934ef-54b8-48b2-9825-9f9c66ed9beb None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:03.321491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb934ef-54b8-48b2-9825-9f9c66ed9beb None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:03.321636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb934ef-54b8-48b2-9825-9f9c66ed9beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:03.341000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-5fb934ef-54b8-48b2-9825-9f9c66ed9beb None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:50:03.342229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5fb934ef-54b8-48b2-9825-9f9c66ed9beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:50:03.417543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 597/1187] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:50:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:50:03.722483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e779a-32c6-46c1-8053-614fd7e46e12 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:03.827712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e779a-32c6-46c1-8053-614fd7e46e12 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:03.863982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c9a84-0c42-4b4c-9dfc-fc9efd96d450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:03.864910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9a84-0c42-4b4c-9dfc-fc9efd96d450 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:03.865240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9a84-0c42-4b4c-9dfc-fc9efd96d450 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:03.865516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9a84-0c42-4b4c-9dfc-fc9efd96d450 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:03.875749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c9a84-0c42-4b4c-9dfc-fc9efd96d450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-278c9a84-0c42-4b4c-9dfc-fc9efd96d450 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:50:03.881442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:50:03.882433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:50:03.883457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 591/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:50:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:50:03.891865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb934ef-54b8-48b2-9825-9f9c66ed9beb None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:04.001799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb934ef-54b8-48b2-9825-9f9c66ed9beb None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:04.016259 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:04.051570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56c67f-d694-40d2-9a22-104d2bf0292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:04.053223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c67f-d694-40d2-9a22-104d2bf0292d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:04.053503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c67f-d694-40d2-9a22-104d2bf0292d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:04.053781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56c67f-d694-40d2-9a22-104d2bf0292d None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:04.054587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56c67f-d694-40d2-9a22-104d2bf0292d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:50:04.054895 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56c67f-d694-40d2-9a22-104d2bf0292d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:04.056271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56c67f-d694-40d2-9a22-104d2bf0292d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:04.065288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 598/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:50:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:04.071902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c9a84-0c42-4b4c-9dfc-fc9efd96d450 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:04.122349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:04.178478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c9a84-0c42-4b4c-9dfc-fc9efd96d450 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:04.212106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20fe27-ddd2-449c-a047-218db82a8265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:04.212717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20fe27-ddd2-449c-a047-218db82a8265 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:04.212993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20fe27-ddd2-449c-a047-218db82a8265 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:04.213260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20fe27-ddd2-449c-a047-218db82a8265 None admin] PATH_INFO: `/v3/users/575275c31a0a4a339e71c75913ec2b2e` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:04.214391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20fe27-ddd2-449c-a047-218db82a8265 None admin] RBAC: Authorizing `identity:get_user(user_id=575275c31a0a4a339e71c75913ec2b2e)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:04.215809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20fe27-ddd2-449c-a047-218db82a8265 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:04.217359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 592/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:50:04 2022] GET /identity/v3/users/575275c31a0a4a339e71c75913ec2b2e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:04.223162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56c67f-d694-40d2-9a22-104d2bf0292d None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:04.326422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56c67f-d694-40d2-9a22-104d2bf0292d None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:04.359256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eebf2-15e6-425f-9541-726d6e7389f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:04.359887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eebf2-15e6-425f-9541-726d6e7389f9 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:04.360169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eebf2-15e6-425f-9541-726d6e7389f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:04.360444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eebf2-15e6-425f-9541-726d6e7389f9 None admin] PATH_INFO: `/v3/projects/e324ffd1e30d48ba9fd4723ae155ab1b` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:04.361556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eebf2-15e6-425f-9541-726d6e7389f9 None admin] RBAC: Authorizing `identity:get_project(project_id=e324ffd1e30d48ba9fd4723ae155ab1b)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:04.363012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eebf2-15e6-425f-9541-726d6e7389f9 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:04.364687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 599/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:50:04 2022] GET /identity/v3/projects/e324ffd1e30d48ba9fd4723ae155ab1b => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:04.370746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20fe27-ddd2-449c-a047-218db82a8265 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:04.468742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20fe27-ddd2-449c-a047-218db82a8265 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:04.484545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:04.501270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965915e8-cd9b-4fdb-b933-21ffeb88eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:04.501919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965915e8-cd9b-4fdb-b933-21ffeb88eac3 None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:04.502199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965915e8-cd9b-4fdb-b933-21ffeb88eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:04.502498 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965915e8-cd9b-4fdb-b933-21ffeb88eac3 None admin] PATH_INFO: `/v3/projects/e324ffd1e30d48ba9fd4723ae155ab1b/users/575275c31a0a4a339e71c75913ec2b2e/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:04.504367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965915e8-cd9b-4fdb-b933-21ffeb88eac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e324ffd1e30d48ba9fd4723ae155ab1b, user_id=575275c31a0a4a339e71c75913ec2b2e, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:04.506399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965915e8-cd9b-4fdb-b933-21ffeb88eac3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:04.576943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 593/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:50:04 2022] PUT /identity/v3/projects/e324ffd1e30d48ba9fd4723ae155ab1b/users/575275c31a0a4a339e71c75913ec2b2e/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:50:06.730271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb9445-5da7-4963-8d08-437a04ddf495 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:06.730792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb9445-5da7-4963-8d08-437a04ddf495 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:06.730792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb9445-5da7-4963-8d08-437a04ddf495 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:06.732235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 600/1193] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:50:06.737684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aaf6be-efb3-4cb1-866a-b6e12fc778a1 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:06.738103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aaf6be-efb3-4cb1-866a-b6e12fc778a1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:06.738255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aaf6be-efb3-4cb1-866a-b6e12fc778a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:06.757511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-32aaf6be-efb3-4cb1-866a-b6e12fc778a1 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:50:06.758731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-32aaf6be-efb3-4cb1-866a-b6e12fc778a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:50:06.824591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 594/1194] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:50:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:50:07.096036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb9445-5da7-4963-8d08-437a04ddf495 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:07.138453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:07.198591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb9445-5da7-4963-8d08-437a04ddf495 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:07.231574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f55d1-8923-483f-b65b-2dd969402e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:07.232194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f55d1-8923-483f-b65b-2dd969402e94 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:07.232472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f55d1-8923-483f-b65b-2dd969402e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:07.232796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f55d1-8923-483f-b65b-2dd969402e94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:07.243957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f55d1-8923-483f-b65b-2dd969402e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-278f55d1-8923-483f-b65b-2dd969402e94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:50:07.248886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:50:07.250077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:50:07.251163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 601/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:50:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:50:07.257354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aaf6be-efb3-4cb1-866a-b6e12fc778a1 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:07.354408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aaf6be-efb3-4cb1-866a-b6e12fc778a1 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:07.361611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:07.387597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b3af9-434d-4b29-900f-7a924d056552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:07.388198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3af9-434d-4b29-900f-7a924d056552 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:07.388479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3af9-434d-4b29-900f-7a924d056552 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:07.388753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3af9-434d-4b29-900f-7a924d056552 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:07.389418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b3af9-434d-4b29-900f-7a924d056552 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:50:07.389717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b3af9-434d-4b29-900f-7a924d056552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:07.391098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b3af9-434d-4b29-900f-7a924d056552 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:07.400454 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 595/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:50:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:07.406644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f55d1-8923-483f-b65b-2dd969402e94 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:07.499522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:07.502187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f55d1-8923-483f-b65b-2dd969402e94 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:07.534138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9727b-8922-4e5f-8b82-171bf2578d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:07.534777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9727b-8922-4e5f-8b82-171bf2578d9b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:07.535053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9727b-8922-4e5f-8b82-171bf2578d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:07.535344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9727b-8922-4e5f-8b82-171bf2578d9b None admin] PATH_INFO: `/v3/users/575275c31a0a4a339e71c75913ec2b2e` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:07.537155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9727b-8922-4e5f-8b82-171bf2578d9b None admin] RBAC: Authorizing `identity:get_user(user_id=575275c31a0a4a339e71c75913ec2b2e)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:07.538827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9727b-8922-4e5f-8b82-171bf2578d9b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:07.540699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 602/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Sep 14 11:50:07 2022] GET /identity/v3/users/575275c31a0a4a339e71c75913ec2b2e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:07.546486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b3af9-434d-4b29-900f-7a924d056552 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:07.650743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b3af9-434d-4b29-900f-7a924d056552 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:07.684358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f60253-c621-45c0-a5f5-63cec537aada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:07.684949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f60253-c621-45c0-a5f5-63cec537aada None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:07.685225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f60253-c621-45c0-a5f5-63cec537aada None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:07.685494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f60253-c621-45c0-a5f5-63cec537aada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:07.718340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:07.750069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f60253-c621-45c0-a5f5-63cec537aada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:07.751546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f60253-c621-45c0-a5f5-63cec537aada None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:07.844843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 596/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:50:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:50:07.850883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9727b-8922-4e5f-8b82-171bf2578d9b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:07.947582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9727b-8922-4e5f-8b82-171bf2578d9b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:07.980001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9ecb3-37df-4323-948e-9df5a3147a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:07.980622 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9ecb3-37df-4323-948e-9df5a3147a9c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:07.980914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9ecb3-37df-4323-948e-9df5a3147a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:07.981168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9ecb3-37df-4323-948e-9df5a3147a9c None admin] PATH_INFO: `/v3/projects/e324ffd1e30d48ba9fd4723ae155ab1b` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:07.982292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9ecb3-37df-4323-948e-9df5a3147a9c None admin] RBAC: Authorizing `identity:get_project(project_id=e324ffd1e30d48ba9fd4723ae155ab1b)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:07.983712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9ecb3-37df-4323-948e-9df5a3147a9c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:07.985318 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 603/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Sep 14 11:50:07 2022] GET /identity/v3/projects/e324ffd1e30d48ba9fd4723ae155ab1b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:07.992017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f60253-c621-45c0-a5f5-63cec537aada None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:50:08.055545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:08.087521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f60253-c621-45c0-a5f5-63cec537aada None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:50:08.120164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74e74c-241c-4e60-b653-4d5db92d517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:50:08.120749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74e74c-241c-4e60-b653-4d5db92d517f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:50:08.121025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74e74c-241c-4e60-b653-4d5db92d517f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:50:08.121296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74e74c-241c-4e60-b653-4d5db92d517f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:50:08.122005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74e74c-241c-4e60-b653-4d5db92d517f None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=e324ffd1e30d48ba9fd4723ae155ab1b, user.id=575275c31a0a4a339e71c75913ec2b2e) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:50:08.122337 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74e74c-241c-4e60-b653-4d5db92d517f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:50:08.123741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74e74c-241c-4e60-b653-4d5db92d517f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:50:08.129372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 597/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:50:07 2022] GET /identity/v3/role_assignments?user.id=575275c31a0a4a339e71c75913ec2b2e&scope.project.id=e324ffd1e30d48ba9fd4723ae155ab1b&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:50:17.975996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=82 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:50:18.126764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=34 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:24.773635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0258b-99aa-4f36-a8c1-f1ef4df45885 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:24.774222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0258b-99aa-4f36-a8c1-f1ef4df45885 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:24.774222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0258b-99aa-4f36-a8c1-f1ef4df45885 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:24.775562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 604/1201] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:51:24.781097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f748-925c-45e3-8822-203d6dd424e7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:24.781514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f748-925c-45e3-8822-203d6dd424e7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:24.781620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f748-925c-45e3-8822-203d6dd424e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:24.800911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-63c7f748-925c-45e3-8822-203d6dd424e7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:51:24.802081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-63c7f748-925c-45e3-8822-203d6dd424e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:51:24.867268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 598/1202] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:51:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:51:25.145618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0258b-99aa-4f36-a8c1-f1ef4df45885 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:25.246857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0258b-99aa-4f36-a8c1-f1ef4df45885 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:25.279387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51c392-cd6e-4ae3-a6a3-eee2820f5cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:25.280012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c392-cd6e-4ae3-a6a3-eee2820f5cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:25.280285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c392-cd6e-4ae3-a6a3-eee2820f5cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:25.280552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c392-cd6e-4ae3-a6a3-eee2820f5cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:25.293105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51c392-cd6e-4ae3-a6a3-eee2820f5cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:25.295773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51c392-cd6e-4ae3-a6a3-eee2820f5cf8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-6c51c392-cd6e-4ae3-a6a3-eee2820f5cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:25.312913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:25.316130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:25.317097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:25.317097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:25.317097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:25.317097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 605/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:25.321036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7f748-925c-45e3-8822-203d6dd424e7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:25.418631 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7f748-925c-45e3-8822-203d6dd424e7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:25.447579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:25.453350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4ca16-db26-4a68-8f69-3b35e80ae13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:25.458604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4ca16-db26-4a68-8f69-3b35e80ae13d None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:25.458604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4ca16-db26-4a68-8f69-3b35e80ae13d None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:25.458604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4ca16-db26-4a68-8f69-3b35e80ae13d None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:25.458604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4ca16-db26-4a68-8f69-3b35e80ae13d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:25.458604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4ca16-db26-4a68-8f69-3b35e80ae13d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:25.458604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4ca16-db26-4a68-8f69-3b35e80ae13d None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:25.467798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 599/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:25.474185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51c392-cd6e-4ae3-a6a3-eee2820f5cf8 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:25.525933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:25.571570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51c392-cd6e-4ae3-a6a3-eee2820f5cf8 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:25.604873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501120e5-b51b-4f3d-9195-70fffaf62f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:25.606350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501120e5-b51b-4f3d-9195-70fffaf62f6c None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:25.606350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501120e5-b51b-4f3d-9195-70fffaf62f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:25.606350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501120e5-b51b-4f3d-9195-70fffaf62f6c None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:25.606799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501120e5-b51b-4f3d-9195-70fffaf62f6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:25.608212 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501120e5-b51b-4f3d-9195-70fffaf62f6c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:25.681939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 606/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Sep 14 11:51:25 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:51:27.873137 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2dc9-fcd1-4c32-9cac-18baec93e0db None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:27.873648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2dc9-fcd1-4c32-9cac-18baec93e0db None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:27.873648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f2dc9-fcd1-4c32-9cac-18baec93e0db None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:27.875099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 600/1206] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:51:27.880982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ce164-4ce3-4e36-976e-4444ef0f7be7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:27.881405 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ce164-4ce3-4e36-976e-4444ef0f7be7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:27.881567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ce164-4ce3-4e36-976e-4444ef0f7be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:27.900237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-760ce164-4ce3-4e36-976e-4444ef0f7be7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:51:27.909445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-760ce164-4ce3-4e36-976e-4444ef0f7be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:51:27.967601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 607/1207] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:51:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:51:28.257665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f2dc9-fcd1-4c32-9cac-18baec93e0db None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:28.361813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f2dc9-fcd1-4c32-9cac-18baec93e0db None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:28.395415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef61e40-83b4-4bb0-8fd3-79e69cb53fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:28.395982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef61e40-83b4-4bb0-8fd3-79e69cb53fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:28.396259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef61e40-83b4-4bb0-8fd3-79e69cb53fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:28.396529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef61e40-83b4-4bb0-8fd3-79e69cb53fa1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:28.406322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef61e40-83b4-4bb0-8fd3-79e69cb53fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-5ef61e40-83b4-4bb0-8fd3-79e69cb53fa1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:51:28.411639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:28.412721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:28.413905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 601/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:28.418806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ce164-4ce3-4e36-976e-4444ef0f7be7 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:28.457040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:28.518125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ce164-4ce3-4e36-976e-4444ef0f7be7 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:28.552327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbf1e6-981d-4903-ae16-bf6c73e94a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:28.552930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf1e6-981d-4903-ae16-bf6c73e94a8d None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:28.553212 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf1e6-981d-4903-ae16-bf6c73e94a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:28.553490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbf1e6-981d-4903-ae16-bf6c73e94a8d None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:28.554177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbf1e6-981d-4903-ae16-bf6c73e94a8d None admin] RBAC: Adding query filter params (name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:28.554516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbf1e6-981d-4903-ae16-bf6c73e94a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:28.555883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbf1e6-981d-4903-ae16-bf6c73e94a8d None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:28.563909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 608/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:28.569951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef61e40-83b4-4bb0-8fd3-79e69cb53fa1 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:28.622345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:28.670289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef61e40-83b4-4bb0-8fd3-79e69cb53fa1 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:28.703001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a8a9-f0ff-4d9f-8719-a895ababd459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:28.704212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a8a9-f0ff-4d9f-8719-a895ababd459 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:28.704488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a8a9-f0ff-4d9f-8719-a895ababd459 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:28.704758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a8a9-f0ff-4d9f-8719-a895ababd459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:28.714839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85a8a9-f0ff-4d9f-8719-a895ababd459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:28.716256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85a8a9-f0ff-4d9f-8719-a895ababd459 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-9e85a8a9-f0ff-4d9f-8719-a895ababd459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:28.730607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:28.731864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:28.733029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:28.733029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:28.733029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:28.733029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 602/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:28.737857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbf1e6-981d-4903-ae16-bf6c73e94a8d None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:28.836634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:28.839433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbf1e6-981d-4903-ae16-bf6c73e94a8d None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:28.873082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9422e7-e7ea-4183-a449-d4bda5f0b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:28.873687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9422e7-e7ea-4183-a449-d4bda5f0b76c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:28.874015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9422e7-e7ea-4183-a449-d4bda5f0b76c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:28.874332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9422e7-e7ea-4183-a449-d4bda5f0b76c None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:28.880096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9422e7-e7ea-4183-a449-d4bda5f0b76c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:28.880096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9422e7-e7ea-4183-a449-d4bda5f0b76c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:28.880096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9422e7-e7ea-4183-a449-d4bda5f0b76c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:28.889128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 609/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:28.895298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a8a9-f0ff-4d9f-8719-a895ababd459 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:28.997150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a8a9-f0ff-4d9f-8719-a895ababd459 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:28.998715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:29.030840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736f84-f102-4706-aa0b-ebd451a58419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:29.031462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736f84-f102-4706-aa0b-ebd451a58419 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:29.031893 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736f84-f102-4706-aa0b-ebd451a58419 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:29.032253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5736f84-f102-4706-aa0b-ebd451a58419 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:29.038882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5736f84-f102-4706-aa0b-ebd451a58419 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:29.040353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5736f84-f102-4706-aa0b-ebd451a58419 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-e5736f84-f102-4706-aa0b-ebd451a58419 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:51:29.052165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:29.053568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:29.054821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 603/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 11:51:29.059244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9422e7-e7ea-4183-a449-d4bda5f0b76c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:29.161962 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9422e7-e7ea-4183-a449-d4bda5f0b76c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:29.197017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507322cd-49d6-4d6e-93e3-f0bc4e8ae18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:29.197663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507322cd-49d6-4d6e-93e3-f0bc4e8ae18a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:29.197929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507322cd-49d6-4d6e-93e3-f0bc4e8ae18a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:29.198202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507322cd-49d6-4d6e-93e3-f0bc4e8ae18a None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:29.198956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507322cd-49d6-4d6e-93e3-f0bc4e8ae18a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:29.199265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507322cd-49d6-4d6e-93e3-f0bc4e8ae18a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:29.200698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507322cd-49d6-4d6e-93e3-f0bc4e8ae18a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:29.217402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 610/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Sep 14 11:51:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:29.224125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736f84-f102-4706-aa0b-ebd451a58419 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:29.322907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5736f84-f102-4706-aa0b-ebd451a58419 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:29.356014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a4701-c909-4fc5-996f-9430a69cdb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:29.356641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a4701-c909-4fc5-996f-9430a69cdb03 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:29.356917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a4701-c909-4fc5-996f-9430a69cdb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:29.357183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a4701-c909-4fc5-996f-9430a69cdb03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:29.387451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:29.424793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a4701-c909-4fc5-996f-9430a69cdb03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:29.426167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a4701-c909-4fc5-996f-9430a69cdb03 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:29.522928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 604/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:51:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:51:29.528770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507322cd-49d6-4d6e-93e3-f0bc4e8ae18a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:29.547890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:29.625020 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507322cd-49d6-4d6e-93e3-f0bc4e8ae18a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:29.658909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa6270-2eeb-45e3-a8a0-2e834760b76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:29.659565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa6270-2eeb-45e3-a8a0-2e834760b76a None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:29.659845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa6270-2eeb-45e3-a8a0-2e834760b76a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:29.660107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa6270-2eeb-45e3-a8a0-2e834760b76a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:29.670687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa6270-2eeb-45e3-a8a0-2e834760b76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:29.672633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa6270-2eeb-45e3-a8a0-2e834760b76a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-ebaa6270-2eeb-45e3-a8a0-2e834760b76a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:29.687561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:29.689291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:29.690485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:29.690485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:29.690485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:29.690485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 611/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:29.695113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a4701-c909-4fc5-996f-9430a69cdb03 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:29.755639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:29.792863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a4701-c909-4fc5-996f-9430a69cdb03 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:29.825460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08476883-e972-4346-b8fb-bae004f32342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:29.826055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08476883-e972-4346-b8fb-bae004f32342 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:29.826362 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08476883-e972-4346-b8fb-bae004f32342 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:29.826635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08476883-e972-4346-b8fb-bae004f32342 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:29.827269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08476883-e972-4346-b8fb-bae004f32342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:29.827569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08476883-e972-4346-b8fb-bae004f32342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:29.829309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08476883-e972-4346-b8fb-bae004f32342 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:29.840321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 605/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:29.846787 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa6270-2eeb-45e3-a8a0-2e834760b76a None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:29.915782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:29.946255 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa6270-2eeb-45e3-a8a0-2e834760b76a None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:29.979661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cefa6e-22d2-4586-921b-4cd6c092d6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:29.980291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cefa6e-22d2-4586-921b-4cd6c092d6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:29.980572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cefa6e-22d2-4586-921b-4cd6c092d6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:29.980847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cefa6e-22d2-4586-921b-4cd6c092d6d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:29.987793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cefa6e-22d2-4586-921b-4cd6c092d6d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:29.989222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cefa6e-22d2-4586-921b-4cd6c092d6d8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-67cefa6e-22d2-4586-921b-4cd6c092d6d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:51:30.001105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:30.002179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:30.003342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:51:30.003342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:51:30.003342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:51:30.003342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:51:30.003342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:51:30.003342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:51:30.003342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:30.003342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:30.003342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 612/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:30.008694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08476883-e972-4346-b8fb-bae004f32342 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:30.106235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08476883-e972-4346-b8fb-bae004f32342 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:30.129595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:30.153250 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002c4de-b24d-4d71-bfd9-7c832f622ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:30.153860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002c4de-b24d-4d71-bfd9-7c832f622ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:30.154138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002c4de-b24d-4d71-bfd9-7c832f622ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:30.154435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002c4de-b24d-4d71-bfd9-7c832f622ae7 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:30.155121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002c4de-b24d-4d71-bfd9-7c832f622ae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:30.155421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002c4de-b24d-4d71-bfd9-7c832f622ae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:30.157122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002c4de-b24d-4d71-bfd9-7c832f622ae7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:30.176712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 606/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:30.182969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cefa6e-22d2-4586-921b-4cd6c092d6d8 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:30.285167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cefa6e-22d2-4586-921b-4cd6c092d6d8 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:30.314105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:30.319939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d263e7-8233-49f0-9650-6f0fd32ef807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:30.320692 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d263e7-8233-49f0-9650-6f0fd32ef807 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:30.320875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d263e7-8233-49f0-9650-6f0fd32ef807 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:30.321145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d263e7-8233-49f0-9650-6f0fd32ef807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:30.321860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d263e7-8233-49f0-9650-6f0fd32ef807 None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=877b59ec265f42e4bf8edbd9767e3319) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:30.322167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d263e7-8233-49f0-9650-6f0fd32ef807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:30.323662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d263e7-8233-49f0-9650-6f0fd32ef807 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:30.329246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 613/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:51:30 2022] GET /identity/v3/role_assignments?user.id=877b59ec265f42e4bf8edbd9767e3319&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:32.455660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a7d78-6612-432e-aa12-5f0926fa8e59 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:32.456221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a7d78-6612-432e-aa12-5f0926fa8e59 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:32.456221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a7d78-6612-432e-aa12-5f0926fa8e59 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:32.457620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 607/1220] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:51:32.462885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41846170-c8f6-438f-bf75-75fea71d3d6e None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:32.463325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41846170-c8f6-438f-bf75-75fea71d3d6e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:32.463426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41846170-c8f6-438f-bf75-75fea71d3d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:32.482326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-41846170-c8f6-438f-bf75-75fea71d3d6e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:51:32.483508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-41846170-c8f6-438f-bf75-75fea71d3d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:51:32.552925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 614/1221] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:51:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:51:32.824933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a7d78-6612-432e-aa12-5f0926fa8e59 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:32.924779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a7d78-6612-432e-aa12-5f0926fa8e59 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:32.959665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fe7e-dad1-4a58-947c-dd9c5d98bbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:32.960289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fe7e-dad1-4a58-947c-dd9c5d98bbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:32.960674 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fe7e-dad1-4a58-947c-dd9c5d98bbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:32.960949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fe7e-dad1-4a58-947c-dd9c5d98bbe6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:32.970851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3fe7e-dad1-4a58-947c-dd9c5d98bbe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-63b3fe7e-dad1-4a58-947c-dd9c5d98bbe6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:51:32.975614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:32.976724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:32.977753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 608/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:32.982970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41846170-c8f6-438f-bf75-75fea71d3d6e None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:33.079769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41846170-c8f6-438f-bf75-75fea71d3d6e None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:33.102332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:33.112589 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f215db-159a-44e9-917c-ae8f85901da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:33.113192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f215db-159a-44e9-917c-ae8f85901da5 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:33.113470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f215db-159a-44e9-917c-ae8f85901da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:33.113743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f215db-159a-44e9-917c-ae8f85901da5 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:33.114438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f215db-159a-44e9-917c-ae8f85901da5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:33.114744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f215db-159a-44e9-917c-ae8f85901da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:33.116094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f215db-159a-44e9-917c-ae8f85901da5 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:33.123711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 615/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:33.129947 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fe7e-dad1-4a58-947c-dd9c5d98bbe6 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:33.172509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:33.226314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fe7e-dad1-4a58-947c-dd9c5d98bbe6 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:33.259788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856adba-54be-4eb5-86d5-0a2982d917e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:33.260399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856adba-54be-4eb5-86d5-0a2982d917e5 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:33.260673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856adba-54be-4eb5-86d5-0a2982d917e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:33.260941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856adba-54be-4eb5-86d5-0a2982d917e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:33.270726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856adba-54be-4eb5-86d5-0a2982d917e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:33.272181 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856adba-54be-4eb5-86d5-0a2982d917e5 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-e856adba-54be-4eb5-86d5-0a2982d917e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:33.287035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:33.287995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:33.288883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:33.288883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:33.288883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:33.288883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 609/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:33.299373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f215db-159a-44e9-917c-ae8f85901da5 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:33.397877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f215db-159a-44e9-917c-ae8f85901da5 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:33.431057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb5bbc-8406-46c7-b0cf-fe527c9f7e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:33.435387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb5bbc-8406-46c7-b0cf-fe527c9f7e8c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:33.435387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb5bbc-8406-46c7-b0cf-fe527c9f7e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:33.435387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb5bbc-8406-46c7-b0cf-fe527c9f7e8c None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:33.435387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb5bbc-8406-46c7-b0cf-fe527c9f7e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:33.435387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb5bbc-8406-46c7-b0cf-fe527c9f7e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:33.435387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb5bbc-8406-46c7-b0cf-fe527c9f7e8c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:33.447235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 616/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:33.453040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856adba-54be-4eb5-86d5-0a2982d917e5 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:33.552755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:33.559552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856adba-54be-4eb5-86d5-0a2982d917e5 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:33.595278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce729d-6b45-4d27-ba1b-3889950104fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:33.595909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce729d-6b45-4d27-ba1b-3889950104fa None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:33.596189 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce729d-6b45-4d27-ba1b-3889950104fa None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:33.596462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce729d-6b45-4d27-ba1b-3889950104fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:33.603689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce729d-6b45-4d27-ba1b-3889950104fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:33.605532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce729d-6b45-4d27-ba1b-3889950104fa None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-55ce729d-6b45-4d27-ba1b-3889950104fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:51:33.617453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:33.619920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:33.621621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 610/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:33.624577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb5bbc-8406-46c7-b0cf-fe527c9f7e8c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:33.673408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:33.727552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb5bbc-8406-46c7-b0cf-fe527c9f7e8c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:33.767567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662a861-153f-4425-82de-252666a039ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:33.768181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a861-153f-4425-82de-252666a039ce None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:33.768464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a861-153f-4425-82de-252666a039ce None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:33.768739 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a861-153f-4425-82de-252666a039ce None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:33.769548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662a861-153f-4425-82de-252666a039ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:33.769782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662a861-153f-4425-82de-252666a039ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:33.771259 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662a861-153f-4425-82de-252666a039ce None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:33.788105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 617/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Sep 14 11:51:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:33.793978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce729d-6b45-4d27-ba1b-3889950104fa None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:33.893627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce729d-6b45-4d27-ba1b-3889950104fa None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:33.927285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f5bb3-675f-4974-ba82-ed18929c51ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:33.927976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f5bb3-675f-4974-ba82-ed18929c51ef None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:33.928257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f5bb3-675f-4974-ba82-ed18929c51ef None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:33.928532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f5bb3-675f-4974-ba82-ed18929c51ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:33.939975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f5bb3-675f-4974-ba82-ed18929c51ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:33.941408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f5bb3-675f-4974-ba82-ed18929c51ef None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-056f5bb3-675f-4974-ba82-ed18929c51ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:33.956241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:33.957371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:33.958339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:33.958339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:33.958339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:33.958339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 611/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:33.963103 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662a861-153f-4425-82de-252666a039ce None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:34.062534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662a861-153f-4425-82de-252666a039ce None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:34.064879 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:34.095910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28796bb-4255-48d4-bade-de16f9cfe413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:34.096513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28796bb-4255-48d4-bade-de16f9cfe413 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:34.096792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28796bb-4255-48d4-bade-de16f9cfe413 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:34.097063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28796bb-4255-48d4-bade-de16f9cfe413 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:34.097751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28796bb-4255-48d4-bade-de16f9cfe413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:34.098055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28796bb-4255-48d4-bade-de16f9cfe413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:34.099441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28796bb-4255-48d4-bade-de16f9cfe413 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:34.110246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 618/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:34.115958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f5bb3-675f-4974-ba82-ed18929c51ef None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:34.125416 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:34.213952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f5bb3-675f-4974-ba82-ed18929c51ef None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:34.247868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105df54-0e7c-4f1a-8524-9441d9257a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:34.248535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105df54-0e7c-4f1a-8524-9441d9257a54 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:34.248847 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105df54-0e7c-4f1a-8524-9441d9257a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:34.249117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105df54-0e7c-4f1a-8524-9441d9257a54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:34.256210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105df54-0e7c-4f1a-8524-9441d9257a54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:34.257626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105df54-0e7c-4f1a-8524-9441d9257a54 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-3105df54-0e7c-4f1a-8524-9441d9257a54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:51:34.269303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:34.270153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:34.271102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:51:34.271102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:51:34.271102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:51:34.271102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:51:34.271102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:51:34.271102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:51:34.271102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:34.271102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:34.271102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 612/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:34.276326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28796bb-4255-48d4-bade-de16f9cfe413 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:34.382831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28796bb-4255-48d4-bade-de16f9cfe413 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:34.415552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3618569-4c78-4d39-b649-da933ed030c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:34.416515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618569-4c78-4d39-b649-da933ed030c5 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:34.416515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618569-4c78-4d39-b649-da933ed030c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:34.416707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618569-4c78-4d39-b649-da933ed030c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:34.417385 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3618569-4c78-4d39-b649-da933ed030c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:34.417687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3618569-4c78-4d39-b649-da933ed030c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:34.419133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3618569-4c78-4d39-b649-da933ed030c5 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:34.430947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 619/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:34.436999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105df54-0e7c-4f1a-8524-9441d9257a54 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:34.502064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:34.535913 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105df54-0e7c-4f1a-8524-9441d9257a54 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:34.568403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeab3cb-2940-4e8f-bc7e-71675b0cd8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:34.569053 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeab3cb-2940-4e8f-bc7e-71675b0cd8ec None admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:34.569333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeab3cb-2940-4e8f-bc7e-71675b0cd8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:34.569614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeab3cb-2940-4e8f-bc7e-71675b0cd8ec None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/877b59ec265f42e4bf8edbd9767e3319/roles/7667dacf895b4ae09b42a6ce839f2192` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:34.583326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeab3cb-2940-4e8f-bc7e-71675b0cd8ec None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=877b59ec265f42e4bf8edbd9767e3319, role_id=7667dacf895b4ae09b42a6ce839f2192)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:34.594476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeab3cb-2940-4e8f-bc7e-71675b0cd8ec None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:34.800919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 613/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:51:34 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/877b59ec265f42e4bf8edbd9767e3319/roles/7667dacf895b4ae09b42a6ce839f2192 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:51:36.945390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17238-3334-4a58-9ba5-c66b3bcb7cfc None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:36.945945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17238-3334-4a58-9ba5-c66b3bcb7cfc None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:36.945945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e17238-3334-4a58-9ba5-c66b3bcb7cfc None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:36.947356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 620/1233] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:51:36.952569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc52ec-f4cf-48c5-b2a8-41ebfb5f8f0c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:36.953733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc52ec-f4cf-48c5-b2a8-41ebfb5f8f0c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:36.953733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc52ec-f4cf-48c5-b2a8-41ebfb5f8f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:36.972942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2fcc52ec-f4cf-48c5-b2a8-41ebfb5f8f0c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:51:36.974121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2fcc52ec-f4cf-48c5-b2a8-41ebfb5f8f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:51:37.039129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 614/1234] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:51:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:51:37.317090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17238-3334-4a58-9ba5-c66b3bcb7cfc None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:37.342924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:37.418788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e17238-3334-4a58-9ba5-c66b3bcb7cfc None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:37.460672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c2c9c-c586-48d2-bdb8-ed53bef0ec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:37.461310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c2c9c-c586-48d2-bdb8-ed53bef0ec4e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:37.461584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c2c9c-c586-48d2-bdb8-ed53bef0ec4e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:37.461854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c2c9c-c586-48d2-bdb8-ed53bef0ec4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:37.471740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c2c9c-c586-48d2-bdb8-ed53bef0ec4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-890c2c9c-c586-48d2-bdb8-ed53bef0ec4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:51:37.476588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:37.477683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:37.478854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 621/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Sep 14 11:51:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:37.483715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc52ec-f4cf-48c5-b2a8-41ebfb5f8f0c None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:37.529223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:37.582712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc52ec-f4cf-48c5-b2a8-41ebfb5f8f0c None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:37.616949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32535f4f-3726-4208-849b-97c2217b9d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:37.618052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32535f4f-3726-4208-849b-97c2217b9d2b None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:37.618052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32535f4f-3726-4208-849b-97c2217b9d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:37.618052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32535f4f-3726-4208-849b-97c2217b9d2b None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:37.618886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32535f4f-3726-4208-849b-97c2217b9d2b None admin] RBAC: Adding query filter params (name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:37.619188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32535f4f-3726-4208-849b-97c2217b9d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:37.620548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32535f4f-3726-4208-849b-97c2217b9d2b None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:37.629791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 615/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Sep 14 11:51:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:37.635563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c2c9c-c586-48d2-bdb8-ed53bef0ec4e None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:37.725082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:37.745675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c2c9c-c586-48d2-bdb8-ed53bef0ec4e None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:37.780607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063d8ce-2a93-42bf-8a78-7f7a74ff4ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:37.781379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063d8ce-2a93-42bf-8a78-7f7a74ff4ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:37.781921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063d8ce-2a93-42bf-8a78-7f7a74ff4ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:37.782173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063d8ce-2a93-42bf-8a78-7f7a74ff4ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:37.794066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063d8ce-2a93-42bf-8a78-7f7a74ff4ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:37.795556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063d8ce-2a93-42bf-8a78-7f7a74ff4ee2 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-2063d8ce-2a93-42bf-8a78-7f7a74ff4ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:37.814661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:37.815768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:37.816859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:37.816859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:37.816859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:37.816859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 622/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:37.821902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32535f4f-3726-4208-849b-97c2217b9d2b None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:37.919552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32535f4f-3726-4208-849b-97c2217b9d2b None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:37.928256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:37.951799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009dcb-4745-4c3f-89e8-776c4a2903b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:37.952388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009dcb-4745-4c3f-89e8-776c4a2903b2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:37.952662 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009dcb-4745-4c3f-89e8-776c4a2903b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:37.953825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009dcb-4745-4c3f-89e8-776c4a2903b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:37.954167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c009dcb-4745-4c3f-89e8-776c4a2903b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:37.954536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c009dcb-4745-4c3f-89e8-776c4a2903b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:37.955889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c009dcb-4745-4c3f-89e8-776c4a2903b2 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:37.967039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 616/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:37.973336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063d8ce-2a93-42bf-8a78-7f7a74ff4ee2 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:38.071531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063d8ce-2a93-42bf-8a78-7f7a74ff4ee2 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:38.105046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd4cae-4093-4c37-936e-4bed0c653aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:38.105679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd4cae-4093-4c37-936e-4bed0c653aeb None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:38.107335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd4cae-4093-4c37-936e-4bed0c653aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:38.107335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd4cae-4093-4c37-936e-4bed0c653aeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:38.108830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:38.113750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd4cae-4093-4c37-936e-4bed0c653aeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:38.115218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd4cae-4093-4c37-936e-4bed0c653aeb None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-b0bd4cae-4093-4c37-936e-4bed0c653aeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:51:38.127400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:38.128623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:38.129950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 623/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:38.134694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009dcb-4745-4c3f-89e8-776c4a2903b2 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:38.235262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009dcb-4745-4c3f-89e8-776c4a2903b2 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:38.273840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a41af0-899f-46af-a733-13c8a8595cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:38.275478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a41af0-899f-46af-a733-13c8a8595cfb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:38.275478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a41af0-899f-46af-a733-13c8a8595cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:38.275478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a41af0-899f-46af-a733-13c8a8595cfb None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:38.275801 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a41af0-899f-46af-a733-13c8a8595cfb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:38.276088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a41af0-899f-46af-a733-13c8a8595cfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:38.277560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a41af0-899f-46af-a733-13c8a8595cfb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:38.294954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 617/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Sep 14 11:51:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:38.300790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd4cae-4093-4c37-936e-4bed0c653aeb None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:38.401115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd4cae-4093-4c37-936e-4bed0c653aeb None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:38.439750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf041936-8b9e-4a67-b550-96cda729afb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:38.440398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf041936-8b9e-4a67-b550-96cda729afb7 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:38.440683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf041936-8b9e-4a67-b550-96cda729afb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:38.440956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf041936-8b9e-4a67-b550-96cda729afb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:38.534024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:38.540261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf041936-8b9e-4a67-b550-96cda729afb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:38.541710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf041936-8b9e-4a67-b550-96cda729afb7 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:38.637363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 624/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:51:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:51:38.643532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a41af0-899f-46af-a733-13c8a8595cfb None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:38.669642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:38.742647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a41af0-899f-46af-a733-13c8a8595cfb None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:38.775529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f72711-dae1-4250-aca8-282cc93329f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:38.776153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f72711-dae1-4250-aca8-282cc93329f7 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:38.776432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f72711-dae1-4250-aca8-282cc93329f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:38.776704 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f72711-dae1-4250-aca8-282cc93329f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:38.791717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f72711-dae1-4250-aca8-282cc93329f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:38.791717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f72711-dae1-4250-aca8-282cc93329f7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-47f72711-dae1-4250-aca8-282cc93329f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:38.803829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:38.805323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:38.806439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:38.806439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:38.806439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:38.806439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 618/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:38.810853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf041936-8b9e-4a67-b550-96cda729afb7 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:38.904122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:38.910567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf041936-8b9e-4a67-b550-96cda729afb7 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:38.943776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94f8ca-3c56-462b-8bdd-ac17884a2ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:38.944373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f8ca-3c56-462b-8bdd-ac17884a2ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:38.944652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f8ca-3c56-462b-8bdd-ac17884a2ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:38.944921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f8ca-3c56-462b-8bdd-ac17884a2ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:38.945559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94f8ca-3c56-462b-8bdd-ac17884a2ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:38.945859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94f8ca-3c56-462b-8bdd-ac17884a2ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:38.947355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94f8ca-3c56-462b-8bdd-ac17884a2ba6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:38.958937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 625/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:38.964679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f72711-dae1-4250-aca8-282cc93329f7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:39.044868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:39.067015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f72711-dae1-4250-aca8-282cc93329f7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:39.100097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed038a76-f668-4ce3-aa2c-a449169b1125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:39.100748 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed038a76-f668-4ce3-aa2c-a449169b1125 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:39.101028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed038a76-f668-4ce3-aa2c-a449169b1125 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:39.101300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed038a76-f668-4ce3-aa2c-a449169b1125 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:39.107673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed038a76-f668-4ce3-aa2c-a449169b1125 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:39.109201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed038a76-f668-4ce3-aa2c-a449169b1125 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-ed038a76-f668-4ce3-aa2c-a449169b1125 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:51:39.123070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:39.124147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:39.125877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:51:39.125877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:51:39.125877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:51:39.125877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:51:39.125877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:51:39.125877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:51:39.125877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:39.125877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:39.125877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 619/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:39.130889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94f8ca-3c56-462b-8bdd-ac17884a2ba6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:39.232038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94f8ca-3c56-462b-8bdd-ac17884a2ba6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:39.264844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8c24f-6e30-419a-9b49-617e17a0b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:39.265491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8c24f-6e30-419a-9b49-617e17a0b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:39.265812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8c24f-6e30-419a-9b49-617e17a0b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:39.266086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8c24f-6e30-419a-9b49-617e17a0b1b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:39.266793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8c24f-6e30-419a-9b49-617e17a0b1b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:39.267097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8c24f-6e30-419a-9b49-617e17a0b1b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:39.268506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8c24f-6e30-419a-9b49-617e17a0b1b7 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:39.279891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 626/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:39.286042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed038a76-f668-4ce3-aa2c-a449169b1125 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:39.384832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed038a76-f668-4ce3-aa2c-a449169b1125 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:39.419400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08514e1d-dc8b-47e3-b86a-c535ff116624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:39.422915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08514e1d-dc8b-47e3-b86a-c535ff116624 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:39.422915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08514e1d-dc8b-47e3-b86a-c535ff116624 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:39.422915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08514e1d-dc8b-47e3-b86a-c535ff116624 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:39.422915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08514e1d-dc8b-47e3-b86a-c535ff116624 None admin] RBAC: Adding query filter params (role.id=7667dacf895b4ae09b42a6ce839f2192, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=877b59ec265f42e4bf8edbd9767e3319) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:39.422915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08514e1d-dc8b-47e3-b86a-c535ff116624 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:39.423753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08514e1d-dc8b-47e3-b86a-c535ff116624 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:39.429518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 620/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:51:39 2022] GET /identity/v3/role_assignments?user.id=877b59ec265f42e4bf8edbd9767e3319&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=7667dacf895b4ae09b42a6ce839f2192 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:41.639629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1b423-1a5e-4278-811b-db476b3845ed None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:41.640090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1b423-1a5e-4278-811b-db476b3845ed None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:41.640182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1b423-1a5e-4278-811b-db476b3845ed None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:41.642222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 627/1247] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:51:41.647628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea99ae5-381c-41f7-80ac-4bc89c9e2cf9 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:41.648049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea99ae5-381c-41f7-80ac-4bc89c9e2cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:41.648179 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea99ae5-381c-41f7-80ac-4bc89c9e2cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:41.654523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:41.667309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2ea99ae5-381c-41f7-80ac-4bc89c9e2cf9 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:51:41.668507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2ea99ae5-381c-41f7-80ac-4bc89c9e2cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:51:41.733536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 621/1248] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:51:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:51:42.003522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1b423-1a5e-4278-811b-db476b3845ed None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:42.021431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:42.102787 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1b423-1a5e-4278-811b-db476b3845ed None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:42.135795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bf96d-48bf-4201-940c-d62e4e3da088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:42.136425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf96d-48bf-4201-940c-d62e4e3da088 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:42.136703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf96d-48bf-4201-940c-d62e4e3da088 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:42.136977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf96d-48bf-4201-940c-d62e4e3da088 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:42.148149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bf96d-48bf-4201-940c-d62e4e3da088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-889bf96d-48bf-4201-940c-d62e4e3da088 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:51:42.152981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:42.154076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:42.154990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 628/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:51:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:42.160148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea99ae5-381c-41f7-80ac-4bc89c9e2cf9 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:42.260474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea99ae5-381c-41f7-80ac-4bc89c9e2cf9 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:42.290160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:42.297200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae01c9-1a31-4d55-994e-687c7c782225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:42.297871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae01c9-1a31-4d55-994e-687c7c782225 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:42.298150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae01c9-1a31-4d55-994e-687c7c782225 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:42.298494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae01c9-1a31-4d55-994e-687c7c782225 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:42.299122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae01c9-1a31-4d55-994e-687c7c782225 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:42.299430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae01c9-1a31-4d55-994e-687c7c782225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:42.300793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae01c9-1a31-4d55-994e-687c7c782225 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:42.309263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 622/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:51:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:42.316320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bf96d-48bf-4201-940c-d62e4e3da088 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:42.394934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:42.417194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bf96d-48bf-4201-940c-d62e4e3da088 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:42.451197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ab52d-1149-4c50-9926-1b4933daafb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:42.451824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab52d-1149-4c50-9926-1b4933daafb2 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:42.452140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab52d-1149-4c50-9926-1b4933daafb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:42.454571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ab52d-1149-4c50-9926-1b4933daafb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:42.462719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ab52d-1149-4c50-9926-1b4933daafb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:42.464211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ab52d-1149-4c50-9926-1b4933daafb2 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-ef4ab52d-1149-4c50-9926-1b4933daafb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:42.478092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:42.479204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:42.480304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:42.480304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:42.480304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:42.480304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 629/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:42.485882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae01c9-1a31-4d55-994e-687c7c782225 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:42.611136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae01c9-1a31-4d55-994e-687c7c782225 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:42.644910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2daaa-05bf-422c-84df-3ff2b66bad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:42.645521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2daaa-05bf-422c-84df-3ff2b66bad9a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:42.645800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2daaa-05bf-422c-84df-3ff2b66bad9a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:42.646072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2daaa-05bf-422c-84df-3ff2b66bad9a None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:42.646745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2daaa-05bf-422c-84df-3ff2b66bad9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:42.647053 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2daaa-05bf-422c-84df-3ff2b66bad9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:42.648407 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2daaa-05bf-422c-84df-3ff2b66bad9a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:42.660359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 623/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:51:42.666415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ab52d-1149-4c50-9926-1b4933daafb2 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:42.764063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ab52d-1149-4c50-9926-1b4933daafb2 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:42.790240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:42.798459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c904a-122a-4947-9f11-436f765bfec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:42.799083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c904a-122a-4947-9f11-436f765bfec8 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:42.799360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c904a-122a-4947-9f11-436f765bfec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:42.799632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c904a-122a-4947-9f11-436f765bfec8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:42.806831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c904a-122a-4947-9f11-436f765bfec8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:42.808262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c904a-122a-4947-9f11-436f765bfec8 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-4b8c904a-122a-4947-9f11-436f765bfec8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:51:42.819351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:42.828419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:42.829663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 630/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:42.830399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2daaa-05bf-422c-84df-3ff2b66bad9a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:42.883677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:42.926929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2daaa-05bf-422c-84df-3ff2b66bad9a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:42.960059 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18214e3-c6b8-46c0-bb5c-1309cca0fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:42.960682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18214e3-c6b8-46c0-bb5c-1309cca0fec6 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:42.960965 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18214e3-c6b8-46c0-bb5c-1309cca0fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:42.961239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18214e3-c6b8-46c0-bb5c-1309cca0fec6 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:42.961964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18214e3-c6b8-46c0-bb5c-1309cca0fec6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:42.962300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18214e3-c6b8-46c0-bb5c-1309cca0fec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:42.963718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18214e3-c6b8-46c0-bb5c-1309cca0fec6 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:42.981369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 624/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Sep 14 11:51:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:42.987533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c904a-122a-4947-9f11-436f765bfec8 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:43.087302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c904a-122a-4947-9f11-436f765bfec8 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:43.120041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4ba13-a440-45b9-a6e0-fb293d0af560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:43.120654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ba13-a440-45b9-a6e0-fb293d0af560 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:43.120934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ba13-a440-45b9-a6e0-fb293d0af560 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:43.121210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4ba13-a440-45b9-a6e0-fb293d0af560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:43.174766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:43.187322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4ba13-a440-45b9-a6e0-fb293d0af560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:43.188767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4ba13-a440-45b9-a6e0-fb293d0af560 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:43.284591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 631/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:51:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:51:43.290434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18214e3-c6b8-46c0-bb5c-1309cca0fec6 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:43.390898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18214e3-c6b8-46c0-bb5c-1309cca0fec6 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:43.403535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:43.423532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b8caf-a153-43ea-b7c4-7475658db1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:43.424156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b8caf-a153-43ea-b7c4-7475658db1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:43.424437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b8caf-a153-43ea-b7c4-7475658db1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:43.424710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b8caf-a153-43ea-b7c4-7475658db1e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:43.434357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b8caf-a153-43ea-b7c4-7475658db1e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:43.435742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b8caf-a153-43ea-b7c4-7475658db1e7 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-107b8caf-a153-43ea-b7c4-7475658db1e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:43.450835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:43.451815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:43.453643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:43.453643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:43.453643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:43.453643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 625/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:43.458431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4ba13-a440-45b9-a6e0-fb293d0af560 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:43.542904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:43.554412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4ba13-a440-45b9-a6e0-fb293d0af560 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:43.587992 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b0331-0316-4cf4-9c69-58e0b000a5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:43.588555 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b0331-0316-4cf4-9c69-58e0b000a5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:43.588835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b0331-0316-4cf4-9c69-58e0b000a5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:43.589107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b0331-0316-4cf4-9c69-58e0b000a5a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:43.589778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b0331-0316-4cf4-9c69-58e0b000a5a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:43.590081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b0331-0316-4cf4-9c69-58e0b000a5a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:43.591474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b0331-0316-4cf4-9c69-58e0b000a5a6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:43.602798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 632/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:43.608463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b8caf-a153-43ea-b7c4-7475658db1e7 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:43.707320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b8caf-a153-43ea-b7c4-7475658db1e7 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:43.739744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d731e-7f02-4954-90d2-fc849f149d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:43.740354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d731e-7f02-4954-90d2-fc849f149d75 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:43.740630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d731e-7f02-4954-90d2-fc849f149d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:43.740898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d731e-7f02-4954-90d2-fc849f149d75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:43.747518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d731e-7f02-4954-90d2-fc849f149d75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:43.748933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d731e-7f02-4954-90d2-fc849f149d75 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-fd5d731e-7f02-4954-90d2-fc849f149d75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:51:43.760610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:43.761652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:43.767512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:51:43.767512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:51:43.767512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:51:43.767512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:51:43.767512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:51:43.767512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:51:43.767512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:43.767512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:43.767512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 626/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:43.768121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b0331-0316-4cf4-9c69-58e0b000a5a6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:43.866775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b0331-0316-4cf4-9c69-58e0b000a5a6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:43.900530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e12144-1dc5-427b-82fe-4c74e5601985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:43.901132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e12144-1dc5-427b-82fe-4c74e5601985 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:43.901408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e12144-1dc5-427b-82fe-4c74e5601985 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:43.901675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e12144-1dc5-427b-82fe-4c74e5601985 None admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:43.902386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e12144-1dc5-427b-82fe-4c74e5601985 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:43.902688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e12144-1dc5-427b-82fe-4c74e5601985 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:43.904139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e12144-1dc5-427b-82fe-4c74e5601985 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:43.916143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 633/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:51:43.922807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d731e-7f02-4954-90d2-fc849f149d75 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:43.949121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:44.020721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d731e-7f02-4954-90d2-fc849f149d75 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:44.054559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e38391-6dfa-4371-8407-45dee6cbb7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:44.055144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e38391-6dfa-4371-8407-45dee6cbb7cd None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:44.055420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e38391-6dfa-4371-8407-45dee6cbb7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:44.055694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e38391-6dfa-4371-8407-45dee6cbb7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:44.056473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e38391-6dfa-4371-8407-45dee6cbb7cd None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=877b59ec265f42e4bf8edbd9767e3319) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:44.056814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e38391-6dfa-4371-8407-45dee6cbb7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:44.058424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e38391-6dfa-4371-8407-45dee6cbb7cd None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:44.064669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 627/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:51:43 2022] GET /identity/v3/role_assignments?user.id=877b59ec265f42e4bf8edbd9767e3319&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:46.216046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a955f5-0af0-4a5a-a526-e3a1ba36fea8 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:46.216621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a955f5-0af0-4a5a-a526-e3a1ba36fea8 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:46.216621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a955f5-0af0-4a5a-a526-e3a1ba36fea8 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:46.217950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 634/1261] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:51:46.223287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52aca6b-193c-44aa-a2a7-cda37acdc8cb None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:46.223694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52aca6b-193c-44aa-a2a7-cda37acdc8cb None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:46.223829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52aca6b-193c-44aa-a2a7-cda37acdc8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:46.243231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c52aca6b-193c-44aa-a2a7-cda37acdc8cb None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:51:46.244403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c52aca6b-193c-44aa-a2a7-cda37acdc8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:51:46.315005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 628/1262] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:51:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:51:46.583733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a955f5-0af0-4a5a-a526-e3a1ba36fea8 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:46.595178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:46.687841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a955f5-0af0-4a5a-a526-e3a1ba36fea8 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:46.721350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d46def-bf43-4964-a16e-94a20ca79614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:46.721972 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46def-bf43-4964-a16e-94a20ca79614 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:46.722274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46def-bf43-4964-a16e-94a20ca79614 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:46.722546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46def-bf43-4964-a16e-94a20ca79614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:46.732691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d46def-bf43-4964-a16e-94a20ca79614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-d6d46def-bf43-4964-a16e-94a20ca79614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:51:46.737768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:46.745644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:46.746932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 635/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:51:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:46.747694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52aca6b-193c-44aa-a2a7-cda37acdc8cb None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:46.762849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:46.841355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52aca6b-193c-44aa-a2a7-cda37acdc8cb None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:46.874846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6ec9b-cba9-4f57-bc1d-4b526d3d5716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:46.875444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6ec9b-cba9-4f57-bc1d-4b526d3d5716 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:46.875723 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6ec9b-cba9-4f57-bc1d-4b526d3d5716 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:46.876033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6ec9b-cba9-4f57-bc1d-4b526d3d5716 None admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:46.876688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6ec9b-cba9-4f57-bc1d-4b526d3d5716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:46.876987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6ec9b-cba9-4f57-bc1d-4b526d3d5716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:46.878379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6ec9b-cba9-4f57-bc1d-4b526d3d5716 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:46.886155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 629/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:51:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:46.892583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d46def-bf43-4964-a16e-94a20ca79614 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:46.958414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:46.990610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d46def-bf43-4964-a16e-94a20ca79614 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:47.023561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583f11c-747d-4ee2-895b-c33495f5f19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:47.024182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f11c-747d-4ee2-895b-c33495f5f19e None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:47.024463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f11c-747d-4ee2-895b-c33495f5f19e None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:47.024736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583f11c-747d-4ee2-895b-c33495f5f19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:47.035138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583f11c-747d-4ee2-895b-c33495f5f19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:47.036621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583f11c-747d-4ee2-895b-c33495f5f19e None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-e583f11c-747d-4ee2-895b-c33495f5f19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:47.052782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:47.053940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:47.055203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:47.055203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:47.055203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:47.055203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 636/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:47.059921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6ec9b-cba9-4f57-bc1d-4b526d3d5716 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:47.141769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:47.160614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6ec9b-cba9-4f57-bc1d-4b526d3d5716 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:47.194023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abe2ae-a681-4cf9-aceb-444014b115cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:47.194652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abe2ae-a681-4cf9-aceb-444014b115cb None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:47.194931 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abe2ae-a681-4cf9-aceb-444014b115cb None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:47.195203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abe2ae-a681-4cf9-aceb-444014b115cb None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:47.195836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abe2ae-a681-4cf9-aceb-444014b115cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:47.196135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abe2ae-a681-4cf9-aceb-444014b115cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:47.197490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abe2ae-a681-4cf9-aceb-444014b115cb None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:47.208707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 630/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:47.214522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583f11c-747d-4ee2-895b-c33495f5f19e None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:47.313895 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583f11c-747d-4ee2-895b-c33495f5f19e None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:47.333496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:47.347353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab690-a5a7-4408-9101-bdbcaa3d5dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:47.347981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab690-a5a7-4408-9101-bdbcaa3d5dea None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:47.348265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab690-a5a7-4408-9101-bdbcaa3d5dea None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:47.348539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab690-a5a7-4408-9101-bdbcaa3d5dea None admin] PATH_INFO: `/v3/users/placement` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:47.355705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ab690-a5a7-4408-9101-bdbcaa3d5dea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:47.357143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ab690-a5a7-4408-9101-bdbcaa3d5dea None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-315ab690-a5a7-4408-9101-bdbcaa3d5dea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:51:47.368752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:47.370540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:47.371825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 637/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:47.376195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abe2ae-a681-4cf9-aceb-444014b115cb None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:47.474730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abe2ae-a681-4cf9-aceb-444014b115cb None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:47.508538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e257b7-98ea-4d7d-8096-8ef0f1c61f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:47.509139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e257b7-98ea-4d7d-8096-8ef0f1c61f17 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:47.509420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e257b7-98ea-4d7d-8096-8ef0f1c61f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:47.509692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e257b7-98ea-4d7d-8096-8ef0f1c61f17 None admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:47.510439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e257b7-98ea-4d7d-8096-8ef0f1c61f17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:47.510745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e257b7-98ea-4d7d-8096-8ef0f1c61f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:47.512163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e257b7-98ea-4d7d-8096-8ef0f1c61f17 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:47.523816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:47.529541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 631/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Sep 14 11:51:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 11:51:47.536102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab690-a5a7-4408-9101-bdbcaa3d5dea None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:47.635471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab690-a5a7-4408-9101-bdbcaa3d5dea None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:47.668087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f87a81-08de-4f30-8cb8-b5fe1909e4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:47.668751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f87a81-08de-4f30-8cb8-b5fe1909e4ed None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:47.669025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f87a81-08de-4f30-8cb8-b5fe1909e4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:47.669295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f87a81-08de-4f30-8cb8-b5fe1909e4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:47.679963 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f87a81-08de-4f30-8cb8-b5fe1909e4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:47.681457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f87a81-08de-4f30-8cb8-b5fe1909e4ed None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-f2f87a81-08de-4f30-8cb8-b5fe1909e4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:47.695871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:47.696981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:47.697885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:47.697885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:47.697885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:47.697885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 638/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:47.703400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e257b7-98ea-4d7d-8096-8ef0f1c61f17 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:47.800857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e257b7-98ea-4d7d-8096-8ef0f1c61f17 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:47.835150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d6e55-ab71-4794-bb90-353d71185587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:47.835760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d6e55-ab71-4794-bb90-353d71185587 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:47.838090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d6e55-ab71-4794-bb90-353d71185587 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:47.838090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d6e55-ab71-4794-bb90-353d71185587 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:47.838090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d6e55-ab71-4794-bb90-353d71185587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:47.838090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d6e55-ab71-4794-bb90-353d71185587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:47.838629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d6e55-ab71-4794-bb90-353d71185587 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:47.849878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 632/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:47.855620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f87a81-08de-4f30-8cb8-b5fe1909e4ed None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:47.887155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:47.953696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f87a81-08de-4f30-8cb8-b5fe1909e4ed None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:47.987547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76ae98-6fc7-4425-9755-cb1aafeef7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:47.988167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ae98-6fc7-4425-9755-cb1aafeef7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:47.988444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ae98-6fc7-4425-9755-cb1aafeef7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:47.988715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76ae98-6fc7-4425-9755-cb1aafeef7c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:47.995225 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76ae98-6fc7-4425-9755-cb1aafeef7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:47.996639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76ae98-6fc7-4425-9755-cb1aafeef7c6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-bb76ae98-6fc7-4425-9755-cb1aafeef7c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:51:48.008458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:48.009548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:48.010663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:51:48.010663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:51:48.010663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:51:48.010663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:51:48.010663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:51:48.010663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:51:48.010663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:48.010663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:48.010663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 639/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:48.016425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d6e55-ab71-4794-bb90-353d71185587 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:48.074084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:48.114840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d6e55-ab71-4794-bb90-353d71185587 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:48.153157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddab02-fdf4-4fdc-86b3-b6ffcc39bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:48.153755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddab02-fdf4-4fdc-86b3-b6ffcc39bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:48.154029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddab02-fdf4-4fdc-86b3-b6ffcc39bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:48.154319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddab02-fdf4-4fdc-86b3-b6ffcc39bcb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:48.155006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddab02-fdf4-4fdc-86b3-b6ffcc39bcb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:48.155305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddab02-fdf4-4fdc-86b3-b6ffcc39bcb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:48.157040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddab02-fdf4-4fdc-86b3-b6ffcc39bcb3 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:48.168468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 633/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:51:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:48.174883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76ae98-6fc7-4425-9755-cb1aafeef7c6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:48.266625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:48.278606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76ae98-6fc7-4425-9755-cb1aafeef7c6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:48.312789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb0843-ae27-48d9-ba5d-18ad907705eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:48.313580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb0843-ae27-48d9-ba5d-18ad907705eb None admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:48.313856 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb0843-ae27-48d9-ba5d-18ad907705eb None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:48.314126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb0843-ae27-48d9-ba5d-18ad907705eb None admin] PATH_INFO: `/v3/projects/87de90a658c840a8ba257969f074ad67/users/877b59ec265f42e4bf8edbd9767e3319/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:48.316039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb0843-ae27-48d9-ba5d-18ad907705eb None admin] RBAC: Authorizing `identity:create_grant(project_id=87de90a658c840a8ba257969f074ad67, user_id=877b59ec265f42e4bf8edbd9767e3319, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:48.317455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb0843-ae27-48d9-ba5d-18ad907705eb None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:48.435811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 640/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Sep 14 11:51:48 2022] PUT /identity/v3/projects/87de90a658c840a8ba257969f074ad67/users/877b59ec265f42e4bf8edbd9767e3319/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 11:51:50.559926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27071b-b1cb-427b-a457-84f43da46707 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:50.560567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27071b-b1cb-427b-a457-84f43da46707 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:50.560567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27071b-b1cb-427b-a457-84f43da46707 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:50.561861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 634/1274] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:51:50.567500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef022f-dae0-43d9-93a1-45f53a58fa80 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:50.567890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef022f-dae0-43d9-93a1-45f53a58fa80 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:50.568050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef022f-dae0-43d9-93a1-45f53a58fa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:50.586550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-feef022f-dae0-43d9-93a1-45f53a58fa80 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:51:50.587744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-feef022f-dae0-43d9-93a1-45f53a58fa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:51:50.654406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 641/1275] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:51:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:51:50.922136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27071b-b1cb-427b-a457-84f43da46707 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:51.022740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27071b-b1cb-427b-a457-84f43da46707 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:51.040372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:51.057548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d851a32-8573-4210-a56b-8c6710656281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:51.058190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d851a32-8573-4210-a56b-8c6710656281 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:51.063320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d851a32-8573-4210-a56b-8c6710656281 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:51.063320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d851a32-8573-4210-a56b-8c6710656281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:51.069026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d851a32-8573-4210-a56b-8c6710656281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-5d851a32-8573-4210-a56b-8c6710656281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 11:51:51.073850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:51.074941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:51.075844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 635/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Sep 14 11:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:51.081154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef022f-dae0-43d9-93a1-45f53a58fa80 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:51.162130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:51.179967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef022f-dae0-43d9-93a1-45f53a58fa80 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:51.213036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3023c-919d-42a1-9902-f3e61fff5ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:51.213638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3023c-919d-42a1-9902-f3e61fff5ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:51.213911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3023c-919d-42a1-9902-f3e61fff5ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:51.214176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3023c-919d-42a1-9902-f3e61fff5ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:51.214861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3023c-919d-42a1-9902-f3e61fff5ed9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:51.215162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3023c-919d-42a1-9902-f3e61fff5ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:51.216499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3023c-919d-42a1-9902-f3e61fff5ed9 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:51.225194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 642/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Sep 14 11:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:51.231318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d851a32-8573-4210-a56b-8c6710656281 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:51.333696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d851a32-8573-4210-a56b-8c6710656281 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:51.367292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbe531-573f-44c7-b08c-9966ddbd5c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:51.370194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbe531-573f-44c7-b08c-9966ddbd5c9a None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:51.370194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbe531-573f-44c7-b08c-9966ddbd5c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:51.370194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbe531-573f-44c7-b08c-9966ddbd5c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:51.378297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbe531-573f-44c7-b08c-9966ddbd5c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:51.379724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbe531-573f-44c7-b08c-9966ddbd5c9a None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-4bcbe531-573f-44c7-b08c-9966ddbd5c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:51.394511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:51.395621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:51.396743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:51.396743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:51.396743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:51.396743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 636/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:51.401453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3023c-919d-42a1-9902-f3e61fff5ed9 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:51.499934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3023c-919d-42a1-9902-f3e61fff5ed9 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:51.536107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33a6cd-1c46-4a81-96e8-242c87e237b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:51.536735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33a6cd-1c46-4a81-96e8-242c87e237b6 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:51.537012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33a6cd-1c46-4a81-96e8-242c87e237b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:51.537284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33a6cd-1c46-4a81-96e8-242c87e237b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:51.537922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33a6cd-1c46-4a81-96e8-242c87e237b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:51.538244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33a6cd-1c46-4a81-96e8-242c87e237b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:51.539595 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33a6cd-1c46-4a81-96e8-242c87e237b6 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:51.551271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 643/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:51.556957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbe531-573f-44c7-b08c-9966ddbd5c9a None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:51.587878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:51.658871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbe531-573f-44c7-b08c-9966ddbd5c9a None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:51.692054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9d21b-68a9-40ea-9548-f36dec4bd3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:51.692672 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9d21b-68a9-40ea-9548-f36dec4bd3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:51.692951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9d21b-68a9-40ea-9548-f36dec4bd3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:51.693223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9d21b-68a9-40ea-9548-f36dec4bd3b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:51.700330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9d21b-68a9-40ea-9548-f36dec4bd3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:51.701774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9d21b-68a9-40ea-9548-f36dec4bd3b2 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-4db9d21b-68a9-40ea-9548-f36dec4bd3b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 11:51:51.714636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:51.717645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:51.718999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 637/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:51.721665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33a6cd-1c46-4a81-96e8-242c87e237b6 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:51.725511 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:51.819485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33a6cd-1c46-4a81-96e8-242c87e237b6 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:51.853459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154790f-0e66-48cb-b1dd-3f69c5b2ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:51.854056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154790f-0e66-48cb-b1dd-3f69c5b2ac1b None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:51.854396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154790f-0e66-48cb-b1dd-3f69c5b2ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:51.854665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154790f-0e66-48cb-b1dd-3f69c5b2ac1b None admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:51.855379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154790f-0e66-48cb-b1dd-3f69c5b2ac1b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:51.855819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154790f-0e66-48cb-b1dd-3f69c5b2ac1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:51.857225 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154790f-0e66-48cb-b1dd-3f69c5b2ac1b None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:51.874715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 644/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Sep 14 11:51:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:51.880521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9d21b-68a9-40ea-9548-f36dec4bd3b2 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:51.971779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:51.981717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9d21b-68a9-40ea-9548-f36dec4bd3b2 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:52.015697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790fbee-7a94-4161-98e0-1346e9f85169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:52.016438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790fbee-7a94-4161-98e0-1346e9f85169 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:52.016716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790fbee-7a94-4161-98e0-1346e9f85169 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:52.016985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790fbee-7a94-4161-98e0-1346e9f85169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:52.082513 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790fbee-7a94-4161-98e0-1346e9f85169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:52.083888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790fbee-7a94-4161-98e0-1346e9f85169 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:52.169886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:52.180106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 638/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Sep 14 11:51:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 11:51:52.185937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154790f-0e66-48cb-b1dd-3f69c5b2ac1b None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:52.246975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:52.287928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154790f-0e66-48cb-b1dd-3f69c5b2ac1b None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:52.322313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4b1c3-d733-4889-aed6-d23d50324ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:52.322949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4b1c3-d733-4889-aed6-d23d50324ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:52.323231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4b1c3-d733-4889-aed6-d23d50324ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:52.323505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4b1c3-d733-4889-aed6-d23d50324ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:52.333742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4b1c3-d733-4889-aed6-d23d50324ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:52.335192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4b1c3-d733-4889-aed6-d23d50324ed7 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-bca4b1c3-d733-4889-aed6-d23d50324ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 11:51:52.351124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:52.352245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 11:51:52.353412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 11:51:52.353412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 11:51:52.353412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:52.353412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 645/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 11:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:52.358060 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790fbee-7a94-4161-98e0-1346e9f85169 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:52.481596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790fbee-7a94-4161-98e0-1346e9f85169 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:52.516041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b8b23-5521-4fb0-b73f-fb7afde73c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:52.516632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b8b23-5521-4fb0-b73f-fb7afde73c75 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:52.516910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b8b23-5521-4fb0-b73f-fb7afde73c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:52.517177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b8b23-5521-4fb0-b73f-fb7afde73c75 None admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:52.517810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b8b23-5521-4fb0-b73f-fb7afde73c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:52.518107 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b8b23-5521-4fb0-b73f-fb7afde73c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:52.519488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b8b23-5521-4fb0-b73f-fb7afde73c75 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:52.530713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 639/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Sep 14 11:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:52.536439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4b1c3-d733-4889-aed6-d23d50324ed7 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:52.644301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4b1c3-d733-4889-aed6-d23d50324ed7 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:52.658021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:52.677341 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae1f5f-c737-4bda-b17a-78c3f9277642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:52.677968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1f5f-c737-4bda-b17a-78c3f9277642 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:52.678273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1f5f-c737-4bda-b17a-78c3f9277642 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:52.678547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1f5f-c737-4bda-b17a-78c3f9277642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:52.684905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae1f5f-c737-4bda-b17a-78c3f9277642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:52.686377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae1f5f-c737-4bda-b17a-78c3f9277642 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application [None req-47ae1f5f-c737-4bda-b17a-78c3f9277642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 11:51:52.698267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:52.699309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:52.700536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 11:51:52.700536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 11:51:52.700536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 11:51:52.700536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 11:51:52.700536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 11:51:52.700536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 11:51:52.700536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 11:51:52.700536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: ERROR keystone.server.flask.application Sep 14 11:51:52.700536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 646/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Sep 14 11:51:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:52.706023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b8b23-5521-4fb0-b73f-fb7afde73c75 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:52.755150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:52.803960 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b8b23-5521-4fb0-b73f-fb7afde73c75 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:52.837749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99ed93-b106-4595-89f5-c24ecea3dd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:52.838506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ed93-b106-4595-89f5-c24ecea3dd44 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:52.838790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ed93-b106-4595-89f5-c24ecea3dd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:52.839065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ed93-b106-4595-89f5-c24ecea3dd44 None admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:52.839852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99ed93-b106-4595-89f5-c24ecea3dd44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:52.840156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99ed93-b106-4595-89f5-c24ecea3dd44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:52.841591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99ed93-b106-4595-89f5-c24ecea3dd44 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:52.853524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 640/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Sep 14 11:51:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:52.860223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae1f5f-c737-4bda-b17a-78c3f9277642 None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:52.966481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae1f5f-c737-4bda-b17a-78c3f9277642 None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:52.999816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b15ee2-7d02-4fa5-ad39-8c139bf25baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:53.000453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b15ee2-7d02-4fa5-ad39-8c139bf25baf None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:53.000727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b15ee2-7d02-4fa5-ad39-8c139bf25baf None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:53.000989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b15ee2-7d02-4fa5-ad39-8c139bf25baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:53.001702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b15ee2-7d02-4fa5-ad39-8c139bf25baf None admin] RBAC: Adding query filter params (role.id=57aefe4cb3b1409abaaf216f5107c0bf, scope.project.id=87de90a658c840a8ba257969f074ad67, user.id=877b59ec265f42e4bf8edbd9767e3319) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:53.002003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b15ee2-7d02-4fa5-ad39-8c139bf25baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:53.003447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b15ee2-7d02-4fa5-ad39-8c139bf25baf None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:53.008947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 647/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Sep 14 11:51:52 2022] GET /identity/v3/role_assignments?user.id=877b59ec265f42e4bf8edbd9767e3319&scope.project.id=87de90a658c840a8ba257969f074ad67&role.id=57aefe4cb3b1409abaaf216f5107c0bf => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:55.194651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53cf8d-8890-4a77-86d9-b60f39bec548 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:55.195182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53cf8d-8890-4a77-86d9-b60f39bec548 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:55.195182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53cf8d-8890-4a77-86d9-b60f39bec548 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:55.196529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 641/1288] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:51:55.201677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e37e1-92e4-4ab2-a72f-40b82635bb98 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:55.202599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e37e1-92e4-4ab2-a72f-40b82635bb98 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:55.203314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e37e1-92e4-4ab2-a72f-40b82635bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:55.221354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c90e37e1-92e4-4ab2-a72f-40b82635bb98 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:51:55.229843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c90e37e1-92e4-4ab2-a72f-40b82635bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:51:55.251596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:55.288542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 648/1289] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:51:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:51:55.557243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53cf8d-8890-4a77-86d9-b60f39bec548 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:55.661011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53cf8d-8890-4a77-86d9-b60f39bec548 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:55.672213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:55.695043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827afbc-83e4-4708-9f7b-39d0565df245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:55.695667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827afbc-83e4-4708-9f7b-39d0565df245 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:55.695948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827afbc-83e4-4708-9f7b-39d0565df245 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:55.696221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827afbc-83e4-4708-9f7b-39d0565df245 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:55.696830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827afbc-83e4-4708-9f7b-39d0565df245 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:55.698174 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827afbc-83e4-4708-9f7b-39d0565df245 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-d827afbc-83e4-4708-9f7b-39d0565df245 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:51:55.707422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:51:55.708623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:51:55.709619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 642/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Sep 14 11:51:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:51:55.714582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e37e1-92e4-4ab2-a72f-40b82635bb98 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:55.814814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e37e1-92e4-4ab2-a72f-40b82635bb98 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:55.849229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de194d-b253-4fd5-b3e3-3fdc23495081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:55.849838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de194d-b253-4fd5-b3e3-3fdc23495081 None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:55.850115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de194d-b253-4fd5-b3e3-3fdc23495081 None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:55.850415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de194d-b253-4fd5-b3e3-3fdc23495081 None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:55.851040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de194d-b253-4fd5-b3e3-3fdc23495081 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:55.851411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de194d-b253-4fd5-b3e3-3fdc23495081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:55.852761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de194d-b253-4fd5-b3e3-3fdc23495081 None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:55.857413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 649/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Wed Sep 14 11:51:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:55.863548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827afbc-83e4-4708-9f7b-39d0565df245 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:55.963217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827afbc-83e4-4708-9f7b-39d0565df245 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:55.996764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f3148-6e24-47a5-9de1-392352330c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:55.997357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f3148-6e24-47a5-9de1-392352330c99 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:55.997634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f3148-6e24-47a5-9de1-392352330c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:55.997904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f3148-6e24-47a5-9de1-392352330c99 None admin] PATH_INFO: `/v3/services` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:55.998551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f3148-6e24-47a5-9de1-392352330c99 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:51:55.998957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f3148-6e24-47a5-9de1-392352330c99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:56.000352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f3148-6e24-47a5-9de1-392352330c99 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:56.004888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 643/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Wed Sep 14 11:51:55 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:51:58.149136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb142bd1-3aa6-426a-985d-2d608f14e3ca None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:58.149675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb142bd1-3aa6-426a-985d-2d608f14e3ca None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:58.149675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb142bd1-3aa6-426a-985d-2d608f14e3ca None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:58.151058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 650/1293] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:51:58.156643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b429-13c4-4962-9dc3-be4d0c8ec3e4 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:58.159382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b429-13c4-4962-9dc3-be4d0c8ec3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:58.159382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b429-13c4-4962-9dc3-be4d0c8ec3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:58.175890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2281b429-13c4-4962-9dc3-be4d0c8ec3e4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:51:58.177106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2281b429-13c4-4962-9dc3-be4d0c8ec3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:51:58.207169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:58.243660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 644/1294] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:51:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:51:58.525135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb142bd1-3aa6-426a-985d-2d608f14e3ca None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:51:58.556652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:51:58.626881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb142bd1-3aa6-426a-985d-2d608f14e3ca None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:51:58.661080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2857-2c8d-44c2-b2c6-67e189245b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:51:58.661686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2857-2c8d-44c2-b2c6-67e189245b7a None admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:51:58.661969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2857-2c8d-44c2-b2c6-67e189245b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:51:58.662266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2857-2c8d-44c2-b2c6-67e189245b7a None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:51:58.662936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa2857-2c8d-44c2-b2c6-67e189245b7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:51:58.664283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa2857-2c8d-44c2-b2c6-67e189245b7a None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:51:58.767908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 651/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Sep 14 11:51:58 2022] POST /identity/v3/services => generated 246 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:52:00.914951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f98ac9-adb7-49c4-8dbb-aaae510456bb None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:00.915462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f98ac9-adb7-49c4-8dbb-aaae510456bb None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:00.915555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f98ac9-adb7-49c4-8dbb-aaae510456bb None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:00.916827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 645/1296] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:52:00.922783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf93c5-005b-4196-92db-f60c466c11ed None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:00.923205 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf93c5-005b-4196-92db-f60c466c11ed None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:00.923306 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf93c5-005b-4196-92db-f60c466c11ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:00.941602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-81cf93c5-005b-4196-92db-f60c466c11ed None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:52:00.942883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-81cf93c5-005b-4196-92db-f60c466c11ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:52:01.019587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 652/1297] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:52:00 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 11:52:01.278399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f98ac9-adb7-49c4-8dbb-aaae510456bb None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:52:01.379464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f98ac9-adb7-49c4-8dbb-aaae510456bb None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:52:01.412718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccfc2f-528f-4397-9ca9-107b2a855399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:52:01.415752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccfc2f-528f-4397-9ca9-107b2a855399 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:01.415752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccfc2f-528f-4397-9ca9-107b2a855399 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:01.415752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccfc2f-528f-4397-9ca9-107b2a855399 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:01.415752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccfc2f-528f-4397-9ca9-107b2a855399 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:52:01.416110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccfc2f-528f-4397-9ca9-107b2a855399 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-deccfc2f-528f-4397-9ca9-107b2a855399 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:52:01.425066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:52:01.426092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:52:01.426962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 646/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Sep 14 11:52:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:52:01.432408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf93c5-005b-4196-92db-f60c466c11ed None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:52:01.450900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:52:01.527489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf93c5-005b-4196-92db-f60c466c11ed None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:52:01.560567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3fbe8-9680-4654-9221-70d0d4694b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:52:01.561184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3fbe8-9680-4654-9221-70d0d4694b2c None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:01.561523 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3fbe8-9680-4654-9221-70d0d4694b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:01.562049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3fbe8-9680-4654-9221-70d0d4694b2c None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:01.562700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3fbe8-9680-4654-9221-70d0d4694b2c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:52:01.562998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3fbe8-9680-4654-9221-70d0d4694b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:52:01.564338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3fbe8-9680-4654-9221-70d0d4694b2c None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:52:01.569187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 653/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Wed Sep 14 11:52:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:52:01.575178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccfc2f-528f-4397-9ca9-107b2a855399 None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:52:01.606368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:52:01.674538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccfc2f-528f-4397-9ca9-107b2a855399 None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:52:01.708101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4d864-a246-4c16-b37e-e7bd0c52b070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:52:01.708726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d864-a246-4c16-b37e-e7bd0c52b070 None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:01.708993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d864-a246-4c16-b37e-e7bd0c52b070 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:01.709266 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d864-a246-4c16-b37e-e7bd0c52b070 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:01.709965 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4d864-a246-4c16-b37e-e7bd0c52b070 None admin] RBAC: Adding query filter params (interface=public, service_id=02166c2155ad4abca5b1587f25e8ca3c, region_id=RegionOne) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:52:01.710302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4d864-a246-4c16-b37e-e7bd0c52b070 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:52:01.711666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4d864-a246-4c16-b37e-e7bd0c52b070 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:52:01.716588 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 647/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Sep 14 11:52:01 2022] GET /identity/v3/endpoints?service_id=02166c2155ad4abca5b1587f25e8ca3c&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:52:01.723252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3fbe8-9680-4654-9221-70d0d4694b2c None admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:52:01.805214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:52:01.822904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3fbe8-9680-4654-9221-70d0d4694b2c None admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:52:01.857447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a60ed9-01ad-4463-a62e-f7692af0bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:52:01.858063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60ed9-01ad-4463-a62e-f7692af0bf6f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:01.858371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60ed9-01ad-4463-a62e-f7692af0bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:01.858791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60ed9-01ad-4463-a62e-f7692af0bf6f None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:01.859395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a60ed9-01ad-4463-a62e-f7692af0bf6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:52:01.860751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a60ed9-01ad-4463-a62e-f7692af0bf6f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:52:01.867387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 654/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Sep 14 11:52:01 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 11:52:04.080471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd98dad-4536-4c1c-a1be-04104ac7784d None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:04.081009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd98dad-4536-4c1c-a1be-04104ac7784d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:04.081009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd98dad-4536-4c1c-a1be-04104ac7784d None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:04.082376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 648/1302] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:52:04.087802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747651c8-5d50-4009-a310-028f938dc6a4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:04.088372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747651c8-5d50-4009-a310-028f938dc6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:04.088372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747651c8-5d50-4009-a310-028f938dc6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:04.107126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-747651c8-5d50-4009-a310-028f938dc6a4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:52:04.108393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-747651c8-5d50-4009-a310-028f938dc6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:52:04.174914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 655/1303] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:52:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 11:52:04.441795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd98dad-4536-4c1c-a1be-04104ac7784d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:52:04.546346 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:52:04.553136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd98dad-4536-4c1c-a1be-04104ac7784d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:52:04.599686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664128d3-3ba4-4dfd-81cb-8d16c2319d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:52:04.600326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664128d3-3ba4-4dfd-81cb-8d16c2319d9f None admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:04.600601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664128d3-3ba4-4dfd-81cb-8d16c2319d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:04.600866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664128d3-3ba4-4dfd-81cb-8d16c2319d9f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:04.601451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664128d3-3ba4-4dfd-81cb-8d16c2319d9f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:52:04.602848 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664128d3-3ba4-4dfd-81cb-8d16c2319d9f None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application [None req-664128d3-3ba4-4dfd-81cb-8d16c2319d9f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 11:52:04.611802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 11:52:04.612979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application with Lock( Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self._enter() Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application return self.creator() Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application created_value = creator( Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: ERROR keystone.server.flask.application Sep 14 11:52:04.613885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 649/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Sep 14 11:52:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 11:52:04.620038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747651c8-5d50-4009-a310-028f938dc6a4 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:52:04.695036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:52:04.717419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747651c8-5d50-4009-a310-028f938dc6a4 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:52:04.750990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40caade-6b1a-4434-930a-4cfec74bd42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:52:04.751592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40caade-6b1a-4434-930a-4cfec74bd42f None admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:04.751869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40caade-6b1a-4434-930a-4cfec74bd42f None admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:04.752139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40caade-6b1a-4434-930a-4cfec74bd42f None admin] PATH_INFO: `/v3/services` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:04.752760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40caade-6b1a-4434-930a-4cfec74bd42f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 11:52:04.753058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40caade-6b1a-4434-930a-4cfec74bd42f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:52:04.754509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40caade-6b1a-4434-930a-4cfec74bd42f None admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:52:04.760021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 656/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Wed Sep 14 11:52:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 11:52:04.767015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664128d3-3ba4-4dfd-81cb-8d16c2319d9f None admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:52:04.867830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664128d3-3ba4-4dfd-81cb-8d16c2319d9f None admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:52:04.901451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043c558-2a6b-4019-9414-05065e2404c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:52:04.902093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043c558-2a6b-4019-9414-05065e2404c1 None admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:52:04.902406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043c558-2a6b-4019-9414-05065e2404c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:52:04.902676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043c558-2a6b-4019-9414-05065e2404c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:52:04.903340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043c558-2a6b-4019-9414-05065e2404c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:52:04.904709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043c558-2a6b-4019-9414-05065e2404c1 None admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:52:05.105899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 650/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 11:52:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 11:52:14.782516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=30 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:52:15.100888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:42.835220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077ad6-1986-42d4-915c-6b454fceb5f6 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:42.835691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077ad6-1986-42d4-915c-6b454fceb5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:42.835772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077ad6-1986-42d4-915c-6b454fceb5f6 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:42.842318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f59181-4488-465f-9fb0-5686863975c6 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:42.842717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f59181-4488-465f-9fb0-5686863975c6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:42.842865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f59181-4488-465f-9fb0-5686863975c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:42.845207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 657/1307] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:59:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:59:42.925707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-03f59181-4488-465f-9fb0-5686863975c6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:59:42.927001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-03f59181-4488-465f-9fb0-5686863975c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:43.050295 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 651/1308] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 11:59:43.337879 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133196f-515c-4b08-8d68-8dda37cfae4d None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:43.338271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133196f-515c-4b08-8d68-8dda37cfae4d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:43.338631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133196f-515c-4b08-8d68-8dda37cfae4d None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:43.340086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 658/1309] 10.222.0.77 () {54 vars in 965 bytes} [Wed Sep 14 11:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:59:43.347022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eaa5f-19dc-4769-914b-d37ee7796bb1 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:43.347382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eaa5f-19dc-4769-914b-d37ee7796bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:43.347728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3eaa5f-19dc-4769-914b-d37ee7796bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:43.430532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-bd3eaa5f-19dc-4769-914b-d37ee7796bb1 None None] MFA Rules not processed for user `67880641bc954088bef0b601a8410f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:59:43.431945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-bd3eaa5f-19dc-4769-914b-d37ee7796bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:43.457801 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:43.521541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 652/1310] 10.222.0.77 () {58 vars in 1062 bytes} [Wed Sep 14 11:59:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 11:59:43.531047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133196f-515c-4b08-8d68-8dda37cfae4d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:59:43.533360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8133196f-515c-4b08-8d68-8dda37cfae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:43.661706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133196f-515c-4b08-8d68-8dda37cfae4d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:59:43.744307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cb97d-14a2-4238-9ddb-9a816892cd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:59:43.744926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cb97d-14a2-4238-9ddb-9a816892cd58 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:43.745205 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cb97d-14a2-4238-9ddb-9a816892cd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:43.745476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cb97d-14a2-4238-9ddb-9a816892cd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:43.747181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-621cb97d-14a2-4238-9ddb-9a816892cd58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:43.821126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:43.888177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cb97d-14a2-4238-9ddb-9a816892cd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:59:43.890447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cb97d-14a2-4238-9ddb-9a816892cd58 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:59:43.913791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 659/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 11:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 11:59:46.426331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e6b1a-a6fb-4101-a8dd-b01da084d240 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:46.426821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e6b1a-a6fb-4101-a8dd-b01da084d240 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:46.427106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e6b1a-a6fb-4101-a8dd-b01da084d240 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:46.428480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 653/1312] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:59:46.433772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20f52e-d69a-4a88-831a-36bc8f614fb3 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:46.434302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20f52e-d69a-4a88-831a-36bc8f614fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:46.434412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20f52e-d69a-4a88-831a-36bc8f614fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:46.515791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-1b20f52e-d69a-4a88-831a-36bc8f614fb3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:59:46.517622 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1b20f52e-d69a-4a88-831a-36bc8f614fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:46.613142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 660/1313] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 11:59:46.902749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e6b1a-a6fb-4101-a8dd-b01da084d240 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:59:46.904270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6f4e6b1a-a6fb-4101-a8dd-b01da084d240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:47.005673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e6b1a-a6fb-4101-a8dd-b01da084d240 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:59:47.076171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:47.079041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1d74c-525d-42f9-b50b-3c3f18db7943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:59:47.079651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1d74c-525d-42f9-b50b-3c3f18db7943 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:47.079923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1d74c-525d-42f9-b50b-3c3f18db7943 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:47.080190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1d74c-525d-42f9-b50b-3c3f18db7943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:47.081751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9ef1d74c-525d-42f9-b50b-3c3f18db7943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:47.186786 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1d74c-525d-42f9-b50b-3c3f18db7943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:59:47.188897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1d74c-525d-42f9-b50b-3c3f18db7943 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:59:47.206874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 654/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 11:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 11:59:49.961670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68367eb-e743-435f-9a1d-6c6433407cc0 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:49.962201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68367eb-e743-435f-9a1d-6c6433407cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:49.962201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68367eb-e743-435f-9a1d-6c6433407cc0 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:49.963634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 661/1315] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:59:49.969749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb82ab3-9564-452f-be97-73573177a9fb None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:49.970182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb82ab3-9564-452f-be97-73573177a9fb None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:49.970467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb82ab3-9564-452f-be97-73573177a9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:50.035138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-8fb82ab3-9564-452f-be97-73573177a9fb None None] MFA Rules not processed for user `465764cb0a1f478290cb4e10c56c3094`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:59:50.036341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8fb82ab3-9564-452f-be97-73573177a9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:50.087862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:50.130953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 655/1316] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:59:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 11:59:50.418859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68367eb-e743-435f-9a1d-6c6433407cc0 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:59:50.420408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b68367eb-e743-435f-9a1d-6c6433407cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:50.430104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:50.522300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68367eb-e743-435f-9a1d-6c6433407cc0 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:59:50.594222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d6e19-e3c0-4816-8bea-037dc2c05555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:59:50.594855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d6e19-e3c0-4816-8bea-037dc2c05555 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:50.595136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d6e19-e3c0-4816-8bea-037dc2c05555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:50.595411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d6e19-e3c0-4816-8bea-037dc2c05555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:50.596997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-558d6e19-e3c0-4816-8bea-037dc2c05555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:50.660287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:50.707309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d6e19-e3c0-4816-8bea-037dc2c05555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:59:50.708737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d6e19-e3c0-4816-8bea-037dc2c05555 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:59:50.726697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 662/1317] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 11:59:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 11:59:53.860370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b851c-bcf6-4120-951e-82cdab50c3f8 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:53.860925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b851c-bcf6-4120-951e-82cdab50c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:53.860925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b851c-bcf6-4120-951e-82cdab50c3f8 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:53.862313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 656/1318] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:59:53.867670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c291-356f-432d-9741-6f4b1b7353d7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:53.868086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c291-356f-432d-9741-6f4b1b7353d7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:53.868178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c291-356f-432d-9741-6f4b1b7353d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:53.941761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-ac60c291-356f-432d-9741-6f4b1b7353d7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:59:53.943033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ac60c291-356f-432d-9741-6f4b1b7353d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:54.037854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 663/1319] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 11:59:54.334124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b851c-bcf6-4120-951e-82cdab50c3f8 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:59:54.335693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b09b851c-bcf6-4120-951e-82cdab50c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:54.443789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b851c-bcf6-4120-951e-82cdab50c3f8 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:59:54.528722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b772cf2-050f-4260-97af-ea5af260c48c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:59:54.529368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772cf2-050f-4260-97af-ea5af260c48c service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:54.529646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772cf2-050f-4260-97af-ea5af260c48c service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:54.529918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772cf2-050f-4260-97af-ea5af260c48c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:54.532055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9b772cf2-050f-4260-97af-ea5af260c48c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:54.539924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:54.643839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b772cf2-050f-4260-97af-ea5af260c48c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:59:54.645313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b772cf2-050f-4260-97af-ea5af260c48c service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:59:54.664160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 657/1320] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 11:59:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 11:59:57.895831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78e89b-3c03-42b1-bd52-b179b71d330c None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:57.896394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78e89b-3c03-42b1-bd52-b179b71d330c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:57.896394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78e89b-3c03-42b1-bd52-b179b71d330c None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:57.897643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 664/1321] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 11:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 11:59:57.903133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98086f65-bda9-435b-a721-4d13b662c782 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:57.903576 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98086f65-bda9-435b-a721-4d13b662c782 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:57.903677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98086f65-bda9-435b-a721-4d13b662c782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:57.973701 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-98086f65-bda9-435b-a721-4d13b662c782 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 11:59:57.974964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-98086f65-bda9-435b-a721-4d13b662c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:58.034667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:58.074153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 658/1322] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 11:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 11:59:58.360647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78e89b-3c03-42b1-bd52-b179b71d330c None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 11:59:58.362366 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ae78e89b-3c03-42b1-bd52-b179b71d330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:58.383514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:58.476721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78e89b-3c03-42b1-bd52-b179b71d330c None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 11:59:58.552025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb282d9-aa8a-4d77-9584-34abc2bf922a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 11:59:58.552633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb282d9-aa8a-4d77-9584-34abc2bf922a service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 11:59:58.552909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb282d9-aa8a-4d77-9584-34abc2bf922a service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 11:59:58.553177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb282d9-aa8a-4d77-9584-34abc2bf922a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 11:59:58.554796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-deb282d9-aa8a-4d77-9584-34abc2bf922a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 11:59:58.630890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:59:58.668988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb282d9-aa8a-4d77-9584-34abc2bf922a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 11:59:58.670499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb282d9-aa8a-4d77-9584-34abc2bf922a service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 11:59:58.689737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 665/1323] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 11:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:00.914575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988af10-9764-47d5-ae78-a0140e0498ee None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:00.915105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988af10-9764-47d5-ae78-a0140e0498ee None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:00.915105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988af10-9764-47d5-ae78-a0140e0498ee None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:00.916671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 659/1324] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:00.922635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cdc98-d061-48f3-9135-115712badd12 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:00.923072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cdc98-d061-48f3-9135-115712badd12 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:00.923176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cdc98-d061-48f3-9135-115712badd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:00.990339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-4b4cdc98-d061-48f3-9135-115712badd12 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:00.991587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4b4cdc98-d061-48f3-9135-115712badd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:01.089661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 666/1325] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:01.375770 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988af10-9764-47d5-ae78-a0140e0498ee None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:01.377396 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-3988af10-9764-47d5-ae78-a0140e0498ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:01.490438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988af10-9764-47d5-ae78-a0140e0498ee None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:01.563268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98057399-8618-4fbf-8e05-492416d6b4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:01.563878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98057399-8618-4fbf-8e05-492416d6b4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:01.564161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98057399-8618-4fbf-8e05-492416d6b4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:01.564436 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98057399-8618-4fbf-8e05-492416d6b4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:01.566372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-98057399-8618-4fbf-8e05-492416d6b4a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:01.584114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:01.678730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98057399-8618-4fbf-8e05-492416d6b4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:01.680156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98057399-8618-4fbf-8e05-492416d6b4a8 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:01.699248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 660/1326] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:00:03.930551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43869-bed2-4e96-ad65-dfd10eac0ad4 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:03.931047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43869-bed2-4e96-ad65-dfd10eac0ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:03.931138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43869-bed2-4e96-ad65-dfd10eac0ad4 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:03.932442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 667/1327] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:03.938694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584deab-cfba-4734-a1c9-5abb862f9b10 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:03.939147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584deab-cfba-4734-a1c9-5abb862f9b10 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:03.939334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584deab-cfba-4734-a1c9-5abb862f9b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:04.006658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-9584deab-cfba-4734-a1c9-5abb862f9b10 None None] MFA Rules not processed for user `465764cb0a1f478290cb4e10c56c3094`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:04.007860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9584deab-cfba-4734-a1c9-5abb862f9b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:04.085344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:04.124907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 661/1328] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:04.414549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43869-bed2-4e96-ad65-dfd10eac0ad4 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:04.416073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-87e43869-bed2-4e96-ad65-dfd10eac0ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:04.450496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:04.535040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43869-bed2-4e96-ad65-dfd10eac0ad4 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:04.616754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e47aed-a855-4f01-8017-772e8668ffc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:04.617505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e47aed-a855-4f01-8017-772e8668ffc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:04.617652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e47aed-a855-4f01-8017-772e8668ffc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:04.617924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e47aed-a855-4f01-8017-772e8668ffc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:04.619610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e9e47aed-a855-4f01-8017-772e8668ffc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:04.706087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:04.739585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e47aed-a855-4f01-8017-772e8668ffc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:04.741043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e47aed-a855-4f01-8017-772e8668ffc7 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:04.761051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 668/1329] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:07.523705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7d401-8077-4676-9cfb-2b3bd4767f39 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:07.524284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7d401-8077-4676-9cfb-2b3bd4767f39 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:07.524284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7d401-8077-4676-9cfb-2b3bd4767f39 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:07.525580 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 662/1330] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:07.531741 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee02b1-503e-425c-9da3-26c42f66d2bd None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:07.532173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee02b1-503e-425c-9da3-26c42f66d2bd None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:07.532284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee02b1-503e-425c-9da3-26c42f66d2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:07.597899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e1ee02b1-503e-425c-9da3-26c42f66d2bd None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:07.599160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e1ee02b1-503e-425c-9da3-26c42f66d2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:07.696094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 669/1331] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:07.980040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7d401-8077-4676-9cfb-2b3bd4767f39 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:07.981560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-84a7d401-8077-4676-9cfb-2b3bd4767f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:08.084142 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7d401-8077-4676-9cfb-2b3bd4767f39 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:08.156447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2975d1-90b1-48e2-9e50-84ce14187c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:08.157041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2975d1-90b1-48e2-9e50-84ce14187c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:08.157319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2975d1-90b1-48e2-9e50-84ce14187c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:08.157589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2975d1-90b1-48e2-9e50-84ce14187c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:08.159190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2f2975d1-90b1-48e2-9e50-84ce14187c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:08.190985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:08.272143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2975d1-90b1-48e2-9e50-84ce14187c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:08.273497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2975d1-90b1-48e2-9e50-84ce14187c42 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:08.291451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 663/1332] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:10.488227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59a5d7-6ba5-4d93-a9b1-440206cfc31d None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:10.488780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59a5d7-6ba5-4d93-a9b1-440206cfc31d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:10.488780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59a5d7-6ba5-4d93-a9b1-440206cfc31d None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:10.490145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 670/1333] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:10.495368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470ff1-fa03-46e3-a7e2-00fdfb84ed01 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:10.495773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470ff1-fa03-46e3-a7e2-00fdfb84ed01 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:10.495919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470ff1-fa03-46e3-a7e2-00fdfb84ed01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:10.560614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-15470ff1-fa03-46e3-a7e2-00fdfb84ed01 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:10.561853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-15470ff1-fa03-46e3-a7e2-00fdfb84ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:10.641393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:10.663985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 664/1334] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:10.954782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59a5d7-6ba5-4d93-a9b1-440206cfc31d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:10.961514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-cd59a5d7-6ba5-4d93-a9b1-440206cfc31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:10.998228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:11.060827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59a5d7-6ba5-4d93-a9b1-440206cfc31d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:11.133338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d5cea-182c-49d0-8f63-37e1fa785643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:11.133940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5cea-182c-49d0-8f63-37e1fa785643 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:11.134239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5cea-182c-49d0-8f63-37e1fa785643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:11.134513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5cea-182c-49d0-8f63-37e1fa785643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:11.136187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c95d5cea-182c-49d0-8f63-37e1fa785643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:11.220659 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:11.245416 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d5cea-182c-49d0-8f63-37e1fa785643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:11.246885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d5cea-182c-49d0-8f63-37e1fa785643 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:11.265699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 671/1335] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:13.987620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dbd6-006d-405b-b162-f7358209f6f3 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:13.988186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dbd6-006d-405b-b162-f7358209f6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:13.988186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dbd6-006d-405b-b162-f7358209f6f3 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:13.989516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 665/1336] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:13.995043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06225649-10be-49fb-af89-d002dd89034f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:13.995473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06225649-10be-49fb-af89-d002dd89034f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:13.995593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06225649-10be-49fb-af89-d002dd89034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:14.063341 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-06225649-10be-49fb-af89-d002dd89034f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:14.064571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-06225649-10be-49fb-af89-d002dd89034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:14.161332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 672/1337] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:14.479287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482154f-0ac7-4719-aed0-681f83097761 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:14.479567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482154f-0ac7-4719-aed0-681f83097761 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:14.479836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482154f-0ac7-4719-aed0-681f83097761 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:14.482018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 666/1338] 10.222.0.77 () {54 vars in 965 bytes} [Wed Sep 14 12:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:14.489196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538e190-712c-4c91-9f47-2470fce9af7f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:14.489477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538e190-712c-4c91-9f47-2470fce9af7f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:14.495335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538e190-712c-4c91-9f47-2470fce9af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:14.551478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:14.576418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-0538e190-712c-4c91-9f47-2470fce9af7f None None] MFA Rules not processed for user `67880641bc954088bef0b601a8410f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:14.578118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0538e190-712c-4c91-9f47-2470fce9af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:14.662559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 673/1339] 10.222.0.77 () {58 vars in 1062 bytes} [Wed Sep 14 12:00:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:14.673731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482154f-0ac7-4719-aed0-681f83097761 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:14.675340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2482154f-0ac7-4719-aed0-681f83097761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:14.798687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482154f-0ac7-4719-aed0-681f83097761 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:14.891959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98c7bc-0ffd-4fa1-98fe-2cbb630fffa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:14.892741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c7bc-0ffd-4fa1-98fe-2cbb630fffa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:14.893024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c7bc-0ffd-4fa1-98fe-2cbb630fffa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:14.893298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c7bc-0ffd-4fa1-98fe-2cbb630fffa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:14.894951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0c98c7bc-0ffd-4fa1-98fe-2cbb630fffa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:14.940973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:15.027272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98c7bc-0ffd-4fa1-98fe-2cbb630fffa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:15.028717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98c7bc-0ffd-4fa1-98fe-2cbb630fffa6 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:15.051526 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 667/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:20.274890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18713d79-0f32-4f16-b402-46fab796c591 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:20.275414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18713d79-0f32-4f16-b402-46fab796c591 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:20.275526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18713d79-0f32-4f16-b402-46fab796c591 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:20.276959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 674/1341] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:20.282541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ca20-4294-4274-9d81-ca496170902d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:20.282974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ca20-4294-4274-9d81-ca496170902d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:20.283159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151ca20-4294-4274-9d81-ca496170902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:20.353295 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2151ca20-4294-4274-9d81-ca496170902d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:20.356776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2151ca20-4294-4274-9d81-ca496170902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:20.444461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:20.458253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 668/1342] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:20.751710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18713d79-0f32-4f16-b402-46fab796c591 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:20.753313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-18713d79-0f32-4f16-b402-46fab796c591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:20.863252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18713d79-0f32-4f16-b402-46fab796c591 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:20.901593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:20.938469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc6583-77bf-4c33-be9b-cad5ab7b1dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:20.939092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6583-77bf-4c33-be9b-cad5ab7b1dfe service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:20.939390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6583-77bf-4c33-be9b-cad5ab7b1dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:20.939684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6583-77bf-4c33-be9b-cad5ab7b1dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:20.941592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-53fc6583-77bf-4c33-be9b-cad5ab7b1dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:21.050820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc6583-77bf-4c33-be9b-cad5ab7b1dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:21.052158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc6583-77bf-4c33-be9b-cad5ab7b1dfe service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:21.070353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 675/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:24.320815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed54116-b295-4f90-a307-ad7fc5b5f120 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:24.321342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed54116-b295-4f90-a307-ad7fc5b5f120 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:24.321342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed54116-b295-4f90-a307-ad7fc5b5f120 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:24.322755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 669/1344] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:24.328063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42a90-254f-491d-88c1-e32b799cc90b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:24.328512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42a90-254f-491d-88c1-e32b799cc90b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:24.328709 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd42a90-254f-491d-88c1-e32b799cc90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:24.395366 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-dfd42a90-254f-491d-88c1-e32b799cc90b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:24.396583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-dfd42a90-254f-491d-88c1-e32b799cc90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:24.416575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:24.498942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 676/1345] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:24.782387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed54116-b295-4f90-a307-ad7fc5b5f120 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:24.783970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4ed54116-b295-4f90-a307-ad7fc5b5f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:24.891369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed54116-b295-4f90-a307-ad7fc5b5f120 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:24.988106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c26f79-a4e0-4a1b-b722-489b8a75242f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:24.988719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26f79-a4e0-4a1b-b722-489b8a75242f service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:24.988997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26f79-a4e0-4a1b-b722-489b8a75242f service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:24.989268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26f79-a4e0-4a1b-b722-489b8a75242f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:24.990879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d7c26f79-a4e0-4a1b-b722-489b8a75242f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:25.041383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:25.112190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c26f79-a4e0-4a1b-b722-489b8a75242f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:25.113783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c26f79-a4e0-4a1b-b722-489b8a75242f service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:25.133945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 670/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:29.638969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b882d-e55c-40d9-8a1d-d706506d8c1a None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:29.639531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b882d-e55c-40d9-8a1d-d706506d8c1a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:29.639621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b882d-e55c-40d9-8a1d-d706506d8c1a None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:29.643363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 677/1347] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:29.646598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac643-c93d-4b5d-8ce8-65a0b86d3f2c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:29.647072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac643-c93d-4b5d-8ce8-65a0b86d3f2c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:29.647173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdac643-c93d-4b5d-8ce8-65a0b86d3f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:29.715010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-1fdac643-c93d-4b5d-8ce8-65a0b86d3f2c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:29.716249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1fdac643-c93d-4b5d-8ce8-65a0b86d3f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:29.817441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:29.825552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 671/1348] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:30.110058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b882d-e55c-40d9-8a1d-d706506d8c1a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:30.111647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fd1b882d-e55c-40d9-8a1d-d706506d8c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:30.214453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b882d-e55c-40d9-8a1d-d706506d8c1a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:30.263541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:30.288750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480f832-b824-478f-b9b0-b512dd8b5f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:30.289371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480f832-b824-478f-b9b0-b512dd8b5f55 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:30.289682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480f832-b824-478f-b9b0-b512dd8b5f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:30.290017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480f832-b824-478f-b9b0-b512dd8b5f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:30.291662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b480f832-b824-478f-b9b0-b512dd8b5f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:30.410897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480f832-b824-478f-b9b0-b512dd8b5f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:30.412325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480f832-b824-478f-b9b0-b512dd8b5f55 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:30.431577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 678/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:35.371475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda88bfd-905a-43dd-8f68-278777736ed4 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:35.371932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda88bfd-905a-43dd-8f68-278777736ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:35.372228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda88bfd-905a-43dd-8f68-278777736ed4 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:35.374006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 672/1350] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:35.379686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a043-cefe-4acb-abc1-55fa44ee0758 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:35.380481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a043-cefe-4acb-abc1-55fa44ee0758 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:35.380905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a043-cefe-4acb-abc1-55fa44ee0758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:35.482520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6566a043-cefe-4acb-abc1-55fa44ee0758 None None] MFA Rules not processed for user `877b59ec265f42e4bf8edbd9767e3319`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:35.490008 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6566a043-cefe-4acb-abc1-55fa44ee0758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:35.509491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:35.667681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 679/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:00:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:39.948019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578919c-68cc-4b97-bcc3-693e0ca307b4 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:39.948553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578919c-68cc-4b97-bcc3-693e0ca307b4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:39.948954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578919c-68cc-4b97-bcc3-693e0ca307b4 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:39.950657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 673/1352] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:00:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:39.956119 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad88ef7-ab2a-469f-a24a-ec4c12cfb7c4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:39.956562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad88ef7-ab2a-469f-a24a-ec4c12cfb7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:39.956668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad88ef7-ab2a-469f-a24a-ec4c12cfb7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:40.038998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9ad88ef7-ab2a-469f-a24a-ec4c12cfb7c4 None None] MFA Rules not processed for user `877b59ec265f42e4bf8edbd9767e3319`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:40.040220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9ad88ef7-ab2a-469f-a24a-ec4c12cfb7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:40.115310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:40.150891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 680/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:41.599388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5dd6-0e00-4fe0-8019-ade2cd59be9e None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:41.600000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5dd6-0e00-4fe0-8019-ade2cd59be9e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:41.600000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5dd6-0e00-4fe0-8019-ade2cd59be9e None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:41.601285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 674/1354] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:41.606365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54784b-84fd-4077-a465-1a2516344da5 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:41.606786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54784b-84fd-4077-a465-1a2516344da5 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:41.606943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54784b-84fd-4077-a465-1a2516344da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:41.697320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6d54784b-84fd-4077-a465-1a2516344da5 None None] MFA Rules not processed for user `877b59ec265f42e4bf8edbd9767e3319`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:41.698564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6d54784b-84fd-4077-a465-1a2516344da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:41.813377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 681/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:00:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:45.349463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1de4-e25c-478d-b734-66614ac24fab None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:45.350341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1de4-e25c-478d-b734-66614ac24fab None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:45.350818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1de4-e25c-478d-b734-66614ac24fab None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:45.352800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 675/1356] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:45.358719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d746cd-f34c-4d83-90bb-ced6e9bec349 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:45.359185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d746cd-f34c-4d83-90bb-ced6e9bec349 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:45.359302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d746cd-f34c-4d83-90bb-ced6e9bec349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:45.400327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:45.432811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-95d746cd-f34c-4d83-90bb-ced6e9bec349 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:45.434448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-95d746cd-f34c-4d83-90bb-ced6e9bec349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:45.539287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 682/1357] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:45.844761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686a855-8b10-471f-855e-f375889693a0 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:45.845047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686a855-8b10-471f-855e-f375889693a0 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:45.845643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686a855-8b10-471f-855e-f375889693a0 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:45.847008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 676/1358] 10.222.0.77 () {54 vars in 962 bytes} [Wed Sep 14 12:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:00:45.861992 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f8a1-f628-4c54-a8ac-0b28c4f36e57 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:45.862372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f8a1-f628-4c54-a8ac-0b28c4f36e57 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:45.862630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f8a1-f628-4c54-a8ac-0b28c4f36e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:45.945955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-1362f8a1-f628-4c54-a8ac-0b28c4f36e57 None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:45.947220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1362f8a1-f628-4c54-a8ac-0b28c4f36e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:46.003925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:46.076362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 683/1359] 10.222.0.77 () {58 vars in 1059 bytes} [Wed Sep 14 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:46.083992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686a855-8b10-471f-855e-f375889693a0 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:46.085738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6686a855-8b10-471f-855e-f375889693a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:46.242702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686a855-8b10-471f-855e-f375889693a0 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:46.319928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:46.362186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b865f79-b7f6-4e9e-a8df-8aa73ff995d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:46.362863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b865f79-b7f6-4e9e-a8df-8aa73ff995d3 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:46.363088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b865f79-b7f6-4e9e-a8df-8aa73ff995d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:46.363256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b865f79-b7f6-4e9e-a8df-8aa73ff995d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:46.364846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7b865f79-b7f6-4e9e-a8df-8aa73ff995d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:46.460440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b865f79-b7f6-4e9e-a8df-8aa73ff995d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:46.462401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b865f79-b7f6-4e9e-a8df-8aa73ff995d3 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:46.485864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 677/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:48.863458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231995-45b1-4c42-aaeb-5bb414ea40bc None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:48.864022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231995-45b1-4c42-aaeb-5bb414ea40bc None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:48.864022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231995-45b1-4c42-aaeb-5bb414ea40bc None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:48.865339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 684/1361] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:48.870985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82721e-7ef8-437f-9627-7b0aaabb9ee0 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:48.871391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82721e-7ef8-437f-9627-7b0aaabb9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:48.871506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82721e-7ef8-437f-9627-7b0aaabb9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:48.946726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2b82721e-7ef8-437f-9627-7b0aaabb9ee0 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:48.948226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2b82721e-7ef8-437f-9627-7b0aaabb9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:48.989346 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:49.054085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 678/1362] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:49.343761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7231995-45b1-4c42-aaeb-5bb414ea40bc None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:49.345285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f7231995-45b1-4c42-aaeb-5bb414ea40bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:49.519548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7231995-45b1-4c42-aaeb-5bb414ea40bc None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:49.529934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:49.668033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14745f8e-13d6-4f26-9118-d794729bf153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:49.668675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14745f8e-13d6-4f26-9118-d794729bf153 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:49.668957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14745f8e-13d6-4f26-9118-d794729bf153 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:49.669238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14745f8e-13d6-4f26-9118-d794729bf153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:49.671489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-14745f8e-13d6-4f26-9118-d794729bf153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:49.771072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14745f8e-13d6-4f26-9118-d794729bf153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:49.772676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14745f8e-13d6-4f26-9118-d794729bf153 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:49.792194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 685/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:52.455755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52776a7-e293-41e5-8566-c0766351f62a None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:52.456262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52776a7-e293-41e5-8566-c0766351f62a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:52.456344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52776a7-e293-41e5-8566-c0766351f62a None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:52.457659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 679/1364] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:52.463626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0054d-0afe-41e3-bbc3-48c2945d028d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:52.464436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0054d-0afe-41e3-bbc3-48c2945d028d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:52.464924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0054d-0afe-41e3-bbc3-48c2945d028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:52.482922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:52.539343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-8ea0054d-0afe-41e3-bbc3-48c2945d028d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:52.541123 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8ea0054d-0afe-41e3-bbc3-48c2945d028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:52.648168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 686/1365] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:52.948376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77ad1b-d003-4ca9-a3e7-20dc3ee597b4 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:52.948882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77ad1b-d003-4ca9-a3e7-20dc3ee597b4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:52.949325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77ad1b-d003-4ca9-a3e7-20dc3ee597b4 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:52.952246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 680/1366] 10.222.0.77 () {54 vars in 962 bytes} [Wed Sep 14 12:00:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:52.957404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112c0f-635b-4169-8eb0-78f39b0fa24e None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:52.957759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112c0f-635b-4169-8eb0-78f39b0fa24e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:52.958102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112c0f-635b-4169-8eb0-78f39b0fa24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:53.036715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-cc112c0f-635b-4169-8eb0-78f39b0fa24e None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:53.037921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-cc112c0f-635b-4169-8eb0-78f39b0fa24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:53.075461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:53.159421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 687/1367] 10.222.0.77 () {58 vars in 1059 bytes} [Wed Sep 14 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:53.168138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77ad1b-d003-4ca9-a3e7-20dc3ee597b4 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:53.170448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-db77ad1b-d003-4ca9-a3e7-20dc3ee597b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:53.328595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77ad1b-d003-4ca9-a3e7-20dc3ee597b4 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:53.351963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:53.453823 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa99beb-8a70-4292-8b26-4a0eabe355b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:53.454467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa99beb-8a70-4292-8b26-4a0eabe355b1 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:53.454742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa99beb-8a70-4292-8b26-4a0eabe355b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:53.455015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa99beb-8a70-4292-8b26-4a0eabe355b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:53.456591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-efa99beb-8a70-4292-8b26-4a0eabe355b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:53.557175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa99beb-8a70-4292-8b26-4a0eabe355b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:53.558911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa99beb-8a70-4292-8b26-4a0eabe355b1 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:53.581411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 681/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:53.659188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4c687-5521-4a17-87b3-708cb917876d None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:53.659734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4c687-5521-4a17-87b3-708cb917876d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:53.659734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4c687-5521-4a17-87b3-708cb917876d None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:53.661098 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 688/1369] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:53.667453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce23e8-ce47-4273-adfe-7662e2c11c06 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:53.667764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce23e8-ce47-4273-adfe-7662e2c11c06 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:53.668040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce23e8-ce47-4273-adfe-7662e2c11c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:53.712599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:53.758950 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-76ce23e8-ce47-4273-adfe-7662e2c11c06 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:53.760506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-76ce23e8-ce47-4273-adfe-7662e2c11c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:53.873346 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 682/1370] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:54.208678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b5f5-6d78-4a66-acdd-ef46df3e1b7e None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:54.208967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b5f5-6d78-4a66-acdd-ef46df3e1b7e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:54.209247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b5f5-6d78-4a66-acdd-ef46df3e1b7e None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:54.210814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 689/1371] 10.222.0.77 () {54 vars in 964 bytes} [Wed Sep 14 12:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:54.215595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693f1c-d8bb-4124-820f-8535f42a706e None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:54.215945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693f1c-d8bb-4124-820f-8535f42a706e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:54.216850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693f1c-d8bb-4124-820f-8535f42a706e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:54.301727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-7c693f1c-d8bb-4124-820f-8535f42a706e None None] MFA Rules not processed for user `c610ab76127b40429d8e9259446df49a`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:54.303091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7c693f1c-d8bb-4124-820f-8535f42a706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:54.488850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:54.522130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 683/1372] 10.222.0.77 () {58 vars in 1061 bytes} [Wed Sep 14 12:00:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:54.530362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b5f5-6d78-4a66-acdd-ef46df3e1b7e None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:54.532101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8f92b5f5-6d78-4a66-acdd-ef46df3e1b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:54.646421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b5f5-6d78-4a66-acdd-ef46df3e1b7e None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:54.696167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:54.735996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fd0c9-06bb-4f84-a9c6-8a602c7afbfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:54.736668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fd0c9-06bb-4f84-a9c6-8a602c7afbfd service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:54.736905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fd0c9-06bb-4f84-a9c6-8a602c7afbfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:54.737181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fd0c9-06bb-4f84-a9c6-8a602c7afbfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:54.739149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b36fd0c9-06bb-4f84-a9c6-8a602c7afbfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:54.871988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fd0c9-06bb-4f84-a9c6-8a602c7afbfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:54.874103 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fd0c9-06bb-4f84-a9c6-8a602c7afbfd service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:54.895428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 690/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:56.021710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb7b84-992d-430a-b594-5f25d871331f None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:56.022288 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb7b84-992d-430a-b594-5f25d871331f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:56.022420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb7b84-992d-430a-b594-5f25d871331f None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:56.023940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 684/1374] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:56.029807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ddfed-4ae9-439d-bb24-1386d15a4cb4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:56.030259 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ddfed-4ae9-439d-bb24-1386d15a4cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:56.030402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ddfed-4ae9-439d-bb24-1386d15a4cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:56.098579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-7e8ddfed-4ae9-439d-bb24-1386d15a4cb4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:56.099804 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7e8ddfed-4ae9-439d-bb24-1386d15a4cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:56.120290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:56.197956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 691/1375] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:56.491569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb7b84-992d-430a-b594-5f25d871331f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:56.493057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ccdb7b84-992d-430a-b594-5f25d871331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:56.655561 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb7b84-992d-430a-b594-5f25d871331f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:56.712422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:56.776196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87612d87-ec5f-4a5e-bb95-888906fae6b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:00:56.776935 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612d87-ec5f-4a5e-bb95-888906fae6b0 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:56.777210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612d87-ec5f-4a5e-bb95-888906fae6b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:56.777476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87612d87-ec5f-4a5e-bb95-888906fae6b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:56.779651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-87612d87-ec5f-4a5e-bb95-888906fae6b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:56.881489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87612d87-ec5f-4a5e-bb95-888906fae6b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:00:56.883055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87612d87-ec5f-4a5e-bb95-888906fae6b0 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:00:56.901669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 685/1376] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:00:59.294583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53dbb-2477-4c46-a698-eb2b944b4b3f None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:59.295174 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53dbb-2477-4c46-a698-eb2b944b4b3f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:59.295266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53dbb-2477-4c46-a698-eb2b944b4b3f None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:59.296864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 692/1377] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:00:59.302028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa3ad3-1575-478a-ba37-0c5866344285 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:00:59.302504 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa3ad3-1575-478a-ba37-0c5866344285 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:00:59.302683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa3ad3-1575-478a-ba37-0c5866344285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:00:59.375283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-d8aa3ad3-1575-478a-ba37-0c5866344285 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:00:59.377047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d8aa3ad3-1575-478a-ba37-0c5866344285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:59.386573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:00:59.505843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 686/1378] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:00:59.793207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec53dbb-2477-4c46-a698-eb2b944b4b3f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:00:59.795486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9ec53dbb-2477-4c46-a698-eb2b944b4b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:00:59.961756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec53dbb-2477-4c46-a698-eb2b944b4b3f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:00:59.966791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:00.087389 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bf678-f413-4835-a92b-8e7c97726806 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:00.088199 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bf678-f413-4835-a92b-8e7c97726806 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:00.088591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bf678-f413-4835-a92b-8e7c97726806 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:00.088963 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bf678-f413-4835-a92b-8e7c97726806 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:00.091509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-850bf678-f413-4835-a92b-8e7c97726806 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:00.195617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bf678-f413-4835-a92b-8e7c97726806 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:00.197506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bf678-f413-4835-a92b-8e7c97726806 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:00.218748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 693/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:02.598673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d125-cbde-4ff2-bac2-b5052dffab41 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:02.599145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d125-cbde-4ff2-bac2-b5052dffab41 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:02.599318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d125-cbde-4ff2-bac2-b5052dffab41 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:02.604341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 687/1380] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:02.606107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b40c-f18b-4460-b494-7fe06641a983 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:02.606779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b40c-f18b-4460-b494-7fe06641a983 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:02.607161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b40c-f18b-4460-b494-7fe06641a983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:02.623617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:02.707666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-7381b40c-f18b-4460-b494-7fe06641a983 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:02.708856 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7381b40c-f18b-4460-b494-7fe06641a983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:02.819245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 694/1381] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:03.165008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d125-cbde-4ff2-bac2-b5052dffab41 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:03.166623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6873d125-cbde-4ff2-bac2-b5052dffab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:03.304368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:03.315774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d125-cbde-4ff2-bac2-b5052dffab41 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:03.436163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab6628-64b7-49e0-af85-623134292ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:03.436163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab6628-64b7-49e0-af85-623134292ac9 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:03.436163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab6628-64b7-49e0-af85-623134292ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:03.436163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab6628-64b7-49e0-af85-623134292ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:03.436645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-fcab6628-64b7-49e0-af85-623134292ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:03.533998 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab6628-64b7-49e0-af85-623134292ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:03.535579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab6628-64b7-49e0-af85-623134292ac9 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:03.545910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:03.554561 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 688/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:06.625146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974133-041f-4fcb-a6fb-6349596cc58b None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:06.625591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974133-041f-4fcb-a6fb-6349596cc58b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:06.625872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974133-041f-4fcb-a6fb-6349596cc58b None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:06.627760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 695/1383] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:06.634115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bed26-6f42-4bdc-a143-a31084bb78ab None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:06.634593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bed26-6f42-4bdc-a143-a31084bb78ab None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:06.634748 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bed26-6f42-4bdc-a143-a31084bb78ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:06.710460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-880bed26-6f42-4bdc-a143-a31084bb78ab None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:06.712243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-880bed26-6f42-4bdc-a143-a31084bb78ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:06.831539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 689/1384] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:07.198231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1974133-041f-4fcb-a6fb-6349596cc58b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:07.199760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c1974133-041f-4fcb-a6fb-6349596cc58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:07.287988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:07.352775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1974133-041f-4fcb-a6fb-6349596cc58b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:07.471764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea4238-d36f-4cff-8877-4ad379eed0b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:07.472356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea4238-d36f-4cff-8877-4ad379eed0b1 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:07.473098 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea4238-d36f-4cff-8877-4ad379eed0b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:07.473593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea4238-d36f-4cff-8877-4ad379eed0b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:07.476346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6eea4238-d36f-4cff-8877-4ad379eed0b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:07.529678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:07.570002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea4238-d36f-4cff-8877-4ad379eed0b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:07.571636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea4238-d36f-4cff-8877-4ad379eed0b1 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:07.591883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 696/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:09.816055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62239ba-934c-4d73-94de-95c2ce6c763d None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:09.816616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62239ba-934c-4d73-94de-95c2ce6c763d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:09.816616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62239ba-934c-4d73-94de-95c2ce6c763d None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:09.817952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 690/1386] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:09.823394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b3dc4-6151-4e0b-8367-0dd5dc3de71f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:09.823789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b3dc4-6151-4e0b-8367-0dd5dc3de71f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:09.823893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b3dc4-6151-4e0b-8367-0dd5dc3de71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:09.889489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d35b3dc4-6151-4e0b-8367-0dd5dc3de71f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:09.890744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d35b3dc4-6151-4e0b-8367-0dd5dc3de71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:10.001419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 697/1387] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:10.292474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62239ba-934c-4d73-94de-95c2ce6c763d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:10.294749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e62239ba-934c-4d73-94de-95c2ce6c763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:10.372530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:10.443279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62239ba-934c-4d73-94de-95c2ce6c763d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:10.566646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2a14f-173f-4048-a120-3f05e2087923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:10.567151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2a14f-173f-4048-a120-3f05e2087923 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:10.567448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2a14f-173f-4048-a120-3f05e2087923 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:10.567679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2a14f-173f-4048-a120-3f05e2087923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:10.569268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-21d2a14f-173f-4048-a120-3f05e2087923 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:10.584255 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e11edc-0ca9-471e-b802-439a6491ed83 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:10.584536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e11edc-0ca9-471e-b802-439a6491ed83 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:10.584807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e11edc-0ca9-471e-b802-439a6491ed83 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:10.586151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 698/1388] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:01:10.591398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d488d8-2fb2-42ef-a719-1c20d8601f53 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:10.593067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d488d8-2fb2-42ef-a719-1c20d8601f53 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:10.593067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d488d8-2fb2-42ef-a719-1c20d8601f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:10.615212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:10.631318 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:10.662428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-41d488d8-2fb2-42ef-a719-1c20d8601f53 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:10.663645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-41d488d8-2fb2-42ef-a719-1c20d8601f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:10.670461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2a14f-173f-4048-a120-3f05e2087923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:10.672072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2a14f-173f-4048-a120-3f05e2087923 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:10.691563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 691/1389] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:10.762742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 699/1390] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:11.066536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190a6e6-1203-49b3-ab6f-94bd2dabb1c4 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:11.067088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190a6e6-1203-49b3-ab6f-94bd2dabb1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:11.067206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190a6e6-1203-49b3-ab6f-94bd2dabb1c4 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:11.068769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 692/1391] 10.222.0.77 () {54 vars in 966 bytes} [Wed Sep 14 12:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:11.076283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e626d1-8616-4ba2-9294-5b7a98093b89 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:11.077060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e626d1-8616-4ba2-9294-5b7a98093b89 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:11.077060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e626d1-8616-4ba2-9294-5b7a98093b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:11.156062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e9e626d1-8616-4ba2-9294-5b7a98093b89 None None] MFA Rules not processed for user `47bdd5f0b3bc4c099c0d34b3b7c3f3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:11.157280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e9e626d1-8616-4ba2-9294-5b7a98093b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:11.206372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:11.234849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 700/1392] 10.222.0.77 () {58 vars in 1063 bytes} [Wed Sep 14 12:01:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:11.244009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190a6e6-1203-49b3-ab6f-94bd2dabb1c4 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:11.245504 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2190a6e6-1203-49b3-ab6f-94bd2dabb1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:11.354351 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190a6e6-1203-49b3-ab6f-94bd2dabb1c4 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:11.417605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:11.434952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1965938-49fb-4935-b0c1-2cdb6158117b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bdd5f0b3bc4c099c0d34b3b7c3f3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:11.435858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965938-49fb-4935-b0c1-2cdb6158117b service glance] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:11.435858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965938-49fb-4935-b0c1-2cdb6158117b service glance] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:11.436158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965938-49fb-4935-b0c1-2cdb6158117b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:11.437748 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a1965938-49fb-4935-b0c1-2cdb6158117b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:11.554431 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1965938-49fb-4935-b0c1-2cdb6158117b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:11.555868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1965938-49fb-4935-b0c1-2cdb6158117b service glance] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:11.576113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 693/1393] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:12.448924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ada11-ee01-4f24-9ff6-cb9712fb8d7d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:12.448924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ada11-ee01-4f24-9ff6-cb9712fb8d7d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:12.449431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ada11-ee01-4f24-9ff6-cb9712fb8d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:12.518324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2d9ada11-ee01-4f24-9ff6-cb9712fb8d7d None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:12.519535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2d9ada11-ee01-4f24-9ff6-cb9712fb8d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:12.606949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 701/1394] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:01:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:01:12.650596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166e4ae-48b7-48d9-9c47-f039c6502570 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:12.651082 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166e4ae-48b7-48d9-9c47-f039c6502570 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:12.651194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166e4ae-48b7-48d9-9c47-f039c6502570 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:12.652468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 694/1395] 10.222.0.77 () {54 vars in 943 bytes} [Wed Sep 14 12:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:12.658819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d317cf-8c08-4c37-9a5a-bd777795e47e None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:12.659111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d317cf-8c08-4c37-9a5a-bd777795e47e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:12.659391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d317cf-8c08-4c37-9a5a-bd777795e47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:12.741451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-11d317cf-8c08-4c37-9a5a-bd777795e47e None None] MFA Rules not processed for user `39b77396e6ec432e80f4d06bc09a8605`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:12.742711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-11d317cf-8c08-4c37-9a5a-bd777795e47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:12.745673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:12.854629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 702/1396] 10.222.0.77 () {58 vars in 1040 bytes} [Wed Sep 14 12:01:12 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:01:12.864738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166e4ae-48b7-48d9-9c47-f039c6502570 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:12.866296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9166e4ae-48b7-48d9-9c47-f039c6502570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:12.954243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:13.005423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166e4ae-48b7-48d9-9c47-f039c6502570 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:13.122474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d97e-8d31-44f7-bb8d-450fcea5eb52 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:13.122761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d97e-8d31-44f7-bb8d-450fcea5eb52 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:13.123042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d97e-8d31-44f7-bb8d-450fcea5eb52 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:13.123614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802532b-3a6b-4326-940e-889b1925c8d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:13.124229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802532b-3a6b-4326-940e-889b1925c8d1 service swift] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:13.124461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 703/1397] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:01:13.124572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802532b-3a6b-4326-940e-889b1925c8d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:13.124808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802532b-3a6b-4326-940e-889b1925c8d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:13.126507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a802532b-3a6b-4326-940e-889b1925c8d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:13.129870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b406c9b-248d-4fd3-9af3-711e50b6fc6b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:13.130157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b406c9b-248d-4fd3-9af3-711e50b6fc6b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:13.130464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b406c9b-248d-4fd3-9af3-711e50b6fc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:13.200763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-0b406c9b-248d-4fd3-9af3-711e50b6fc6b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:13.201983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0b406c9b-248d-4fd3-9af3-711e50b6fc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:13.202401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:13.215284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802532b-3a6b-4326-940e-889b1925c8d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:13.217427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802532b-3a6b-4326-940e-889b1925c8d1 service swift] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:13.225648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 695/1398] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:01:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:01:13.273463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:13.301443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 704/1399] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:01:13.596744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802532b-3a6b-4326-940e-889b1925c8d1 service swift] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:13.598033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a802532b-3a6b-4326-940e-889b1925c8d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:13.699368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802532b-3a6b-4326-940e-889b1925c8d1 service swift] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:13.818522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114156f-f67a-4089-a0ea-f79bb60ecc86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:13.819033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114156f-f67a-4089-a0ea-f79bb60ecc86 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:13.819306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114156f-f67a-4089-a0ea-f79bb60ecc86 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:13.819584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114156f-f67a-4089-a0ea-f79bb60ecc86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:13.821141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8114156f-f67a-4089-a0ea-f79bb60ecc86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:13.828692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:13.909900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114156f-f67a-4089-a0ea-f79bb60ecc86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:13.911312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114156f-f67a-4089-a0ea-f79bb60ecc86 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:13.930575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 696/1400] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:16.553212 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e973cf-ddd5-4993-9af8-9ddafa0c1bdd None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:16.699345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e973cf-ddd5-4993-9af8-9ddafa0c1bdd None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:16.699345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e973cf-ddd5-4993-9af8-9ddafa0c1bdd None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:16.699345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 705/1401] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:16.700371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0284a3-4ab2-4585-aeb6-26fddd1c2707 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:16.700371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0284a3-4ab2-4585-aeb6-26fddd1c2707 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:16.700371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0284a3-4ab2-4585-aeb6-26fddd1c2707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:16.700371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6c0284a3-4ab2-4585-aeb6-26fddd1c2707 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:16.700371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6c0284a3-4ab2-4585-aeb6-26fddd1c2707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:16.750054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:16.774240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 697/1402] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:17.089511 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e973cf-ddd5-4993-9af8-9ddafa0c1bdd None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:17.091540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-31e973cf-ddd5-4993-9af8-9ddafa0c1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:17.284392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e973cf-ddd5-4993-9af8-9ddafa0c1bdd None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:17.348753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:17.418712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f351be0-e4fa-4b91-a4c4-1c78536b51f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:17.419353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f351be0-e4fa-4b91-a4c4-1c78536b51f8 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:17.419653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f351be0-e4fa-4b91-a4c4-1c78536b51f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:17.419890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f351be0-e4fa-4b91-a4c4-1c78536b51f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:17.421521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6f351be0-e4fa-4b91-a4c4-1c78536b51f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:17.526621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f351be0-e4fa-4b91-a4c4-1c78536b51f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:17.529142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f351be0-e4fa-4b91-a4c4-1c78536b51f8 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:17.549529 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 706/1403] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:20.030458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc92e-83e9-4232-ac42-52ed4a31eee4 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:20.031030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc92e-83e9-4232-ac42-52ed4a31eee4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:20.034722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc92e-83e9-4232-ac42-52ed4a31eee4 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:20.034722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 698/1404] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:20.038658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46911b-a41e-4eba-92b4-9dd34c051193 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:20.039126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46911b-a41e-4eba-92b4-9dd34c051193 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:20.039208 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46911b-a41e-4eba-92b4-9dd34c051193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:20.114087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-fe46911b-a41e-4eba-92b4-9dd34c051193 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:20.115365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fe46911b-a41e-4eba-92b4-9dd34c051193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:20.130222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:20.225223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 707/1405] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:20.522725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc92e-83e9-4232-ac42-52ed4a31eee4 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:20.524276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-30bcc92e-83e9-4232-ac42-52ed4a31eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:20.692802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc92e-83e9-4232-ac42-52ed4a31eee4 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:20.761036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:20.821769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b10be6-a4ee-4f28-8661-11ba85f86a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:20.822417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b10be6-a4ee-4f28-8661-11ba85f86a23 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:20.822695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b10be6-a4ee-4f28-8661-11ba85f86a23 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:20.822965 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b10be6-a4ee-4f28-8661-11ba85f86a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:20.825173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-73b10be6-a4ee-4f28-8661-11ba85f86a23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:20.923126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b10be6-a4ee-4f28-8661-11ba85f86a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:20.924744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b10be6-a4ee-4f28-8661-11ba85f86a23 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:20.944073 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 699/1406] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:23.436526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac1417-6bfa-41c7-a778-e8c3b273fd40 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:23.437127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac1417-6bfa-41c7-a778-e8c3b273fd40 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:23.437127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac1417-6bfa-41c7-a778-e8c3b273fd40 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:23.438753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 708/1407] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:23.444951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4eb45-2787-4cd3-b0ae-adfc8ea9229c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:23.445442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4eb45-2787-4cd3-b0ae-adfc8ea9229c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:23.445536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4eb45-2787-4cd3-b0ae-adfc8ea9229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:23.519830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-8ac4eb45-2787-4cd3-b0ae-adfc8ea9229c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:23.521074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8ac4eb45-2787-4cd3-b0ae-adfc8ea9229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:23.543679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:23.631681 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 700/1408] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:23.926523 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac1417-6bfa-41c7-a778-e8c3b273fd40 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:23.927005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-19ac1417-6bfa-41c7-a778-e8c3b273fd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:24.080869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:24.086109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac1417-6bfa-41c7-a778-e8c3b273fd40 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:24.212211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09923a40-ae4a-4a22-8917-14a7480ac3f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:24.213109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923a40-ae4a-4a22-8917-14a7480ac3f3 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:24.213394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923a40-ae4a-4a22-8917-14a7480ac3f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:24.213670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923a40-ae4a-4a22-8917-14a7480ac3f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:24.219513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-09923a40-ae4a-4a22-8917-14a7480ac3f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:24.319774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09923a40-ae4a-4a22-8917-14a7480ac3f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:24.321509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09923a40-ae4a-4a22-8917-14a7480ac3f3 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:24.337377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:24.342381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 709/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:33.630099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=34 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:38.879067 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dac9d-1eb6-40ed-a50e-794f840a2573 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:38.879701 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dac9d-1eb6-40ed-a50e-794f840a2573 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:38.879701 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dac9d-1eb6-40ed-a50e-794f840a2573 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:38.880882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 701/1410] 10.222.0.77 () {54 vars in 918 bytes} [Wed Sep 14 12:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:38.886666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672511e1-17ea-47ea-8217-5d96336364f1 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:38.887145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672511e1-17ea-47ea-8217-5d96336364f1 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:38.887605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672511e1-17ea-47ea-8217-5d96336364f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:38.964059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-672511e1-17ea-47ea-8217-5d96336364f1 None None] MFA Rules not processed for user `877b59ec265f42e4bf8edbd9767e3319`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:38.965918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-672511e1-17ea-47ea-8217-5d96336364f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:39.073195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 710/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Wed Sep 14 12:01:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:01:39.087816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54ebdf-91fa-4cb9-8500-13e29c66df3d None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:39.088103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54ebdf-91fa-4cb9-8500-13e29c66df3d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:39.088380 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54ebdf-91fa-4cb9-8500-13e29c66df3d None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:39.090285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 702/1412] 10.222.0.77 () {54 vars in 918 bytes} [Wed Sep 14 12:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:39.094966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc5530-bd55-45ea-85ef-c4a2edf7f3dd None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:39.095259 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc5530-bd55-45ea-85ef-c4a2edf7f3dd None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:39.095532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc5530-bd55-45ea-85ef-c4a2edf7f3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:39.179844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:39.183360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-11fc5530-bd55-45ea-85ef-c4a2edf7f3dd None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:39.184857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-11fc5530-bd55-45ea-85ef-c4a2edf7f3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:39.302440 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 711/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Wed Sep 14 12:01:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:41.925035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72e0c2-43a9-4846-b375-c790b731abfc None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:41.925589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72e0c2-43a9-4846-b375-c790b731abfc None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:41.925589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72e0c2-43a9-4846-b375-c790b731abfc None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:41.926956 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:41.932409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0408db-4646-4465-a5ee-ede0fdadc748 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:41.932887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0408db-4646-4465-a5ee-ede0fdadc748 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:41.933083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0408db-4646-4465-a5ee-ede0fdadc748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:42.002370 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6e0408db-4646-4465-a5ee-ede0fdadc748 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:42.003951 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6e0408db-4646-4465-a5ee-ede0fdadc748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:42.177386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:42.219426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:42.510852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72e0c2-43a9-4846-b375-c790b731abfc None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:42.513291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1d72e0c2-43a9-4846-b375-c790b731abfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:42.663218 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72e0c2-43a9-4846-b375-c790b731abfc None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:42.736537 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:42.775946 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded657b9-cec8-4ea9-95a9-f738915450d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:42.777151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded657b9-cec8-4ea9-95a9-f738915450d2 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:42.777434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded657b9-cec8-4ea9-95a9-f738915450d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:42.777886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded657b9-cec8-4ea9-95a9-f738915450d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:42.779527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ded657b9-cec8-4ea9-95a9-f738915450d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:42.867766 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded657b9-cec8-4ea9-95a9-f738915450d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:42.869361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded657b9-cec8-4ea9-95a9-f738915450d2 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:42.888139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 704/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:44.064968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b9937-b157-4aa9-91e8-4dbd3dafa139 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:44.065539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b9937-b157-4aa9-91e8-4dbd3dafa139 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:44.065539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b9937-b157-4aa9-91e8-4dbd3dafa139 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:44.066889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:44.073038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1910-ee00-4cfb-b876-51bd920a1452 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:44.073617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1910-ee00-4cfb-b876-51bd920a1452 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:44.073849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1910-ee00-4cfb-b876-51bd920a1452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:44.148318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-4dbc1910-ee00-4cfb-b876-51bd920a1452 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:44.149534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4dbc1910-ee00-4cfb-b876-51bd920a1452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:44.176420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:44.245651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:44.396469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b9937-b157-4aa9-91e8-4dbd3dafa139 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:44.397891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e09b9937-b157-4aa9-91e8-4dbd3dafa139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:44.548674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b9937-b157-4aa9-91e8-4dbd3dafa139 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:44.590279 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:44.664053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92206-78d3-4661-8b58-410910acdb52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:44.664675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92206-78d3-4661-8b58-410910acdb52 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:44.664946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92206-78d3-4661-8b58-410910acdb52 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:44.665219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92206-78d3-4661-8b58-410910acdb52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:44.666852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-cbd92206-78d3-4661-8b58-410910acdb52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:44.759609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92206-78d3-4661-8b58-410910acdb52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:44.762655 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92206-78d3-4661-8b58-410910acdb52 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:44.780535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 714/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:45.924123 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd519a7-35c1-42f1-9733-b4607c5bcb5a None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:45.924704 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd519a7-35c1-42f1-9733-b4607c5bcb5a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:45.924704 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd519a7-35c1-42f1-9733-b4607c5bcb5a None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:45.926038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:45.933016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a359d-b74d-4685-ac6d-7395cff4f804 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:45.933488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a359d-b74d-4685-ac6d-7395cff4f804 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:45.933947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a359d-b74d-4685-ac6d-7395cff4f804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:45.989724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:46.012587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-257a359d-b74d-4685-ac6d-7395cff4f804 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:46.013789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-257a359d-b74d-4685-ac6d-7395cff4f804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:46.118421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:46.272385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd519a7-35c1-42f1-9733-b4607c5bcb5a None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:46.273990 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-3bd519a7-35c1-42f1-9733-b4607c5bcb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:46.434302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd519a7-35c1-42f1-9733-b4607c5bcb5a None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:46.447448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:46.548521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322f4ea-703d-4ab9-abea-1ea35c5b1252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:46.549045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f4ea-703d-4ab9-abea-1ea35c5b1252 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:46.549322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f4ea-703d-4ab9-abea-1ea35c5b1252 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:46.549590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f4ea-703d-4ab9-abea-1ea35c5b1252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:46.551225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f322f4ea-703d-4ab9-abea-1ea35c5b1252 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:46.641738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322f4ea-703d-4ab9-abea-1ea35c5b1252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:46.643384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322f4ea-703d-4ab9-abea-1ea35c5b1252 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:46.661172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 707/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:47.782168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71540-e23c-4b3c-99fd-a3f84417d997 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:47.782776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71540-e23c-4b3c-99fd-a3f84417d997 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:47.782776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a71540-e23c-4b3c-99fd-a3f84417d997 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:47.784186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:47.790847 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81b249-1cc2-4b7f-95ce-edac952bc9f3 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:47.791310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81b249-1cc2-4b7f-95ce-edac952bc9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:47.791422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81b249-1cc2-4b7f-95ce-edac952bc9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:47.813328 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:47.869368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-9f81b249-1cc2-4b7f-95ce-edac952bc9f3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:47.870565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9f81b249-1cc2-4b7f-95ce-edac952bc9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:47.967912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:48.118865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a71540-e23c-4b3c-99fd-a3f84417d997 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:48.120618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-19a71540-e23c-4b3c-99fd-a3f84417d997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:48.231569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:48.267358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a71540-e23c-4b3c-99fd-a3f84417d997 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:48.380242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080212e1-2604-4101-b211-5d19fb7ecbf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:48.380780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080212e1-2604-4101-b211-5d19fb7ecbf3 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:48.381060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080212e1-2604-4101-b211-5d19fb7ecbf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:48.381337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080212e1-2604-4101-b211-5d19fb7ecbf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:48.382980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-080212e1-2604-4101-b211-5d19fb7ecbf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:48.462945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:48.484864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080212e1-2604-4101-b211-5d19fb7ecbf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:48.487510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080212e1-2604-4101-b211-5d19fb7ecbf3 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:48.513545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 717/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:49.624277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f056b-d8a0-4596-8792-dce57b770b5d None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:49.624732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f056b-d8a0-4596-8792-dce57b770b5d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:49.624846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f056b-d8a0-4596-8792-dce57b770b5d None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:49.626192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:49.632575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118369-63b2-4044-8646-341cdc20eb4d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:49.632989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118369-63b2-4044-8646-341cdc20eb4d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:49.633130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118369-63b2-4044-8646-341cdc20eb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:49.710173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e9118369-63b2-4044-8646-341cdc20eb4d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:49.711397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e9118369-63b2-4044-8646-341cdc20eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:49.806155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:49.957757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f056b-d8a0-4596-8792-dce57b770b5d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:49.959338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b56f056b-d8a0-4596-8792-dce57b770b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:50.041183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:50.102344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f056b-d8a0-4596-8792-dce57b770b5d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:50.212922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e113f-375e-43ba-808c-a9431744c272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:50.213444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e113f-375e-43ba-808c-a9431744c272 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:50.213722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e113f-375e-43ba-808c-a9431744c272 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:50.213987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e113f-375e-43ba-808c-a9431744c272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:50.215732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-fd4e113f-375e-43ba-808c-a9431744c272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:50.263370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:50.303316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e113f-375e-43ba-808c-a9431744c272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:50.304938 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e113f-375e-43ba-808c-a9431744c272 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:50.323772 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 710/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:51.445980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59917-6803-41e1-ae7f-53d838446546 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:51.446471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59917-6803-41e1-ae7f-53d838446546 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:51.446586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59917-6803-41e1-ae7f-53d838446546 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:51.448661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:51.455364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2545d-7c68-42a4-8dba-b4624e9b784d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:51.455845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2545d-7c68-42a4-8dba-b4624e9b784d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:51.455954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2545d-7c68-42a4-8dba-b4624e9b784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:51.532909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-9ea2545d-7c68-42a4-8dba-b4624e9b784d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:51.534131 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9ea2545d-7c68-42a4-8dba-b4624e9b784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:51.631966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:51.780137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59917-6803-41e1-ae7f-53d838446546 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:51.781547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3ba59917-6803-41e1-ae7f-53d838446546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:51.830904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:51.927933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59917-6803-41e1-ae7f-53d838446546 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:52.040752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f72cf8-81f6-4c2a-99d1-0b4034ae661b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:52.041280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72cf8-81f6-4c2a-99d1-0b4034ae661b service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:52.041556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72cf8-81f6-4c2a-99d1-0b4034ae661b service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:52.042078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72cf8-81f6-4c2a-99d1-0b4034ae661b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:52.044112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-17f72cf8-81f6-4c2a-99d1-0b4034ae661b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:52.051066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:52.134404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f72cf8-81f6-4c2a-99d1-0b4034ae661b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:52.136545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f72cf8-81f6-4c2a-99d1-0b4034ae661b service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:52.154319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 720/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:53.320005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a0ee-ed64-471b-af26-f5aaffd62b12 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:53.320636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a0ee-ed64-471b-af26-f5aaffd62b12 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:53.320636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a0ee-ed64-471b-af26-f5aaffd62b12 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:53.321908 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:53.328690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15dbcb-c41f-4250-9920-8938ab6b98bc None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:53.329145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15dbcb-c41f-4250-9920-8938ab6b98bc None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:53.329249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15dbcb-c41f-4250-9920-8938ab6b98bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:53.406769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-ce15dbcb-c41f-4250-9920-8938ab6b98bc None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:53.408051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ce15dbcb-c41f-4250-9920-8938ab6b98bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:53.474915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:53.504041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:53.654509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a0ee-ed64-471b-af26-f5aaffd62b12 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:53.656041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1304a0ee-ed64-471b-af26-f5aaffd62b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:53.673931 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:53.799872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a0ee-ed64-471b-af26-f5aaffd62b12 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:53.887098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:53.912939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad938b08-4498-4906-9b4b-4c1c7187e68c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:53.913550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad938b08-4498-4906-9b4b-4c1c7187e68c service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:53.913826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad938b08-4498-4906-9b4b-4c1c7187e68c service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:53.914093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad938b08-4498-4906-9b4b-4c1c7187e68c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:53.915723 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ad938b08-4498-4906-9b4b-4c1c7187e68c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:54.004500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad938b08-4498-4906-9b4b-4c1c7187e68c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:54.006088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad938b08-4498-4906-9b4b-4c1c7187e68c service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:54.023909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 713/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:55.130045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89b5f-810b-4638-a15f-547a7a18dfbb None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:55.130628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89b5f-810b-4638-a15f-547a7a18dfbb None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:55.130628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89b5f-810b-4638-a15f-547a7a18dfbb None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:55.131972 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:55.138880 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e037-fa36-4894-90cc-1e715886700e None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:55.139316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e037-fa36-4894-90cc-1e715886700e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:55.139538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e037-fa36-4894-90cc-1e715886700e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:55.215087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5ff9e037-fa36-4894-90cc-1e715886700e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:55.216439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5ff9e037-fa36-4894-90cc-1e715886700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:55.257577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:55.311906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:55.463653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89b5f-810b-4638-a15f-547a7a18dfbb None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:55.465200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a3b89b5f-810b-4638-a15f-547a7a18dfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:55.612450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89b5f-810b-4638-a15f-547a7a18dfbb None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:55.667033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:55.725790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfaaa7-0d08-4f62-96db-10fd6acf672e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:55.726353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfaaa7-0d08-4f62-96db-10fd6acf672e service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:55.726631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfaaa7-0d08-4f62-96db-10fd6acf672e service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:55.726902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfaaa7-0d08-4f62-96db-10fd6acf672e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:55.728486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-99bfaaa7-0d08-4f62-96db-10fd6acf672e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:55.818973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfaaa7-0d08-4f62-96db-10fd6acf672e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:55.820573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfaaa7-0d08-4f62-96db-10fd6acf672e service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:55.839122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 723/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:57.047872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec86f5-be55-4cc2-b9b2-08816af706d6 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:57.048449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec86f5-be55-4cc2-b9b2-08816af706d6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:57.048449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec86f5-be55-4cc2-b9b2-08816af706d6 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:57.049777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:57.056089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0918e-a472-493e-8b5c-d07154d5e6d2 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:57.056518 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0918e-a472-493e-8b5c-d07154d5e6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:57.056619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0918e-a472-493e-8b5c-d07154d5e6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:57.130629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b7a0918e-a472-493e-8b5c-d07154d5e6d2 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:57.131836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b7a0918e-a472-493e-8b5c-d07154d5e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:57.133804 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:57.228603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:01:57.379469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec86f5-be55-4cc2-b9b2-08816af706d6 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:01:57.380896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1aec86f5-be55-4cc2-b9b2-08816af706d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:57.524092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec86f5-be55-4cc2-b9b2-08816af706d6 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:01:57.551725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:57.638429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db65241-8331-40a5-911f-a4f8c78d829c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:01:57.638978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db65241-8331-40a5-911f-a4f8c78d829c service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:57.639254 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db65241-8331-40a5-911f-a4f8c78d829c service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:57.639522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db65241-8331-40a5-911f-a4f8c78d829c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:57.641118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1db65241-8331-40a5-911f-a4f8c78d829c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:01:57.728531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db65241-8331-40a5-911f-a4f8c78d829c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:01:57.730164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db65241-8331-40a5-911f-a4f8c78d829c service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:01:57.748202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 716/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:01:59.834074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c0278-cf61-49f3-98a1-ae5abcdb961c None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:59.834668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c0278-cf61-49f3-98a1-ae5abcdb961c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:59.834668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c0278-cf61-49f3-98a1-ae5abcdb961c None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:59.836032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:01:59.842015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24860768-a3c5-4660-b544-800fcf5bed3e None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:01:59.842517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24860768-a3c5-4660-b544-800fcf5bed3e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:01:59.842659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24860768-a3c5-4660-b544-800fcf5bed3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:01:59.883530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:01:59.911833 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-24860768-a3c5-4660-b544-800fcf5bed3e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:01:59.913048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-24860768-a3c5-4660-b544-800fcf5bed3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:00.009981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:00.294779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c0278-cf61-49f3-98a1-ae5abcdb961c None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:00.296393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-327c0278-cf61-49f3-98a1-ae5abcdb961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:00.414195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c0278-cf61-49f3-98a1-ae5abcdb961c None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:00.446269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:00.487783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27107795-e20a-4a88-9654-6b777a01d84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:00.488048 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27107795-e20a-4a88-9654-6b777a01d84e service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:00.488338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27107795-e20a-4a88-9654-6b777a01d84e service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:00.488613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27107795-e20a-4a88-9654-6b777a01d84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:00.490433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-27107795-e20a-4a88-9654-6b777a01d84e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:00.603161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27107795-e20a-4a88-9654-6b777a01d84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:00.605268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27107795-e20a-4a88-9654-6b777a01d84e service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:00.625734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 726/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:02.946006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8c404-0e57-41cf-a814-9e53f41f3ab6 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:02.946575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8c404-0e57-41cf-a814-9e53f41f3ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:02.946575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8c404-0e57-41cf-a814-9e53f41f3ab6 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:02.948266 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:02.953695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e7a1-205e-4c03-a85a-ddb22a4860bd None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:02.954135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e7a1-205e-4c03-a85a-ddb22a4860bd None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:02.954287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e7a1-205e-4c03-a85a-ddb22a4860bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:03.021498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d5a6e7a1-205e-4c03-a85a-ddb22a4860bd None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:03.022757 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d5a6e7a1-205e-4c03-a85a-ddb22a4860bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:03.035608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:03.125541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:03.415808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8c404-0e57-41cf-a814-9e53f41f3ab6 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:03.417982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f8f8c404-0e57-41cf-a814-9e53f41f3ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:03.520269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8c404-0e57-41cf-a814-9e53f41f3ab6 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:03.533642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:03.596398 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8565a8-676e-4ef6-9f1e-44e3245a0166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:03.597036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8565a8-676e-4ef6-9f1e-44e3245a0166 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:03.597315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8565a8-676e-4ef6-9f1e-44e3245a0166 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:03.597585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8565a8-676e-4ef6-9f1e-44e3245a0166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:03.599285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1b8565a8-676e-4ef6-9f1e-44e3245a0166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:03.708317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8565a8-676e-4ef6-9f1e-44e3245a0166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:03.709713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8565a8-676e-4ef6-9f1e-44e3245a0166 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:03.727503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 719/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:06.264371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8383fd-466f-43ce-80e0-341ba407eea5 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:06.264920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8383fd-466f-43ce-80e0-341ba407eea5 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:06.264920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8383fd-466f-43ce-80e0-341ba407eea5 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:06.266284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:06.271639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07affda7-9ed5-4f7e-9d44-93977ff66b15 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:06.272074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07affda7-9ed5-4f7e-9d44-93977ff66b15 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:06.272176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07affda7-9ed5-4f7e-9d44-93977ff66b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:06.320419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:06.340299 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-07affda7-9ed5-4f7e-9d44-93977ff66b15 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:06.341515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-07affda7-9ed5-4f7e-9d44-93977ff66b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:06.438897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:06.735127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8383fd-466f-43ce-80e0-341ba407eea5 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:06.736658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-dd8383fd-466f-43ce-80e0-341ba407eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:06.841104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8383fd-466f-43ce-80e0-341ba407eea5 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:06.882746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:06.916670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff86bd2-cb4b-4583-841a-b43765fb5634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:06.917300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff86bd2-cb4b-4583-841a-b43765fb5634 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:06.917584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff86bd2-cb4b-4583-841a-b43765fb5634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:06.917858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff86bd2-cb4b-4583-841a-b43765fb5634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:06.919508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-aff86bd2-cb4b-4583-841a-b43765fb5634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:07.028090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff86bd2-cb4b-4583-841a-b43765fb5634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:07.029511 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff86bd2-cb4b-4583-841a-b43765fb5634 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:07.048717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 729/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:09.346167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba497e-68af-4b67-bcb9-0d818d01be46 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:09.346781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba497e-68af-4b67-bcb9-0d818d01be46 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:09.346781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba497e-68af-4b67-bcb9-0d818d01be46 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:09.348118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:09.354340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb4410-8c61-4620-88ed-3db78fd9eb19 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:09.354988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb4410-8c61-4620-88ed-3db78fd9eb19 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:09.354988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb4410-8c61-4620-88ed-3db78fd9eb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:09.420548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-5bbb4410-8c61-4620-88ed-3db78fd9eb19 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:09.421778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5bbb4410-8c61-4620-88ed-3db78fd9eb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:09.443157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:09.518274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:09.802258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba497e-68af-4b67-bcb9-0d818d01be46 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:09.803805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-83ba497e-68af-4b67-bcb9-0d818d01be46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:09.907304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba497e-68af-4b67-bcb9-0d818d01be46 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:09.928732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:09.983788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234370ed-2af2-4ceb-8c05-384f894c9b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:09.984394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234370ed-2af2-4ceb-8c05-384f894c9b19 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:09.984675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234370ed-2af2-4ceb-8c05-384f894c9b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:09.984944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234370ed-2af2-4ceb-8c05-384f894c9b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:09.986651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-234370ed-2af2-4ceb-8c05-384f894c9b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:10.094245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234370ed-2af2-4ceb-8c05-384f894c9b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:10.095674 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234370ed-2af2-4ceb-8c05-384f894c9b19 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:10.113680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 722/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:12.394096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d85a3-e24f-4aa4-bf85-66996ec4313d None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:12.394668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d85a3-e24f-4aa4-bf85-66996ec4313d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:12.394668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d85a3-e24f-4aa4-bf85-66996ec4313d None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:12.396041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:12.402232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7434-494e-4b38-a291-6a69f5955b68 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:12.402676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7434-494e-4b38-a291-6a69f5955b68 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:12.402769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a7434-494e-4b38-a291-6a69f5955b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:12.466867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:12.470763 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-de3a7434-494e-4b38-a291-6a69f5955b68 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:12.471974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-de3a7434-494e-4b38-a291-6a69f5955b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:12.568842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:12.853720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d85a3-e24f-4aa4-bf85-66996ec4313d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:12.855288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c34d85a3-e24f-4aa4-bf85-66996ec4313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:12.960065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d85a3-e24f-4aa4-bf85-66996ec4313d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:13.009310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:13.033573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ca677-bd33-49d1-9b97-29e028998200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:13.034199 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ca677-bd33-49d1-9b97-29e028998200 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:13.034503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ca677-bd33-49d1-9b97-29e028998200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:13.034777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ca677-bd33-49d1-9b97-29e028998200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:13.036378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3f7ca677-bd33-49d1-9b97-29e028998200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:13.147599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ca677-bd33-49d1-9b97-29e028998200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:13.148959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ca677-bd33-49d1-9b97-29e028998200 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:13.167980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 732/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:15.411487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58ebee-b80b-4555-ae0b-69329f5ebfd4 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:15.412025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58ebee-b80b-4555-ae0b-69329f5ebfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:15.412025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58ebee-b80b-4555-ae0b-69329f5ebfd4 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:15.413454 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:15.419273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7a916-8601-4503-989e-9b756ff556de None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:15.419716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7a916-8601-4503-989e-9b756ff556de None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:15.419826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7a916-8601-4503-989e-9b756ff556de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:15.488603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d8d7a916-8601-4503-989e-9b756ff556de None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:15.489823 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d8d7a916-8601-4503-989e-9b756ff556de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:15.518342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:15.587244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:15.872560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58ebee-b80b-4555-ae0b-69329f5ebfd4 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:15.874076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ab58ebee-b80b-4555-ae0b-69329f5ebfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:15.979451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58ebee-b80b-4555-ae0b-69329f5ebfd4 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:16.019263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:16.075687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8351f-cc12-4c1c-8221-02d8c3e67078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:16.076313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8351f-cc12-4c1c-8221-02d8c3e67078 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:16.076592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8351f-cc12-4c1c-8221-02d8c3e67078 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:16.076867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8351f-cc12-4c1c-8221-02d8c3e67078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:16.078527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2cb8351f-cc12-4c1c-8221-02d8c3e67078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:16.188613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8351f-cc12-4c1c-8221-02d8c3e67078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:16.190361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8351f-cc12-4c1c-8221-02d8c3e67078 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:16.207911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 725/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:18.796365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4751c-62fd-4e3a-a41f-96426e0674d0 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:18.796921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4751c-62fd-4e3a-a41f-96426e0674d0 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:18.796921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4751c-62fd-4e3a-a41f-96426e0674d0 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:18.798248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:18.804676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88e4dc-0e73-4b37-922d-eb0810dd27c7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:18.805151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88e4dc-0e73-4b37-922d-eb0810dd27c7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:18.805244 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88e4dc-0e73-4b37-922d-eb0810dd27c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:18.879287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-7c88e4dc-0e73-4b37-922d-eb0810dd27c7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:18.880507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7c88e4dc-0e73-4b37-922d-eb0810dd27c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:18.889526 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:18.979601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:19.269090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4751c-62fd-4e3a-a41f-96426e0674d0 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:19.270669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-63b4751c-62fd-4e3a-a41f-96426e0674d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:19.374483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4751c-62fd-4e3a-a41f-96426e0674d0 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:19.428937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:19.448285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2131eb-5033-4fa3-8885-7585630e7415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:19.457534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2131eb-5033-4fa3-8885-7585630e7415 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:19.457534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2131eb-5033-4fa3-8885-7585630e7415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:19.457534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2131eb-5033-4fa3-8885-7585630e7415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:19.457534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6a2131eb-5033-4fa3-8885-7585630e7415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:19.560377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2131eb-5033-4fa3-8885-7585630e7415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:19.565559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2131eb-5033-4fa3-8885-7585630e7415 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:19.584790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 735/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:21.852669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6317993-b617-4e99-b4a5-58df51c396cd None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:21.853198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6317993-b617-4e99-b4a5-58df51c396cd None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:21.853298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6317993-b617-4e99-b4a5-58df51c396cd None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:21.854652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:21.860019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498064a-2ff3-42b6-8c6d-8e67451fe258 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:21.860441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498064a-2ff3-42b6-8c6d-8e67451fe258 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:21.860626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498064a-2ff3-42b6-8c6d-8e67451fe258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:21.926106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-7498064a-2ff3-42b6-8c6d-8e67451fe258 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:21.927334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7498064a-2ff3-42b6-8c6d-8e67451fe258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:21.966451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:22.025100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:22.306713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6317993-b617-4e99-b4a5-58df51c396cd None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:22.308229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a6317993-b617-4e99-b4a5-58df51c396cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:22.409301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6317993-b617-4e99-b4a5-58df51c396cd None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:22.447595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:22.483412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce469a-3edb-4ff8-8de7-955f8e8f41c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:22.484022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce469a-3edb-4ff8-8de7-955f8e8f41c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:22.484301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce469a-3edb-4ff8-8de7-955f8e8f41c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:22.484573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce469a-3edb-4ff8-8de7-955f8e8f41c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:22.486170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0bce469a-3edb-4ff8-8de7-955f8e8f41c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:22.595855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce469a-3edb-4ff8-8de7-955f8e8f41c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:22.597230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce469a-3edb-4ff8-8de7-955f8e8f41c9 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:22.616642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 728/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:24.815798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579db0a1-0162-4212-9906-046f5cc0d963 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:24.816361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579db0a1-0162-4212-9906-046f5cc0d963 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:24.816361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579db0a1-0162-4212-9906-046f5cc0d963 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:24.817641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:24.825296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4e92-6c44-4242-a4bb-eb0537cc0df1 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:24.825889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4e92-6c44-4242-a4bb-eb0537cc0df1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:24.825889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4e92-6c44-4242-a4bb-eb0537cc0df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:24.892046 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-225d4e92-6c44-4242-a4bb-eb0537cc0df1 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:24.893268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-225d4e92-6c44-4242-a4bb-eb0537cc0df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:24.911009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:25.000837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:25.295185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579db0a1-0162-4212-9906-046f5cc0d963 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:25.296733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-579db0a1-0162-4212-9906-046f5cc0d963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:25.400309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579db0a1-0162-4212-9906-046f5cc0d963 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:25.467032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:25.473352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17529d-93e4-4afc-bfb1-cf37521feb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:25.473966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17529d-93e4-4afc-bfb1-cf37521feb21 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:25.474268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17529d-93e4-4afc-bfb1-cf37521feb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:25.474545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17529d-93e4-4afc-bfb1-cf37521feb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:25.476142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-af17529d-93e4-4afc-bfb1-cf37521feb21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:25.584396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17529d-93e4-4afc-bfb1-cf37521feb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:25.585792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17529d-93e4-4afc-bfb1-cf37521feb21 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:25.604954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 738/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:27.894708 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1be7-d71b-47fc-a56f-10869ba7c7c3 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:27.895265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1be7-d71b-47fc-a56f-10869ba7c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:27.895265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1be7-d71b-47fc-a56f-10869ba7c7c3 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:27.896520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:27.902781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b549d-dfd0-4a09-8880-7bc0b3d3ebf7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:27.903210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b549d-dfd0-4a09-8880-7bc0b3d3ebf7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:27.903405 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b549d-dfd0-4a09-8880-7bc0b3d3ebf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:27.970602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-432b549d-dfd0-4a09-8880-7bc0b3d3ebf7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:27.971809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-432b549d-dfd0-4a09-8880-7bc0b3d3ebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:28.019543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:28.068001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:28.364208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b1be7-d71b-47fc-a56f-10869ba7c7c3 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:28.365736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-181b1be7-d71b-47fc-a56f-10869ba7c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:28.468596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b1be7-d71b-47fc-a56f-10869ba7c7c3 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:28.516886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:28.544523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2a466-c876-4594-ac14-6016661d9ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:28.545129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2a466-c876-4594-ac14-6016661d9ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:28.545404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2a466-c876-4594-ac14-6016661d9ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:28.545673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2a466-c876-4594-ac14-6016661d9ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:28.547358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-34d2a466-c876-4594-ac14-6016661d9ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:28.656350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2a466-c876-4594-ac14-6016661d9ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:28.657778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2a466-c876-4594-ac14-6016661d9ea8 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:28.676256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 731/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:38.066413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=22 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:38.673970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=66 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:48.878304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334a577-d22e-4430-bab7-f0179368cf8b None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:48.878841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334a577-d22e-4430-bab7-f0179368cf8b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:48.878841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334a577-d22e-4430-bab7-f0179368cf8b None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:48.880152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 740/1471] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:48.885892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d53f34-5011-4f15-8d41-6e47be46d680 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:48.886329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d53f34-5011-4f15-8d41-6e47be46d680 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:48.886474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d53f34-5011-4f15-8d41-6e47be46d680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:48.957638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-a1d53f34-5011-4f15-8d41-6e47be46d680 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:48.958874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a1d53f34-5011-4f15-8d41-6e47be46d680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:49.052605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 732/1472] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:49.357735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1699f76-bae8-4ece-b304-7445e6e16d1f None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:49.358018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1699f76-bae8-4ece-b304-7445e6e16d1f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:49.358318 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1699f76-bae8-4ece-b304-7445e6e16d1f None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:49.359688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 741/1473] 10.222.0.77 () {54 vars in 966 bytes} [Wed Sep 14 12:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:49.364602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91c7b-5667-4cd7-acc5-3ab7664cec87 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:49.364883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91c7b-5667-4cd7-acc5-3ab7664cec87 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:49.365178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91c7b-5667-4cd7-acc5-3ab7664cec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:49.440169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-53d91c7b-5667-4cd7-acc5-3ab7664cec87 None None] MFA Rules not processed for user `47bdd5f0b3bc4c099c0d34b3b7c3f3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:49.441373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-53d91c7b-5667-4cd7-acc5-3ab7664cec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:49.462816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:49.517333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 733/1474] 10.222.0.77 () {58 vars in 1063 bytes} [Wed Sep 14 12:02:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:49.525867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1699f76-bae8-4ece-b304-7445e6e16d1f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:49.527591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b1699f76-bae8-4ece-b304-7445e6e16d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:49.634068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1699f76-bae8-4ece-b304-7445e6e16d1f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:49.708923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8742ea-d8cf-45a7-9208-0a13e7f22d00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bdd5f0b3bc4c099c0d34b3b7c3f3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:49.709536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8742ea-d8cf-45a7-9208-0a13e7f22d00 service glance] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:49.709815 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8742ea-d8cf-45a7-9208-0a13e7f22d00 service glance] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:49.710089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8742ea-d8cf-45a7-9208-0a13e7f22d00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:49.712050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5a8742ea-d8cf-45a7-9208-0a13e7f22d00 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:49.766494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:49.821576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8742ea-d8cf-45a7-9208-0a13e7f22d00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:49.823029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8742ea-d8cf-45a7-9208-0a13e7f22d00 service glance] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:49.841407 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 742/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:52.109913 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c1f7-d547-412e-85b8-3aec9992139b None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:52.110518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c1f7-d547-412e-85b8-3aec9992139b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:52.110518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c1f7-d547-412e-85b8-3aec9992139b None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:52.111843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 734/1476] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:52.117395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6a7f9-7257-4905-94e5-b50c388ef994 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:52.117821 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6a7f9-7257-4905-94e5-b50c388ef994 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:52.118068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6a7f9-7257-4905-94e5-b50c388ef994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:52.185206 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-10e6a7f9-7257-4905-94e5-b50c388ef994 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:52.186446 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-10e6a7f9-7257-4905-94e5-b50c388ef994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:52.283018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 743/1477] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:52.561015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c1f7-d547-412e-85b8-3aec9992139b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:52.562566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5f50c1f7-d547-412e-85b8-3aec9992139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:52.691653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c1f7-d547-412e-85b8-3aec9992139b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:52.740436 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:52.786332 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281d94c-155f-4a17-b3c3-edcdf29018df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:52.786858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281d94c-155f-4a17-b3c3-edcdf29018df admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:52.787136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281d94c-155f-4a17-b3c3-edcdf29018df admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:52.787407 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281d94c-155f-4a17-b3c3-edcdf29018df admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:52.788043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281d94c-155f-4a17-b3c3-edcdf29018df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:52.790076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: WARNING py.warnings [None req-b281d94c-155f-4a17-b3c3-edcdf29018df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:02:52.790076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: warnings.warn(msg) Sep 14 12:02:52.790076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: Sep 14 12:02:52.791242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281d94c-155f-4a17-b3c3-edcdf29018df admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:52.810605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 735/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Sep 14 12:02:52 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:02:54.988029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add83b60-70fc-4754-90b0-34bee684c121 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:54.988680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add83b60-70fc-4754-90b0-34bee684c121 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:54.988787 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add83b60-70fc-4754-90b0-34bee684c121 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:54.990137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 744/1479] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:54.995745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf93ea1-fcf2-4686-8b83-91419184219c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:54.996223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf93ea1-fcf2-4686-8b83-91419184219c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:54.996333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf93ea1-fcf2-4686-8b83-91419184219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:55.065273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ecf93ea1-fcf2-4686-8b83-91419184219c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:55.066524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ecf93ea1-fcf2-4686-8b83-91419184219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:55.163359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 736/1480] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:55.462692 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add83b60-70fc-4754-90b0-34bee684c121 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:55.464197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-add83b60-70fc-4754-90b0-34bee684c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:55.484145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:55.628514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add83b60-70fc-4754-90b0-34bee684c121 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:55.709898 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:55.741272 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a38776-8628-499c-a22f-a063f5152e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:55.742441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38776-8628-499c-a22f-a063f5152e4b service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:55.742738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38776-8628-499c-a22f-a063f5152e4b service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:55.743007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a38776-8628-499c-a22f-a063f5152e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:55.744594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-32a38776-8628-499c-a22f-a063f5152e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:55.834679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a38776-8628-499c-a22f-a063f5152e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:55.837079 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a38776-8628-499c-a22f-a063f5152e4b service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:55.856065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 745/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:02:58.347921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b7c2-3890-4010-8258-73cca2c6879b None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:58.348497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b7c2-3890-4010-8258-73cca2c6879b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:58.348497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b7c2-3890-4010-8258-73cca2c6879b None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:58.349919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 737/1482] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:02:58.356171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b4a5-0b53-48ba-9caa-c7c773507f7d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:58.356630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b4a5-0b53-48ba-9caa-c7c773507f7d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:58.356759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b4a5-0b53-48ba-9caa-c7c773507f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:58.423073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e667b4a5-0b53-48ba-9caa-c7c773507f7d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:02:58.424284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e667b4a5-0b53-48ba-9caa-c7c773507f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:58.470868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:58.521786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 746/1483] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:02:58.812798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b7c2-3890-4010-8258-73cca2c6879b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:02:58.814657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9b99b7c2-3890-4010-8258-73cca2c6879b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:58.839108 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:58.919640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b7c2-3890-4010-8258-73cca2c6879b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:02:58.993484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa593a-1847-483e-a4ec-a274af57b542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:02:58.994083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa593a-1847-483e-a4ec-a274af57b542 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:02:58.994391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa593a-1847-483e-a4ec-a274af57b542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:02:58.994667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa593a-1847-483e-a4ec-a274af57b542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:02:58.996270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-acaa593a-1847-483e-a4ec-a274af57b542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:02:59.071123 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:02:59.104923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa593a-1847-483e-a4ec-a274af57b542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:02:59.106392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa593a-1847-483e-a4ec-a274af57b542 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:02:59.124505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 738/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:02:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:03:01.352735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81b24a-f217-46ea-9c33-1109392bc9ac None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:03:01.353306 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81b24a-f217-46ea-9c33-1109392bc9ac None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:03:01.353414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81b24a-f217-46ea-9c33-1109392bc9ac None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:03:01.354795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 747/1485] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:03:01.360171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57beb6-a40a-437f-9b5f-043819e80b24 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:03:01.360658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57beb6-a40a-437f-9b5f-043819e80b24 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:03:01.360765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57beb6-a40a-437f-9b5f-043819e80b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:03:01.427078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6c57beb6-a40a-437f-9b5f-043819e80b24 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:03:01.428311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6c57beb6-a40a-437f-9b5f-043819e80b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:03:01.533112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 739/1486] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:03:01.826577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81b24a-f217-46ea-9c33-1109392bc9ac None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:03:01.828115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3a81b24a-f217-46ea-9c33-1109392bc9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:03:01.932586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81b24a-f217-46ea-9c33-1109392bc9ac None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:03:02.004330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:03:02.005855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85833a46-bbd3-40c1-8574-1a3c529094ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:03:02.006494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85833a46-bbd3-40c1-8574-1a3c529094ee service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:03:02.006775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85833a46-bbd3-40c1-8574-1a3c529094ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:03:02.007051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85833a46-bbd3-40c1-8574-1a3c529094ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:03:02.009338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-85833a46-bbd3-40c1-8574-1a3c529094ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:03:02.132230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85833a46-bbd3-40c1-8574-1a3c529094ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:03:02.134040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85833a46-bbd3-40c1-8574-1a3c529094ee service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:03:02.152672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 748/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:03:04.483858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f877fb-c9b2-45e6-8dfb-13f8651a8f61 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:03:04.484451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f877fb-c9b2-45e6-8dfb-13f8651a8f61 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:03:04.484451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f877fb-c9b2-45e6-8dfb-13f8651a8f61 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:03:04.485827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 740/1488] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:03:04.491604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d975e32-f8d9-4dca-91bf-5e4d63011fe8 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:03:04.492556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d975e32-f8d9-4dca-91bf-5e4d63011fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:03:04.492800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d975e32-f8d9-4dca-91bf-5e4d63011fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:03:04.565409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-4d975e32-f8d9-4dca-91bf-5e4d63011fe8 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:03:04.566625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4d975e32-f8d9-4dca-91bf-5e4d63011fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:03:04.625298 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:03:04.673024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 749/1489] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:03:04.971895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f877fb-c9b2-45e6-8dfb-13f8651a8f61 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:03:04.973410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d1f877fb-c9b2-45e6-8dfb-13f8651a8f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:03:05.009347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:03:05.076859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f877fb-c9b2-45e6-8dfb-13f8651a8f61 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:03:05.150489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be175d-b5b6-4509-9555-d020305ff2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:03:05.151091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be175d-b5b6-4509-9555-d020305ff2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:03:05.151369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be175d-b5b6-4509-9555-d020305ff2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:03:05.151640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be175d-b5b6-4509-9555-d020305ff2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:03:05.153231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c2be175d-b5b6-4509-9555-d020305ff2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:03:05.233568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:03:05.262039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be175d-b5b6-4509-9555-d020305ff2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:03:05.263556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be175d-b5b6-4509-9555-d020305ff2f0 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:03:05.281380 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 741/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:03:08.011104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a89a9-cbc8-446f-8dfd-5b27c0520516 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:03:08.011673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a89a9-cbc8-446f-8dfd-5b27c0520516 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:03:08.011673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a89a9-cbc8-446f-8dfd-5b27c0520516 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:03:08.013007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 750/1491] 10.222.0.77 () {54 vars in 927 bytes} [Wed Sep 14 12:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:03:08.018241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2fd86-098a-43f8-aa2d-fbbca1e497ec None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:03:08.018676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2fd86-098a-43f8-aa2d-fbbca1e497ec None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:03:08.018781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2fd86-098a-43f8-aa2d-fbbca1e497ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:03:08.085945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-bcd2fd86-098a-43f8-aa2d-fbbca1e497ec None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:03:08.087194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-bcd2fd86-098a-43f8-aa2d-fbbca1e497ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:03:08.182229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 742/1492] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Sep 14 12:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:03:08.474957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a89a9-cbc8-446f-8dfd-5b27c0520516 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:03:08.477090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3a7a89a9-cbc8-446f-8dfd-5b27c0520516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:03:08.581261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a89a9-cbc8-446f-8dfd-5b27c0520516 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:03:08.656115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ef14f-ec00-46f8-9867-b860ae7bac83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:03:08.656737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ef14f-ec00-46f8-9867-b860ae7bac83 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:03:08.657018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ef14f-ec00-46f8-9867-b860ae7bac83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:03:08.657292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ef14f-ec00-46f8-9867-b860ae7bac83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:03:08.658929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4a3ef14f-ec00-46f8-9867-b860ae7bac83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:03:08.667806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:03:08.769230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ef14f-ec00-46f8-9867-b860ae7bac83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:03:08.770743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ef14f-ec00-46f8-9867-b860ae7bac83 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:03:08.789518 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 751/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:03:18.180665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=82 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:03:18.786976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=50 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:04:44.035506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ae9c1-aa9a-4456-a4f1-05077952bad3 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.036207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ae9c1-aa9a-4456-a4f1-05077952bad3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.036207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ae9c1-aa9a-4456-a4f1-05077952bad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:44.118008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-a24ae9c1-aa9a-4456-a4f1-05077952bad3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:04:44.119269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a24ae9c1-aa9a-4456-a4f1-05077952bad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:04:44.220027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 743/1494] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:04:44.228775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404f93-b575-410e-8919-2a66493ba1b7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.229269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404f93-b575-410e-8919-2a66493ba1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.229376 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404f93-b575-410e-8919-2a66493ba1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:44.249760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b2404f93-b575-410e-8919-2a66493ba1b7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:04:44.250998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b2404f93-b575-410e-8919-2a66493ba1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:04:44.260058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 752/1495] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:04:44.264609 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ae9c1-aa9a-4456-a4f1-05077952bad3 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:04:44.274818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ae9c1-aa9a-4456-a4f1-05077952bad3 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:04:44.279393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd98c28-efac-409d-89fa-b3f0ef6f52aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:04:44.279989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd98c28-efac-409d-89fa-b3f0ef6f52aa admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.280270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd98c28-efac-409d-89fa-b3f0ef6f52aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.280544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd98c28-efac-409d-89fa-b3f0ef6f52aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:44.281191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd98c28-efac-409d-89fa-b3f0ef6f52aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:04:44.281492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd98c28-efac-409d-89fa-b3f0ef6f52aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:04:44.282536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: WARNING py.warnings [None req-4cd98c28-efac-409d-89fa-b3f0ef6f52aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:04:44.282536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: warnings.warn(msg) Sep 14 12:04:44.282536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: Sep 14 12:04:44.283422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd98c28-efac-409d-89fa-b3f0ef6f52aa admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:04:44.295027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 744/1496] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:04:44.303221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404f93-b575-410e-8919-2a66493ba1b7 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:04:44.312260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404f93-b575-410e-8919-2a66493ba1b7 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:04:44.317852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc90053-dcf9-45dd-8493-7bab7fba2ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:04:44.318482 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc90053-dcf9-45dd-8493-7bab7fba2ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.318766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc90053-dcf9-45dd-8493-7bab7fba2ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.319041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc90053-dcf9-45dd-8493-7bab7fba2ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:44.319669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc90053-dcf9-45dd-8493-7bab7fba2ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:04:44.321390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: WARNING py.warnings [None req-abc90053-dcf9-45dd-8493-7bab7fba2ff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:04:44.321390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: warnings.warn(msg) Sep 14 12:04:44.321390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: Sep 14 12:04:44.322723 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc90053-dcf9-45dd-8493-7bab7fba2ff1 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:04:44.440418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 753/1497] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:04:44 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:04:44.444612 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd98c28-efac-409d-89fa-b3f0ef6f52aa admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:04:44.455045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd98c28-efac-409d-89fa-b3f0ef6f52aa admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:04:44.505288 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:04:44.512140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313ecbf-d00f-4b26-857d-c6150b04431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:04:44.512756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313ecbf-d00f-4b26-857d-c6150b04431d admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.513100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313ecbf-d00f-4b26-857d-c6150b04431d admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.513388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313ecbf-d00f-4b26-857d-c6150b04431d admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:44.514024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313ecbf-d00f-4b26-857d-c6150b04431d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:04:44.515078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: WARNING py.warnings [None req-a313ecbf-d00f-4b26-857d-c6150b04431d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:04:44.515078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: warnings.warn(msg) Sep 14 12:04:44.515078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: Sep 14 12:04:44.516327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313ecbf-d00f-4b26-857d-c6150b04431d admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:04:44.616750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 745/1498] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:04:44 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:04:44.621056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc90053-dcf9-45dd-8493-7bab7fba2ff1 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:04:44.632122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc90053-dcf9-45dd-8493-7bab7fba2ff1 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:04:44.636742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93185f0-38bd-4754-93f7-15407c2ccaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:04:44.637379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93185f0-38bd-4754-93f7-15407c2ccaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.637664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93185f0-38bd-4754-93f7-15407c2ccaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.637940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93185f0-38bd-4754-93f7-15407c2ccaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:44.638655 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93185f0-38bd-4754-93f7-15407c2ccaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:04:44.639651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: WARNING py.warnings [None req-c93185f0-38bd-4754-93f7-15407c2ccaf4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:04:44.639651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: warnings.warn(msg) Sep 14 12:04:44.639651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: Sep 14 12:04:44.640537 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93185f0-38bd-4754-93f7-15407c2ccaf4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:04:44.653382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 754/1499] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:04:44.657543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313ecbf-d00f-4b26-857d-c6150b04431d admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:04:44.667874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313ecbf-d00f-4b26-857d-c6150b04431d admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:04:44.672428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76de2a6-46ce-4bc8-bd10-57d2cf4fec77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:04:44.673016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76de2a6-46ce-4bc8-bd10-57d2cf4fec77 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.673296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76de2a6-46ce-4bc8-bd10-57d2cf4fec77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.673568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76de2a6-46ce-4bc8-bd10-57d2cf4fec77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:44.674221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76de2a6-46ce-4bc8-bd10-57d2cf4fec77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:04:44.676276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: WARNING py.warnings [None req-d76de2a6-46ce-4bc8-bd10-57d2cf4fec77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:04:44.676276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: warnings.warn(msg) Sep 14 12:04:44.676276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: Sep 14 12:04:44.677164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76de2a6-46ce-4bc8-bd10-57d2cf4fec77 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:04:44.691856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 746/1500] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:04:44.696039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93185f0-38bd-4754-93f7-15407c2ccaf4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:04:44.706316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93185f0-38bd-4754-93f7-15407c2ccaf4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:04:44.711262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076de79-0af4-46f3-9aa6-c4f5154fe5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:04:44.712029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076de79-0af4-46f3-9aa6-c4f5154fe5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.712405 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076de79-0af4-46f3-9aa6-c4f5154fe5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.712864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076de79-0af4-46f3-9aa6-c4f5154fe5cb admin admin] PATH_INFO: `/v3/projects/457849594dbf4e00877378ebdcb21c68/users/7f9cd33acd68460e95e078f355ed1932/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:44.729453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076de79-0af4-46f3-9aa6-c4f5154fe5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=457849594dbf4e00877378ebdcb21c68, user_id=7f9cd33acd68460e95e078f355ed1932, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:04:44.730607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: WARNING py.warnings [None req-7076de79-0af4-46f3-9aa6-c4f5154fe5cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:04:44.730607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: warnings.warn(msg) Sep 14 12:04:44.730607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: Sep 14 12:04:44.732541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076de79-0af4-46f3-9aa6-c4f5154fe5cb admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:04:44.817833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 755/1501] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:04:44 2022] PUT /identity/v3/projects/457849594dbf4e00877378ebdcb21c68/users/7f9cd33acd68460e95e078f355ed1932/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:04:44.829866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682636cd-0ab5-45e6-8148-49a5cf61bcc0 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.830085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682636cd-0ab5-45e6-8148-49a5cf61bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.830386 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682636cd-0ab5-45e6-8148-49a5cf61bcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:44.857853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-682636cd-0ab5-45e6-8148-49a5cf61bcc0 None None] MFA Rules not processed for user `7f9cd33acd68460e95e078f355ed1932`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:04:44.862715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-682636cd-0ab5-45e6-8148-49a5cf61bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:04:44.921518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 747/1502] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:04:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:04:44.935144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7a95a-cc87-4b36-9d5e-a41e5bac502a None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.935430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7a95a-cc87-4b36-9d5e-a41e5bac502a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.935707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7a95a-cc87-4b36-9d5e-a41e5bac502a None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:44.937081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 756/1503] 10.222.0.77 () {54 vars in 964 bytes} [Wed Sep 14 12:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:04:44.942160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d967bdd-9d6c-42cb-92a9-9d4465e89cb0 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:44.942476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d967bdd-9d6c-42cb-92a9-9d4465e89cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:44.942749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d967bdd-9d6c-42cb-92a9-9d4465e89cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:45.001491 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-9d967bdd-9d6c-42cb-92a9-9d4465e89cb0 None None] MFA Rules not processed for user `c610ab76127b40429d8e9259446df49a`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:04:45.002778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9d967bdd-9d6c-42cb-92a9-9d4465e89cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:04:45.076252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 748/1504] 10.222.0.77 () {58 vars in 1061 bytes} [Wed Sep 14 12:04:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:04:45.084022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7a95a-cc87-4b36-9d5e-a41e5bac502a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:04:45.094509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7a95a-cc87-4b36-9d5e-a41e5bac502a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:04:45.098790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02552d45-d5e0-4dea-902c-0ecc9ec0143b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:04:45.099389 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02552d45-d5e0-4dea-902c-0ecc9ec0143b service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:45.099665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02552d45-d5e0-4dea-902c-0ecc9ec0143b service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:45.099963 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02552d45-d5e0-4dea-902c-0ecc9ec0143b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:45.108052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02552d45-d5e0-4dea-902c-0ecc9ec0143b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:04:45.109465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02552d45-d5e0-4dea-902c-0ecc9ec0143b service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:04:45.118537 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 757/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:04:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:04:45.176637 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf6ace-f63d-41be-9e0e-ca628bb32c09 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:45.176925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf6ace-f63d-41be-9e0e-ca628bb32c09 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:45.177199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf6ace-f63d-41be-9e0e-ca628bb32c09 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:45.178488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 749/1506] 10.222.0.77 () {52 vars in 830 bytes} [Wed Sep 14 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:04:45.182166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02552d45-d5e0-4dea-902c-0ecc9ec0143b service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:04:45.244445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02552d45-d5e0-4dea-902c-0ecc9ec0143b service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:04:45.249441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:04:45.250080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:45.250519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:45.250838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] PATH_INFO: `/v3/users/7f9cd33acd68460e95e078f355ed1932` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:45.252015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9cd33acd68460e95e078f355ed1932)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:04:45.253242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: WARNING py.warnings [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:04:45.253242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: warnings.warn(msg) Sep 14 12:04:45.253242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: Sep 14 12:04:45.254532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:04:45.448185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9cd33acd68460e95e078f355ed1932'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:04:45.448849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9cd33acd68460e95e078f355ed1932'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:04:45.464198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9cd33acd68460e95e078f355ed1932'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:04:45.487908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9cd33acd68460e95e078f355ed1932'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:04:45.488714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9cd33acd68460e95e078f355ed1932'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:04:45.492699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:04:45.587343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 758/1507] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:04:45 2022] DELETE /identity/v3/users/7f9cd33acd68460e95e078f355ed1932 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:04:45.591818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b46d-a505-4b7a-b4ae-b4a87a541c3b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:45.592102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b46d-a505-4b7a-b4ae-b4a87a541c3b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:45.592375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b46d-a505-4b7a-b4ae-b4a87a541c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:45.611111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5a46b46d-a505-4b7a-b4ae-b4a87a541c3b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:04:45.612418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5a46b46d-a505-4b7a-b4ae-b4a87a541c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:04:45.622113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:04:45.670954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 750/1508] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:04:45.680684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:04:45.682122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:04:45.761065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1eb19-7255-4686-9b47-16b74c316bfa admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:04:45.764834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ebb03-8ede-46bd-b4f3-48fad106750a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:04:45.765464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ebb03-8ede-46bd-b4f3-48fad106750a service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:45.765754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ebb03-8ede-46bd-b4f3-48fad106750a service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:45.766035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ebb03-8ede-46bd-b4f3-48fad106750a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:45.776039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ebb03-8ede-46bd-b4f3-48fad106750a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:04:45.781010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ebb03-8ede-46bd-b4f3-48fad106750a service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:04:45.786949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 759/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:04:46.338393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b46d-a505-4b7a-b4ae-b4a87a541c3b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:04:46.339832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5a46b46d-a505-4b7a-b4ae-b4a87a541c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:04:46.351745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b46d-a505-4b7a-b4ae-b4a87a541c3b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:04:46.356166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:04:46.356752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:04:46.357015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:04:46.357282 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] PATH_INFO: `/v3/projects/457849594dbf4e00877378ebdcb21c68` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:04:46.358443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=457849594dbf4e00877378ebdcb21c68)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:04:46.359460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: WARNING py.warnings [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:04:46.359460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: warnings.warn(msg) Sep 14 12:04:46.359460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: Sep 14 12:04:46.360635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:04:46.478223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457849594dbf4e00877378ebdcb21c68', 'request_id': 'req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:04:46.491312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457849594dbf4e00877378ebdcb21c68', 'request_id': 'req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:04:46.497353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457849594dbf4e00877378ebdcb21c68', 'request_id': 'req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:04:46.584728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] The token cache is being invalidate because project 457849594dbf4e00877378ebdcb21c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:04:46.584728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:04:46.584728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a22b81a7-1cad-4ece-9c7f-d12ce974e93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:04:46.584728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 751/1510] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:04:46 2022] DELETE /identity/v3/projects/457849594dbf4e00877378ebdcb21c68 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:04:55.782764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:04:56.577666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:28.342596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a2a68-a79b-4998-ab42-07c51cb54574 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:28.343202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a2a68-a79b-4998-ab42-07c51cb54574 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:28.343303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a2a68-a79b-4998-ab42-07c51cb54574 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:28.344590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:06:28.349578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f167cd-a949-4848-b141-622eb16ff676 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:28.349974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f167cd-a949-4848-b141-622eb16ff676 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:28.350138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f167cd-a949-4848-b141-622eb16ff676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:28.369559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-67f167cd-a949-4848-b141-622eb16ff676 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:06:28.370803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-67f167cd-a949-4848-b141-622eb16ff676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:28.428628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:06:28.587408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a2a68-a79b-4998-ab42-07c51cb54574 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:06:28.589092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4f4a2a68-a79b-4998-ab42-07c51cb54574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:28.691586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a2a68-a79b-4998-ab42-07c51cb54574 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:06:28.697149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560edc7c-07fb-4a7c-843e-3bc60c7c49ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:06:28.697755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560edc7c-07fb-4a7c-843e-3bc60c7c49ec service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:28.698038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560edc7c-07fb-4a7c-843e-3bc60c7c49ec service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:28.698349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560edc7c-07fb-4a7c-843e-3bc60c7c49ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:28.707477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560edc7c-07fb-4a7c-843e-3bc60c7c49ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:06:28.710064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560edc7c-07fb-4a7c-843e-3bc60c7c49ec service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:06:28.720767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 761/1513] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:06:29.791639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fa283-6538-4b2a-980c-e818b09f61cb None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:29.792215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fa283-6538-4b2a-980c-e818b09f61cb None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:29.792215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fa283-6538-4b2a-980c-e818b09f61cb None None] PATH_INFO: `/v3` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:29.793466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 753/1514] 10.222.0.75 () {54 vars in 925 bytes} [Wed Sep 14 12:06:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:06:29.800571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611b76-04be-4860-b304-38f5a88d537e None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:29.800986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611b76-04be-4860-b304-38f5a88d537e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:29.801244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611b76-04be-4860-b304-38f5a88d537e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:29.817064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea8cb8-b891-4840-90b9-5ebfd9f0ae08 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:29.817490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea8cb8-b891-4840-90b9-5ebfd9f0ae08 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:29.817775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea8cb8-b891-4840-90b9-5ebfd9f0ae08 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:29.819142 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 754/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:06:29.825547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786753db-627a-4acb-ac4b-d87606905f40 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:29.826440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786753db-627a-4acb-ac4b-d87606905f40 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:29.826954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786753db-627a-4acb-ac4b-d87606905f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:29.846487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-786753db-627a-4acb-ac4b-d87606905f40 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:06:29.847709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-786753db-627a-4acb-ac4b-d87606905f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:29.856363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 755/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:06:29.856852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-71611b76-04be-4860-b304-38f5a88d537e None None] MFA Rules not processed for user `877b59ec265f42e4bf8edbd9767e3319`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:06:29.859169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-71611b76-04be-4860-b304-38f5a88d537e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:29.941875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 762/1517] 10.222.0.75 () {58 vars in 1015 bytes} [Wed Sep 14 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:06:30.010873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786753db-627a-4acb-ac4b-d87606905f40 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:06:30.023598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786753db-627a-4acb-ac4b-d87606905f40 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:06:30.029541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f8d74-f92e-4f8f-ad59-a6e18bb3524b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:06:30.030134 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f8d74-f92e-4f8f-ad59-a6e18bb3524b service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:30.030434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f8d74-f92e-4f8f-ad59-a6e18bb3524b service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:30.030702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f8d74-f92e-4f8f-ad59-a6e18bb3524b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:30.041212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f8d74-f92e-4f8f-ad59-a6e18bb3524b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:06:30.042820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f8d74-f92e-4f8f-ad59-a6e18bb3524b service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:06:30.052243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 756/1518] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:06:39.440685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afe47b-7c42-44dd-8854-d0db6ca6790a None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:39.441239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afe47b-7c42-44dd-8854-d0db6ca6790a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:39.441239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afe47b-7c42-44dd-8854-d0db6ca6790a None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:39.442656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 763/1519] 10.222.0.77 () {54 vars in 961 bytes} [Wed Sep 14 12:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:06:39.447787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef78cf3-a834-4641-a2e0-5697f1cad29a None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:39.448233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef78cf3-a834-4641-a2e0-5697f1cad29a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:39.448338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef78cf3-a834-4641-a2e0-5697f1cad29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:39.468294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5ef78cf3-a834-4641-a2e0-5697f1cad29a None None] MFA Rules not processed for user `877b59ec265f42e4bf8edbd9767e3319`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:06:39.469519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5ef78cf3-a834-4641-a2e0-5697f1cad29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:39.478062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 757/1520] 10.222.0.77 () {58 vars in 1058 bytes} [Wed Sep 14 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:06:39.486463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afe47b-7c42-44dd-8854-d0db6ca6790a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:06:39.500214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afe47b-7c42-44dd-8854-d0db6ca6790a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:06:39.505143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66bbf0-b3c6-4925-8118-4278cd769e30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:06:39.505772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66bbf0-b3c6-4925-8118-4278cd769e30 service placement] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:39.506055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66bbf0-b3c6-4925-8118-4278cd769e30 service placement] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:39.506372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66bbf0-b3c6-4925-8118-4278cd769e30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:39.515010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66bbf0-b3c6-4925-8118-4278cd769e30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:06:39.516587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66bbf0-b3c6-4925-8118-4278cd769e30 service placement] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:06:39.526435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 764/1521] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:06:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:06:41.543580 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370660a0-0be3-4df4-ae9f-1734d4d3fb8d None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:41.544677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370660a0-0be3-4df4-ae9f-1734d4d3fb8d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:41.544895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370660a0-0be3-4df4-ae9f-1734d4d3fb8d None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:41.546254 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:06:41.552723 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e63317-b88c-4832-b164-af1b1535515c None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:41.553596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e63317-b88c-4832-b164-af1b1535515c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:41.553596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e63317-b88c-4832-b164-af1b1535515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:41.573705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-11e63317-b88c-4832-b164-af1b1535515c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:06:41.574957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-11e63317-b88c-4832-b164-af1b1535515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:41.583176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:06:41.740341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370660a0-0be3-4df4-ae9f-1734d4d3fb8d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:06:41.755063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370660a0-0be3-4df4-ae9f-1734d4d3fb8d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:06:41.760582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf57192-1dac-4a3c-a4e8-1457dc092869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:06:41.761220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf57192-1dac-4a3c-a4e8-1457dc092869 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:41.761506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf57192-1dac-4a3c-a4e8-1457dc092869 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:41.761788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf57192-1dac-4a3c-a4e8-1457dc092869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:41.770749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf57192-1dac-4a3c-a4e8-1457dc092869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:06:41.780368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf57192-1dac-4a3c-a4e8-1457dc092869 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:06:41.782445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 759/1524] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:06:42.972904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d4f4f-9fcb-4fe9-9afb-c0774139caaf None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:42.973477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d4f4f-9fcb-4fe9-9afb-c0774139caaf None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:42.973477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d4f4f-9fcb-4fe9-9afb-c0774139caaf None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:42.974852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:06:42.981170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bdadd-df65-4501-adcc-cfbf61cc2c1b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:42.983715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bdadd-df65-4501-adcc-cfbf61cc2c1b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:42.983715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bdadd-df65-4501-adcc-cfbf61cc2c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:43.006267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-0e5bdadd-df65-4501-adcc-cfbf61cc2c1b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:06:43.007495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0e5bdadd-df65-4501-adcc-cfbf61cc2c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:43.015362 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:06:43.188269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d4f4f-9fcb-4fe9-9afb-c0774139caaf None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:06:43.196491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:43.203063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d4f4f-9fcb-4fe9-9afb-c0774139caaf None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:06:43.208399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce457f5e-4a44-4278-8138-aefd8505452d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:06:43.208992 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce457f5e-4a44-4278-8138-aefd8505452d service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:43.209269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce457f5e-4a44-4278-8138-aefd8505452d service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:43.209536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce457f5e-4a44-4278-8138-aefd8505452d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:43.218040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce457f5e-4a44-4278-8138-aefd8505452d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:06:43.219625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce457f5e-4a44-4278-8138-aefd8505452d service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:06:43.235634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 767/1527] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:06:47.281740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336f9f-74f7-46c1-8d42-10b00ea0b683 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:47.282359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336f9f-74f7-46c1-8d42-10b00ea0b683 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:47.282359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336f9f-74f7-46c1-8d42-10b00ea0b683 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:47.283709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:06:47.289065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187134-0ab4-4a19-86c9-c96430ac0aee None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:47.289484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187134-0ab4-4a19-86c9-c96430ac0aee None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:47.289624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187134-0ab4-4a19-86c9-c96430ac0aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:47.309073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f2187134-0ab4-4a19-86c9-c96430ac0aee None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:06:47.310607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f2187134-0ab4-4a19-86c9-c96430ac0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:47.318782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:06:47.604861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95336f9f-74f7-46c1-8d42-10b00ea0b683 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:06:47.606925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-95336f9f-74f7-46c1-8d42-10b00ea0b683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:47.664588 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95336f9f-74f7-46c1-8d42-10b00ea0b683 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:06:47.668155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0bea7-0ab7-4efa-859f-e33cf4d8b34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:06:47.668831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0bea7-0ab7-4efa-859f-e33cf4d8b34b service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:47.669114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0bea7-0ab7-4efa-859f-e33cf4d8b34b service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:47.669390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0bea7-0ab7-4efa-859f-e33cf4d8b34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:47.678534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0bea7-0ab7-4efa-859f-e33cf4d8b34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:06:47.679962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0bea7-0ab7-4efa-859f-e33cf4d8b34b service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:06:47.690085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 762/1530] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:06:49.862455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b40ca-870a-4153-b794-9252b5f864c9 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:49.863025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b40ca-870a-4153-b794-9252b5f864c9 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:49.863025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b40ca-870a-4153-b794-9252b5f864c9 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:49.864371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:06:49.869583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4f31-c521-4aaa-888e-652921f37f62 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:49.870013 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4f31-c521-4aaa-888e-652921f37f62 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:49.870111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4f31-c521-4aaa-888e-652921f37f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:49.890960 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c10b4f31-c521-4aaa-888e-652921f37f62 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:06:49.892161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c10b4f31-c521-4aaa-888e-652921f37f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:49.899927 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:06:50.188778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b40ca-870a-4153-b794-9252b5f864c9 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:06:50.199520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b40ca-870a-4153-b794-9252b5f864c9 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:06:50.203360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdee0a9-e2a6-4a9e-bb36-b2648ec6bbc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:06:50.203955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee0a9-e2a6-4a9e-bb36-b2648ec6bbc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:50.204233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee0a9-e2a6-4a9e-bb36-b2648ec6bbc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:50.204504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee0a9-e2a6-4a9e-bb36-b2648ec6bbc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:50.213175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdee0a9-e2a6-4a9e-bb36-b2648ec6bbc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:06:50.214615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdee0a9-e2a6-4a9e-bb36-b2648ec6bbc1 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:06:50.226050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 770/1533] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:06:53.984193 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb012c4-6bb5-44ac-ad18-aa333e64a024 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:53.984733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb012c4-6bb5-44ac-ad18-aa333e64a024 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:53.984733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb012c4-6bb5-44ac-ad18-aa333e64a024 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:53.986139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:06:53.991308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5733eb6-7b73-46f6-837b-cdb776f44b6b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:53.991693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5733eb6-7b73-46f6-837b-cdb776f44b6b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:53.991854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5733eb6-7b73-46f6-837b-cdb776f44b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:54.011038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d5733eb6-7b73-46f6-837b-cdb776f44b6b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:06:54.012756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d5733eb6-7b73-46f6-837b-cdb776f44b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:54.020687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:06:54.324154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb012c4-6bb5-44ac-ad18-aa333e64a024 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:06:54.325982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-feb012c4-6bb5-44ac-ad18-aa333e64a024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:54.383138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb012c4-6bb5-44ac-ad18-aa333e64a024 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:06:54.386625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f2304-254d-4633-8c31-0cc4d7537210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:06:54.387297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f2304-254d-4633-8c31-0cc4d7537210 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:54.387576 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f2304-254d-4633-8c31-0cc4d7537210 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:54.387845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f2304-254d-4633-8c31-0cc4d7537210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:54.393571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:06:54.397043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f2304-254d-4633-8c31-0cc4d7537210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:06:54.398488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f2304-254d-4633-8c31-0cc4d7537210 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:06:54.408253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 765/1536] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:06:56.569400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873dde-19a4-4467-a392-3ceff7eae575 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:56.569942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873dde-19a4-4467-a392-3ceff7eae575 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:56.570055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873dde-19a4-4467-a392-3ceff7eae575 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:56.571362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:06:56.579267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726990-aa62-410d-bf9f-5b7d99fd405c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:56.579688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726990-aa62-410d-bf9f-5b7d99fd405c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:56.579802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726990-aa62-410d-bf9f-5b7d99fd405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:56.600173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-e8726990-aa62-410d-bf9f-5b7d99fd405c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:06:56.601401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e8726990-aa62-410d-bf9f-5b7d99fd405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:56.610889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:06:56.928193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c873dde-19a4-4467-a392-3ceff7eae575 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:06:56.929892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1c873dde-19a4-4467-a392-3ceff7eae575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:06:56.944021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c873dde-19a4-4467-a392-3ceff7eae575 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:06:56.947463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715953e4-9988-4d0a-8c8d-a62c2d9a20e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:06:56.948109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715953e4-9988-4d0a-8c8d-a62c2d9a20e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:06:56.948475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715953e4-9988-4d0a-8c8d-a62c2d9a20e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:06:56.948781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715953e4-9988-4d0a-8c8d-a62c2d9a20e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:06:56.959113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715953e4-9988-4d0a-8c8d-a62c2d9a20e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:06:56.962818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715953e4-9988-4d0a-8c8d-a62c2d9a20e8 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:06:56.972269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 773/1539] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:06:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:07:06.595102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=6 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:07:06.968117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=23 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:26.734292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6f15c-92bf-4ba9-8e03-7270b51a9b8d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:26.737377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6f15c-92bf-4ba9-8e03-7270b51a9b8d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:26.737377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6f15c-92bf-4ba9-8e03-7270b51a9b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:26.765240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-f6f6f15c-92bf-4ba9-8e03-7270b51a9b8d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:26.767374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f6f6f15c-92bf-4ba9-8e03-7270b51a9b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:26.780754 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 767/1540] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:26.791702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966bb18-1ca0-49c5-a84e-497c8690af0a None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:26.792754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966bb18-1ca0-49c5-a84e-497c8690af0a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:26.793254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966bb18-1ca0-49c5-a84e-497c8690af0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:26.823315 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f966bb18-1ca0-49c5-a84e-497c8690af0a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:26.825022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f966bb18-1ca0-49c5-a84e-497c8690af0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:26.838642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 774/1541] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:26.843551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6f15c-92bf-4ba9-8e03-7270b51a9b8d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:26.854597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6f15c-92bf-4ba9-8e03-7270b51a9b8d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:26.866113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2de05-395d-4662-b014-8e90b0967954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:26.866762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2de05-395d-4662-b014-8e90b0967954 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:26.867075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2de05-395d-4662-b014-8e90b0967954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:26.867423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2de05-395d-4662-b014-8e90b0967954 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:26.868111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2de05-395d-4662-b014-8e90b0967954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:26.868641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2de05-395d-4662-b014-8e90b0967954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:26.870340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2de05-395d-4662-b014-8e90b0967954 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:26.892261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 768/1542] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:26.900702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966bb18-1ca0-49c5-a84e-497c8690af0a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:26.916862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966bb18-1ca0-49c5-a84e-497c8690af0a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:26.922456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a76f25-3156-47ab-b764-03d914926dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:26.924573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76f25-3156-47ab-b764-03d914926dae admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:26.924573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76f25-3156-47ab-b764-03d914926dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:26.924573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76f25-3156-47ab-b764-03d914926dae admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:26.924573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a76f25-3156-47ab-b764-03d914926dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:26.927033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a76f25-3156-47ab-b764-03d914926dae admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.110572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 775/1543] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:26 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:27.115272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2de05-395d-4662-b014-8e90b0967954 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.126197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2de05-395d-4662-b014-8e90b0967954 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:27.172504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff068e0e-8f1c-4ce4-91ae-b46b957c6a64 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.173179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff068e0e-8f1c-4ce4-91ae-b46b957c6a64 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.173685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff068e0e-8f1c-4ce4-91ae-b46b957c6a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.211757 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-ff068e0e-8f1c-4ce4-91ae-b46b957c6a64 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.213403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ff068e0e-8f1c-4ce4-91ae-b46b957c6a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.222581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a5a4e-e012-4a2f-b8b3-1f7a717c6dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:27.224447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a5a4e-e012-4a2f-b8b3-1f7a717c6dec admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.224447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a5a4e-e012-4a2f-b8b3-1f7a717c6dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.224447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a5a4e-e012-4a2f-b8b3-1f7a717c6dec admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.224447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a5a4e-e012-4a2f-b8b3-1f7a717c6dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:27.226823 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a5a4e-e012-4a2f-b8b3-1f7a717c6dec admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.249956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 776/1544] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.259909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aee32-0129-4874-ac87-2ea838ee0659 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.266442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aee32-0129-4874-ac87-2ea838ee0659 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.266442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aee32-0129-4874-ac87-2ea838ee0659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.292832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-af1aee32-0129-4874-ac87-2ea838ee0659 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.294083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-af1aee32-0129-4874-ac87-2ea838ee0659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.314747 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 777/1545] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.319720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aee32-0129-4874-ac87-2ea838ee0659 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.334007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 769/1546] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:27.340539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aee32-0129-4874-ac87-2ea838ee0659 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:27.346832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e632a8e-6417-4e83-b8e6-9c6873655a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:27.347512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e632a8e-6417-4e83-b8e6-9c6873655a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.347702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a5a4e-e012-4a2f-b8b3-1f7a717c6dec admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.347812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e632a8e-6417-4e83-b8e6-9c6873655a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.348049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e632a8e-6417-4e83-b8e6-9c6873655a60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.348707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e632a8e-6417-4e83-b8e6-9c6873655a60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:27.349014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e632a8e-6417-4e83-b8e6-9c6873655a60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:27.350021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: WARNING py.warnings [None req-3e632a8e-6417-4e83-b8e6-9c6873655a60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:08:27.350021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: warnings.warn(msg) Sep 14 12:08:27.350021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: Sep 14 12:08:27.350945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e632a8e-6417-4e83-b8e6-9c6873655a60 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.368532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a5a4e-e012-4a2f-b8b3-1f7a717c6dec admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:27.371496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 778/1547] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:08:27.372843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6ee6-fd1c-4006-a57b-2c1c7b02ba2b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.373131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6ee6-fd1c-4006-a57b-2c1c7b02ba2b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.373405 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6ee6-fd1c-4006-a57b-2c1c7b02ba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.373856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffe751-f5cf-444d-bbe5-74cc1f168e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:27.374502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffe751-f5cf-444d-bbe5-74cc1f168e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.374784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffe751-f5cf-444d-bbe5-74cc1f168e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.375058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffe751-f5cf-444d-bbe5-74cc1f168e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.375708 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffe751-f5cf-444d-bbe5-74cc1f168e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:27.377499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffe751-f5cf-444d-bbe5-74cc1f168e8b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.388856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 770/1548] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:27.390258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738347ce-f524-4ad1-89df-f3c0e2cea7a2 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.390550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738347ce-f524-4ad1-89df-f3c0e2cea7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.390827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738347ce-f524-4ad1-89df-f3c0e2cea7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.404370 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f28c6ee6-fd1c-4006-a57b-2c1c7b02ba2b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.405609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f28c6ee6-fd1c-4006-a57b-2c1c7b02ba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.421970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-738347ce-f524-4ad1-89df-f3c0e2cea7a2 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.433550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-738347ce-f524-4ad1-89df-f3c0e2cea7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.433693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 779/1549] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.433693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c6ee6-fd1c-4006-a57b-2c1c7b02ba2b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.441777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 771/1550] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.442464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738347ce-f524-4ad1-89df-f3c0e2cea7a2 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.448506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c6ee6-fd1c-4006-a57b-2c1c7b02ba2b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:27.454104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738347ce-f524-4ad1-89df-f3c0e2cea7a2 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:27.459245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed673e4-8ba1-4bc7-95e1-b79ef43f4298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:27.460115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed673e4-8ba1-4bc7-95e1-b79ef43f4298 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.460401 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed673e4-8ba1-4bc7-95e1-b79ef43f4298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.460703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed673e4-8ba1-4bc7-95e1-b79ef43f4298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.461365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed673e4-8ba1-4bc7-95e1-b79ef43f4298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:27.463003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed673e4-8ba1-4bc7-95e1-b79ef43f4298 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.470353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91cace-2fb0-4ee8-a2a9-eabad12c169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:27.470977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91cace-2fb0-4ee8-a2a9-eabad12c169f admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.471258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91cace-2fb0-4ee8-a2a9-eabad12c169f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.471529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91cace-2fb0-4ee8-a2a9-eabad12c169f admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.472173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91cace-2fb0-4ee8-a2a9-eabad12c169f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:27.473185 dv-cinder-844962-2-smb devstack@keystone.service[81557]: WARNING py.warnings [None req-be91cace-2fb0-4ee8-a2a9-eabad12c169f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:08:27.473185 dv-cinder-844962-2-smb devstack@keystone.service[81557]: warnings.warn(msg) Sep 14 12:08:27.473185 dv-cinder-844962-2-smb devstack@keystone.service[81557]: Sep 14 12:08:27.474722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91cace-2fb0-4ee8-a2a9-eabad12c169f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.490885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 780/1551] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:27.493058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115567-4dcc-456a-940b-a79a83ba7cf2 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.493550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115567-4dcc-456a-940b-a79a83ba7cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.494156 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115567-4dcc-456a-940b-a79a83ba7cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.522393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c0115567-4dcc-456a-940b-a79a83ba7cf2 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.522393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c0115567-4dcc-456a-940b-a79a83ba7cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.531733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 781/1552] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.533187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2a7c3-68dd-41ca-9209-5aae2bdc8497 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.533480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2a7c3-68dd-41ca-9209-5aae2bdc8497 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.533758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2a7c3-68dd-41ca-9209-5aae2bdc8497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.553758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-03d2a7c3-68dd-41ca-9209-5aae2bdc8497 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.555913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-03d2a7c3-68dd-41ca-9209-5aae2bdc8497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.566604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 782/1553] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.567852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95ef6-8cbe-4f7c-955b-2c2a0bed8b27 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.568134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95ef6-8cbe-4f7c-955b-2c2a0bed8b27 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.568527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95ef6-8cbe-4f7c-955b-2c2a0bed8b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.582420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 772/1554] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:27.582420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc60e5-8e7a-4b74-bfe8-42fefc08d639 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.582420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc60e5-8e7a-4b74-bfe8-42fefc08d639 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.582420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc60e5-8e7a-4b74-bfe8-42fefc08d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.591994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-07c95ef6-8cbe-4f7c-955b-2c2a0bed8b27 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.591994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-07c95ef6-8cbe-4f7c-955b-2c2a0bed8b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.605700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-80dc60e5-8e7a-4b74-bfe8-42fefc08d639 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.607064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-80dc60e5-8e7a-4b74-bfe8-42fefc08d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.653643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 783/1555] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.654499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c95ef6-8cbe-4f7c-955b-2c2a0bed8b27 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.663525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c95ef6-8cbe-4f7c-955b-2c2a0bed8b27 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:27.668993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde69ab5-49ad-4c4c-bb04-12a7494716ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:27.669664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69ab5-49ad-4c4c-bb04-12a7494716ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.669941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69ab5-49ad-4c4c-bb04-12a7494716ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.670234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69ab5-49ad-4c4c-bb04-12a7494716ed admin admin] PATH_INFO: `/v3/projects/20461a50392347dea913bc8048a6b7e1/users/8f24308cb04a4229b770e58d6e7a832f/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.672632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 773/1556] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.673948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db258c-e81d-4180-ae08-50c36dc678ff None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.674442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db258c-e81d-4180-ae08-50c36dc678ff None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.674586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db258c-e81d-4180-ae08-50c36dc678ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.687179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde69ab5-49ad-4c4c-bb04-12a7494716ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=20461a50392347dea913bc8048a6b7e1, user_id=8f24308cb04a4229b770e58d6e7a832f, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:27.689850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde69ab5-49ad-4c4c-bb04-12a7494716ed admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.695399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-47db258c-e81d-4180-ae08-50c36dc678ff None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.696594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-47db258c-e81d-4180-ae08-50c36dc678ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.704270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 774/1557] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.711798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4477a-3724-4633-80bd-be23b05c04dd None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.711798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4477a-3724-4633-80bd-be23b05c04dd None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.711798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4477a-3724-4633-80bd-be23b05c04dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.725144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-05e4477a-3724-4633-80bd-be23b05c04dd None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.726890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-05e4477a-3724-4633-80bd-be23b05c04dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.734473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 775/1558] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.735742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77c9e9-ce11-4ee3-b238-8b94a30764b1 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.736021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77c9e9-ce11-4ee3-b238-8b94a30764b1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.736290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77c9e9-ce11-4ee3-b238-8b94a30764b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.755372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-cf77c9e9-ce11-4ee3-b238-8b94a30764b1 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.756535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-cf77c9e9-ce11-4ee3-b238-8b94a30764b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.764973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 776/1559] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.765870 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77c9e9-ce11-4ee3-b238-8b94a30764b1 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.775641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77c9e9-ce11-4ee3-b238-8b94a30764b1 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:27.780064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8d237-e5cd-4956-bcee-f3f77518f111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:27.780644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8d237-e5cd-4956-bcee-f3f77518f111 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.785427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8d237-e5cd-4956-bcee-f3f77518f111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.785427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8d237-e5cd-4956-bcee-f3f77518f111 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.785427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8d237-e5cd-4956-bcee-f3f77518f111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:27.785427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8d237-e5cd-4956-bcee-f3f77518f111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:27.785427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8d237-e5cd-4956-bcee-f3f77518f111 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.790564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:27.795548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 777/1560] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:27.796460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8d237-e5cd-4956-bcee-f3f77518f111 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.805932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8d237-e5cd-4956-bcee-f3f77518f111 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:27.810689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab37aad-04cd-4805-9ae3-684eb0a09396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:27.811577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab37aad-04cd-4805-9ae3-684eb0a09396 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.811854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab37aad-04cd-4805-9ae3-684eb0a09396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.812126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab37aad-04cd-4805-9ae3-684eb0a09396 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.812752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab37aad-04cd-4805-9ae3-684eb0a09396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:27.814694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab37aad-04cd-4805-9ae3-684eb0a09396 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.825830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 784/1561] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:27 2022] PUT /identity/v3/projects/20461a50392347dea913bc8048a6b7e1/users/8f24308cb04a4229b770e58d6e7a832f/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:27.831478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde69ab5-49ad-4c4c-bb04-12a7494716ed admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.877239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:27.889084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde69ab5-49ad-4c4c-bb04-12a7494716ed admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:27.893775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3510f9-36ea-4be5-9ea3-22eed59794e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:27.894457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3510f9-36ea-4be5-9ea3-22eed59794e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.894732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3510f9-36ea-4be5-9ea3-22eed59794e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.895002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3510f9-36ea-4be5-9ea3-22eed59794e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.895642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3510f9-36ea-4be5-9ea3-22eed59794e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:27.895983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3510f9-36ea-4be5-9ea3-22eed59794e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:27.897563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3510f9-36ea-4be5-9ea3-22eed59794e2 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.909082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 785/1562] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:27.910164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295ad77-6e0e-4d13-80ba-89855ea47944 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.910503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295ad77-6e0e-4d13-80ba-89855ea47944 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.910773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295ad77-6e0e-4d13-80ba-89855ea47944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.926074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 778/1563] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:27.926312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28b27e-a8dd-4e64-a37b-32316788660d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.932887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28b27e-a8dd-4e64-a37b-32316788660d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.932887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28b27e-a8dd-4e64-a37b-32316788660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.934931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-a295ad77-6e0e-4d13-80ba-89855ea47944 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.936393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a295ad77-6e0e-4d13-80ba-89855ea47944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.944465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 786/1564] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.945333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295ad77-6e0e-4d13-80ba-89855ea47944 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.946890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-cd28b27e-a8dd-4e64-a37b-32316788660d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.948072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-cd28b27e-a8dd-4e64-a37b-32316788660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.956979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 779/1565] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.957977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295ad77-6e0e-4d13-80ba-89855ea47944 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:27.958273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443cc40-2cf4-49bb-a74b-9b2187171713 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.958558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443cc40-2cf4-49bb-a74b-9b2187171713 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.958829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443cc40-2cf4-49bb-a74b-9b2187171713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.964316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a403c-446c-4f4c-9f5e-1bbd2f72f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:27.972395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a403c-446c-4f4c-9f5e-1bbd2f72f1be admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.972395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a403c-446c-4f4c-9f5e-1bbd2f72f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.972395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a403c-446c-4f4c-9f5e-1bbd2f72f1be admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.972395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a403c-446c-4f4c-9f5e-1bbd2f72f1be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:27.972395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a403c-446c-4f4c-9f5e-1bbd2f72f1be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:27.972395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a403c-446c-4f4c-9f5e-1bbd2f72f1be admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:27.978873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-d443cc40-2cf4-49bb-a74b-9b2187171713 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:27.980074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d443cc40-2cf4-49bb-a74b-9b2187171713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:27.981217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 787/1566] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:27.981898 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a403c-446c-4f4c-9f5e-1bbd2f72f1be admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:27.993390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 780/1567] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:27.994794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff0f52-75a5-48c5-852c-56ed1c2f48e2 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:27.995077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff0f52-75a5-48c5-852c-56ed1c2f48e2 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:27.995343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff0f52-75a5-48c5-852c-56ed1c2f48e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:27.999398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a403c-446c-4f4c-9f5e-1bbd2f72f1be admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.004000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d7bb6-8201-40d4-876f-0f0cca347ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.004599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7bb6-8201-40d4-876f-0f0cca347ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.004873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7bb6-8201-40d4-876f-0f0cca347ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.005142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d7bb6-8201-40d4-876f-0f0cca347ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.005767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d7bb6-8201-40d4-876f-0f0cca347ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.007955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d7bb6-8201-40d4-876f-0f0cca347ebe admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.014364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-78ff0f52-75a5-48c5-852c-56ed1c2f48e2 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:28.015556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-78ff0f52-75a5-48c5-852c-56ed1c2f48e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:28.023712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 781/1568] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:28.024462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff0f52-75a5-48c5-852c-56ed1c2f48e2 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.034069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff0f52-75a5-48c5-852c-56ed1c2f48e2 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.038710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527ac31-731f-404d-82e1-19a30966870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.040340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527ac31-731f-404d-82e1-19a30966870c admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.040620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527ac31-731f-404d-82e1-19a30966870c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.040888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527ac31-731f-404d-82e1-19a30966870c admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.041516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527ac31-731f-404d-82e1-19a30966870c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.043425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527ac31-731f-404d-82e1-19a30966870c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.157455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 782/1569] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:28 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:28.157677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 788/1570] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:27 2022] POST /identity/v3/projects => generated 405 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:28.157922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527ac31-731f-404d-82e1-19a30966870c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.158037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d7bb6-8201-40d4-876f-0f0cca347ebe admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.221028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d7bb6-8201-40d4-876f-0f0cca347ebe admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.221397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527ac31-731f-404d-82e1-19a30966870c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.225630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcae3b-9323-48e6-9403-31201663e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.225893 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a4303-ad9d-4dfa-9073-5831bc8cc612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.226905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcae3b-9323-48e6-9403-31201663e54f admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.227119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a4303-ad9d-4dfa-9073-5831bc8cc612 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.227397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a4303-ad9d-4dfa-9073-5831bc8cc612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.227613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcae3b-9323-48e6-9403-31201663e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.227737 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a4303-ad9d-4dfa-9073-5831bc8cc612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.227958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcae3b-9323-48e6-9403-31201663e54f admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.228430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a4303-ad9d-4dfa-9073-5831bc8cc612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.228607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcae3b-9323-48e6-9403-31201663e54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:28.228913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcae3b-9323-48e6-9403-31201663e54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.230018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a4303-ad9d-4dfa-9073-5831bc8cc612 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.230512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcae3b-9323-48e6-9403-31201663e54f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.240405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 783/1571] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:28.240964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a4303-ad9d-4dfa-9073-5831bc8cc612 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.251311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 789/1572] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:28.251311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcae3b-9323-48e6-9403-31201663e54f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.251608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a4303-ad9d-4dfa-9073-5831bc8cc612 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.256158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce3871-7f0e-4ec7-aee6-529ee7ec0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.256516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcae3b-9323-48e6-9403-31201663e54f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.256739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce3871-7f0e-4ec7-aee6-529ee7ec0122 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.257016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce3871-7f0e-4ec7-aee6-529ee7ec0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.257286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce3871-7f0e-4ec7-aee6-529ee7ec0122 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.258621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce3871-7f0e-4ec7-aee6-529ee7ec0122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:28.258920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce3871-7f0e-4ec7-aee6-529ee7ec0122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.260561 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce3871-7f0e-4ec7-aee6-529ee7ec0122 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.262118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf85c8-20a9-422e-b679-09c2b4955a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.262775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf85c8-20a9-422e-b679-09c2b4955a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.263531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf85c8-20a9-422e-b679-09c2b4955a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.263810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf85c8-20a9-422e-b679-09c2b4955a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.264438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf85c8-20a9-422e-b679-09c2b4955a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.266365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf85c8-20a9-422e-b679-09c2b4955a6e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.278599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 784/1573] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:28.278599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce3871-7f0e-4ec7-aee6-529ee7ec0122 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.287253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce3871-7f0e-4ec7-aee6-529ee7ec0122 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.292055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef05e-bfe1-4fdb-a468-17600f830043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.303743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef05e-bfe1-4fdb-a468-17600f830043 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.303743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef05e-bfe1-4fdb-a468-17600f830043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.303743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef05e-bfe1-4fdb-a468-17600f830043 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.303743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ef05e-bfe1-4fdb-a468-17600f830043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:28.303743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ef05e-bfe1-4fdb-a468-17600f830043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.303743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ef05e-bfe1-4fdb-a468-17600f830043 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.308322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 785/1574] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:28.309286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef05e-bfe1-4fdb-a468-17600f830043 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.363331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef05e-bfe1-4fdb-a468-17600f830043 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.367550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8bc92-f177-4ad3-b4d0-402fdeef5a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.368155 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8bc92-f177-4ad3-b4d0-402fdeef5a4c service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.368436 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8bc92-f177-4ad3-b4d0-402fdeef5a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.368711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8bc92-f177-4ad3-b4d0-402fdeef5a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.373288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 790/1575] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:28 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:28.373288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf85c8-20a9-422e-b679-09c2b4955a6e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.381971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8bc92-f177-4ad3-b4d0-402fdeef5a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.382089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8bc92-f177-4ad3-b4d0-402fdeef5a4c service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.391522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 786/1576] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:28.392302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8bc92-f177-4ad3-b4d0-402fdeef5a4c service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.401167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8bc92-f177-4ad3-b4d0-402fdeef5a4c service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.410566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:28.439221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf85c8-20a9-422e-b679-09c2b4955a6e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.444355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d29c8-5602-4504-9bcd-291c1c0f02ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.445114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d29c8-5602-4504-9bcd-291c1c0f02ba admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.445397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d29c8-5602-4504-9bcd-291c1c0f02ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.445667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d29c8-5602-4504-9bcd-291c1c0f02ba admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.446325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d29c8-5602-4504-9bcd-291c1c0f02ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.447338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: WARNING py.warnings [None req-489d29c8-5602-4504-9bcd-291c1c0f02ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:08:28.447338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: warnings.warn(msg) Sep 14 12:08:28.447338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: Sep 14 12:08:28.448678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d29c8-5602-4504-9bcd-291c1c0f02ba admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.464661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f67a4e-d3f0-4dee-9f67-812dad911df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.465269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f67a4e-d3f0-4dee-9f67-812dad911df4 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.465549 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f67a4e-d3f0-4dee-9f67-812dad911df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.465822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f67a4e-d3f0-4dee-9f67-812dad911df4 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.466501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f67a4e-d3f0-4dee-9f67-812dad911df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.468429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f67a4e-d3f0-4dee-9f67-812dad911df4 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.570927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 791/1577] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:28 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:28.571859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d29c8-5602-4504-9bcd-291c1c0f02ba admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.572507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 787/1578] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:28 2022] POST /identity/v3/users => generated 303 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:28.576330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f67a4e-d3f0-4dee-9f67-812dad911df4 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.580756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:28.586065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d29c8-5602-4504-9bcd-291c1c0f02ba admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.587707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f67a4e-d3f0-4dee-9f67-812dad911df4 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.592821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204c04f-0f38-42bb-bbf6-5468d37cb3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.593554 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204c04f-0f38-42bb-bbf6-5468d37cb3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.598807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204c04f-0f38-42bb-bbf6-5468d37cb3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.598807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204c04f-0f38-42bb-bbf6-5468d37cb3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.598807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204c04f-0f38-42bb-bbf6-5468d37cb3e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.598807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204c04f-0f38-42bb-bbf6-5468d37cb3e3 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.599217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c00695-1554-45db-a310-93d03a15931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.599217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00695-1554-45db-a310-93d03a15931d admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.599646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00695-1554-45db-a310-93d03a15931d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.600219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00695-1554-45db-a310-93d03a15931d admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.601862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00695-1554-45db-a310-93d03a15931d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.604817 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00695-1554-45db-a310-93d03a15931d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.623398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 792/1579] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:28.624382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c00695-1554-45db-a310-93d03a15931d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.634786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c00695-1554-45db-a310-93d03a15931d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.639524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999a25b-d767-484c-bb5f-2f6cf16c2647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.640120 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999a25b-d767-484c-bb5f-2f6cf16c2647 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.640402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999a25b-d767-484c-bb5f-2f6cf16c2647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.640681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999a25b-d767-484c-bb5f-2f6cf16c2647 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.641316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999a25b-d767-484c-bb5f-2f6cf16c2647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.643269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999a25b-d767-484c-bb5f-2f6cf16c2647 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.737402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 788/1580] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:28 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:28.739019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204c04f-0f38-42bb-bbf6-5468d37cb3e3 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.796919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 793/1581] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:28 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:28.797831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999a25b-d767-484c-bb5f-2f6cf16c2647 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.805945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204c04f-0f38-42bb-bbf6-5468d37cb3e3 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.866407 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999a25b-d767-484c-bb5f-2f6cf16c2647 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.868278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f839228-e230-4b12-ba8b-e9d70b0a42dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.869027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839228-e230-4b12-ba8b-e9d70b0a42dd admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.869307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839228-e230-4b12-ba8b-e9d70b0a42dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.869578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839228-e230-4b12-ba8b-e9d70b0a42dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.870232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f839228-e230-4b12-ba8b-e9d70b0a42dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.871391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248e18-6738-423c-b37d-3b281c209bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.872003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248e18-6738-423c-b37d-3b281c209bff admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.872113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f839228-e230-4b12-ba8b-e9d70b0a42dd admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.872410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248e18-6738-423c-b37d-3b281c209bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.872694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248e18-6738-423c-b37d-3b281c209bff admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.873453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b248e18-6738-423c-b37d-3b281c209bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.875417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b248e18-6738-423c-b37d-3b281c209bff admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:28.971984 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 794/1582] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:28 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:28.971984 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248e18-6738-423c-b37d-3b281c209bff admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:28.981301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248e18-6738-423c-b37d-3b281c209bff admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:28.986138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f69efd-3c7d-487d-8361-b799e3d25ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:28.986852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69efd-3c7d-487d-8361-b799e3d25ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:28.987237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69efd-3c7d-487d-8361-b799e3d25ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:28.987578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69efd-3c7d-487d-8361-b799e3d25ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:28.988302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f69efd-3c7d-487d-8361-b799e3d25ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:28.990203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f69efd-3c7d-487d-8361-b799e3d25ff5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.005153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 795/1583] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:29.005153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f69efd-3c7d-487d-8361-b799e3d25ff5 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.009634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 789/1584] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:28 2022] POST /identity/v3/projects => generated 375 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:29.009634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f839228-e230-4b12-ba8b-e9d70b0a42dd admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.015758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f69efd-3c7d-487d-8361-b799e3d25ff5 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.030459 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:29.082274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5a65e-fced-413a-a496-35cec49e9090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.082933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5a65e-fced-413a-a496-35cec49e9090 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.083214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5a65e-fced-413a-a496-35cec49e9090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.083488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5a65e-fced-413a-a496-35cec49e9090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.084134 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f839228-e230-4b12-ba8b-e9d70b0a42dd admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.084258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5a65e-fced-413a-a496-35cec49e9090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.086351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5a65e-fced-413a-a496-35cec49e9090 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.090162 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c87a17-5fa3-40ac-b316-e656298958e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.097015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87a17-5fa3-40ac-b316-e656298958e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.097015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87a17-5fa3-40ac-b316-e656298958e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.097015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87a17-5fa3-40ac-b316-e656298958e8 admin admin] PATH_INFO: `/v3/projects/7c867d6108c0406498212383fc925335/users/0396f1e976584ba4b6bfeb4688c7f062/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.097306 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 796/1585] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:29.097306 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5a65e-fced-413a-a496-35cec49e9090 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.106250 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c87a17-5fa3-40ac-b316-e656298958e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c867d6108c0406498212383fc925335, user_id=0396f1e976584ba4b6bfeb4688c7f062, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.107300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: WARNING py.warnings [None req-96c87a17-5fa3-40ac-b316-e656298958e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:08:29.107300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: warnings.warn(msg) Sep 14 12:08:29.107300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: Sep 14 12:08:29.109106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5a65e-fced-413a-a496-35cec49e9090 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.109237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c87a17-5fa3-40ac-b316-e656298958e8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.113815 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a457-255a-424e-b784-5ef2e8f6a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.114435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a457-255a-424e-b784-5ef2e8f6a010 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.114720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a457-255a-424e-b784-5ef2e8f6a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.114999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a457-255a-424e-b784-5ef2e8f6a010 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.115623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64a457-255a-424e-b784-5ef2e8f6a010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.117812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64a457-255a-424e-b784-5ef2e8f6a010 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.214072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 790/1586] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:29 2022] PUT /identity/v3/projects/7c867d6108c0406498212383fc925335/users/0396f1e976584ba4b6bfeb4688c7f062/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:29.214961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c87a17-5fa3-40ac-b316-e656298958e8 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.228184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 797/1587] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:29 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:29.228920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a457-255a-424e-b784-5ef2e8f6a010 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.240179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a457-255a-424e-b784-5ef2e8f6a010 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.271374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:29.303338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c87a17-5fa3-40ac-b316-e656298958e8 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.304044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26e278-2ad6-4be7-b6ff-dd059ef2a69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.305455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e278-2ad6-4be7-b6ff-dd059ef2a69a admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.305835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e278-2ad6-4be7-b6ff-dd059ef2a69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.306113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e278-2ad6-4be7-b6ff-dd059ef2a69a admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.306867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26e278-2ad6-4be7-b6ff-dd059ef2a69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.309015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26e278-2ad6-4be7-b6ff-dd059ef2a69a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.312531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045da09-6337-4e06-8fed-24f47281c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.313161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045da09-6337-4e06-8fed-24f47281c2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.313442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045da09-6337-4e06-8fed-24f47281c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.313715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045da09-6337-4e06-8fed-24f47281c2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.314462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045da09-6337-4e06-8fed-24f47281c2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.316040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045da09-6337-4e06-8fed-24f47281c2c6 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.326775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 798/1588] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:29.327688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045da09-6337-4e06-8fed-24f47281c2c6 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.337770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045da09-6337-4e06-8fed-24f47281c2c6 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.342270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ae59f-8a19-4aae-919f-91a76f481513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.342886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ae59f-8a19-4aae-919f-91a76f481513 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.343163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ae59f-8a19-4aae-919f-91a76f481513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.343463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ae59f-8a19-4aae-919f-91a76f481513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.344098 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ae59f-8a19-4aae-919f-91a76f481513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.345645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ae59f-8a19-4aae-919f-91a76f481513 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.356903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 799/1589] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:29.357688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ae59f-8a19-4aae-919f-91a76f481513 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.371811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ae59f-8a19-4aae-919f-91a76f481513 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.376393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f9329-bbe1-4684-985c-bb37d0d8da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.376993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f9329-bbe1-4684-985c-bb37d0d8da2b admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.377269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f9329-bbe1-4684-985c-bb37d0d8da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.377558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f9329-bbe1-4684-985c-bb37d0d8da2b admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.378180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f9329-bbe1-4684-985c-bb37d0d8da2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.380110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f9329-bbe1-4684-985c-bb37d0d8da2b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.394679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 791/1590] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:29 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:29.394679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26e278-2ad6-4be7-b6ff-dd059ef2a69a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.405063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26e278-2ad6-4be7-b6ff-dd059ef2a69a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.409838 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6f06-f872-409a-8053-4bbe309965ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.411779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6f06-f872-409a-8053-4bbe309965ca admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.411779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6f06-f872-409a-8053-4bbe309965ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.411779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6f06-f872-409a-8053-4bbe309965ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.411779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6f06-f872-409a-8053-4bbe309965ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.415562 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6f06-f872-409a-8053-4bbe309965ca admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.426311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 792/1591] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:29.427645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86a232-4a34-4481-bf9d-bf9b143bfbb0 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.427933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86a232-4a34-4481-bf9d-bf9b143bfbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.428231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86a232-4a34-4481-bf9d-bf9b143bfbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.457190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-0d86a232-4a34-4481-bf9d-bf9b143bfbb0 None None] MFA Rules not processed for user `0396f1e976584ba4b6bfeb4688c7f062`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:29.459861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0d86a232-4a34-4481-bf9d-bf9b143bfbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:29.490591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 800/1592] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:29 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:29.490591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f9329-bbe1-4684-985c-bb37d0d8da2b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.498996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f9329-bbe1-4684-985c-bb37d0d8da2b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.503583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8d2c4-e5b1-4278-aee4-ae6c7bf674f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.504183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8d2c4-e5b1-4278-aee4-ae6c7bf674f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.504464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8d2c4-e5b1-4278-aee4-ae6c7bf674f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.504739 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8d2c4-e5b1-4278-aee4-ae6c7bf674f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.505382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8d2c4-e5b1-4278-aee4-ae6c7bf674f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.506993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8d2c4-e5b1-4278-aee4-ae6c7bf674f4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.517053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 801/1593] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:29.517858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8d2c4-e5b1-4278-aee4-ae6c7bf674f4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.525178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 793/1594] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:29.528606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86a232-4a34-4481-bf9d-bf9b143bfbb0 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.528889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8d2c4-e5b1-4278-aee4-ae6c7bf674f4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.531732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:29.533577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be9bc0-1822-4d0e-a7d4-6cbb9618926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.534343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be9bc0-1822-4d0e-a7d4-6cbb9618926c admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.534625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be9bc0-1822-4d0e-a7d4-6cbb9618926c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.534901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be9bc0-1822-4d0e-a7d4-6cbb9618926c admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.535547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be9bc0-1822-4d0e-a7d4-6cbb9618926c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.537134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be9bc0-1822-4d0e-a7d4-6cbb9618926c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.539664 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86a232-4a34-4481-bf9d-bf9b143bfbb0 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.544700 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d97c11-ad6e-4e3c-ad1d-6bb7c2096644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.545348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d97c11-ad6e-4e3c-ad1d-6bb7c2096644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.545624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d97c11-ad6e-4e3c-ad1d-6bb7c2096644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.545893 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d97c11-ad6e-4e3c-ad1d-6bb7c2096644 admin admin] PATH_INFO: `/v3/projects/00c8fe2cfc344e3eab3daad48c0a47e8/users/72fc1d9c3133459cb3b2af391baacc97/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.549485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 802/1595] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:29.549820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be9bc0-1822-4d0e-a7d4-6cbb9618926c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.559903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be9bc0-1822-4d0e-a7d4-6cbb9618926c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.561592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d97c11-ad6e-4e3c-ad1d-6bb7c2096644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c8fe2cfc344e3eab3daad48c0a47e8, user_id=72fc1d9c3133459cb3b2af391baacc97, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.566887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d97c11-ad6e-4e3c-ad1d-6bb7c2096644 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.566999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa31ae-8e50-47a5-afaa-5535af7cdab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.566999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa31ae-8e50-47a5-afaa-5535af7cdab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.566999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa31ae-8e50-47a5-afaa-5535af7cdab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.566999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa31ae-8e50-47a5-afaa-5535af7cdab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.567981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa31ae-8e50-47a5-afaa-5535af7cdab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.569763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa31ae-8e50-47a5-afaa-5535af7cdab3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.580342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 803/1596] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:29.581119 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa31ae-8e50-47a5-afaa-5535af7cdab3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.591315 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa31ae-8e50-47a5-afaa-5535af7cdab3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.597567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b9e82-d1cc-4256-84df-3e9232ef5316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.597567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9e82-d1cc-4256-84df-3e9232ef5316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.597567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9e82-d1cc-4256-84df-3e9232ef5316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.597567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9e82-d1cc-4256-84df-3e9232ef5316 admin admin] PATH_INFO: `/v3/projects/17be41a20bda43dcacd7aab3a1246c54/users/76789b4d2a2248cebebd87818f3d1491/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.611960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b9e82-d1cc-4256-84df-3e9232ef5316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17be41a20bda43dcacd7aab3a1246c54, user_id=76789b4d2a2248cebebd87818f3d1491, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.614728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b9e82-d1cc-4256-84df-3e9232ef5316 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.676854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 794/1597] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:29 2022] PUT /identity/v3/projects/00c8fe2cfc344e3eab3daad48c0a47e8/users/72fc1d9c3133459cb3b2af391baacc97/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:29.676854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d97c11-ad6e-4e3c-ad1d-6bb7c2096644 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.703833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 804/1598] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:29 2022] PUT /identity/v3/projects/17be41a20bda43dcacd7aab3a1246c54/users/76789b4d2a2248cebebd87818f3d1491/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:29.709873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b9e82-d1cc-4256-84df-3e9232ef5316 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.763592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d97c11-ad6e-4e3c-ad1d-6bb7c2096644 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.774231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b9e82-d1cc-4256-84df-3e9232ef5316 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.779421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ae29-411d-4200-b502-3b1abd515e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.780195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ae29-411d-4200-b502-3b1abd515e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.781312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ae29-411d-4200-b502-3b1abd515e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.781934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ae29-411d-4200-b502-3b1abd515e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.782641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62ae29-411d-4200-b502-3b1abd515e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.785151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62ae29-411d-4200-b502-3b1abd515e96 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.798290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 805/1599] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:29.799217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ae29-411d-4200-b502-3b1abd515e96 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.813762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ae29-411d-4200-b502-3b1abd515e96 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.815988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aae9a-d074-4e61-8dbe-c7e619118d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.816669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aae9a-d074-4e61-8dbe-c7e619118d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.816919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aae9a-d074-4e61-8dbe-c7e619118d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.817198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aae9a-d074-4e61-8dbe-c7e619118d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.817976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aae9a-d074-4e61-8dbe-c7e619118d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.819915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aae9a-d074-4e61-8dbe-c7e619118d2b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.836083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68908938-d77b-40c9-ad66-ff3abfb74ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.844009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68908938-d77b-40c9-ad66-ff3abfb74ece admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.844009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68908938-d77b-40c9-ad66-ff3abfb74ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.844009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68908938-d77b-40c9-ad66-ff3abfb74ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.844009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68908938-d77b-40c9-ad66-ff3abfb74ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.844009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68908938-d77b-40c9-ad66-ff3abfb74ece admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.852769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 795/1600] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:29.853437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68908938-d77b-40c9-ad66-ff3abfb74ece admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.865538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68908938-d77b-40c9-ad66-ff3abfb74ece admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:29.871608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d37625-4c7f-41ba-b652-4b423e6c5b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:29.872570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d37625-4c7f-41ba-b652-4b423e6c5b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:29.872686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d37625-4c7f-41ba-b652-4b423e6c5b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:29.872878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d37625-4c7f-41ba-b652-4b423e6c5b3b admin admin] PATH_INFO: `/v3/projects/3df3c28aa5994fce86ca3df186232f3c/users/22a06dddf5ff41168826320561ad545c/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:29.890275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d37625-4c7f-41ba-b652-4b423e6c5b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df3c28aa5994fce86ca3df186232f3c, user_id=22a06dddf5ff41168826320561ad545c, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:29.892990 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d37625-4c7f-41ba-b652-4b423e6c5b3b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:29.939082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 806/1601] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:29 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:29.940569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aae9a-d074-4e61-8dbe-c7e619118d2b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:29.954708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:30.005867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aae9a-d074-4e61-8dbe-c7e619118d2b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:30.010725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649422d3-9743-443d-94c0-a8ac008c32ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:30.011340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649422d3-9743-443d-94c0-a8ac008c32ac admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.011830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649422d3-9743-443d-94c0-a8ac008c32ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.012109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649422d3-9743-443d-94c0-a8ac008c32ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.012778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649422d3-9743-443d-94c0-a8ac008c32ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:30.015378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649422d3-9743-443d-94c0-a8ac008c32ac admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:30.022078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 796/1602] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:29 2022] PUT /identity/v3/projects/3df3c28aa5994fce86ca3df186232f3c/users/22a06dddf5ff41168826320561ad545c/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:30.024680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7ddf-27f0-488f-a11e-97bd7b133888 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.025419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7ddf-27f0-488f-a11e-97bd7b133888 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.025863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7ddf-27f0-488f-a11e-97bd7b133888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.031696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 807/1603] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:30.031696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836cae6-825d-406e-822b-bddb00cc7e49 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.031696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836cae6-825d-406e-822b-bddb00cc7e49 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.031696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836cae6-825d-406e-822b-bddb00cc7e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.056505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-8836cae6-825d-406e-822b-bddb00cc7e49 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:30.057835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8836cae6-825d-406e-822b-bddb00cc7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:30.082918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ec5c7ddf-27f0-488f-a11e-97bd7b133888 None None] MFA Rules not processed for user `72fc1d9c3133459cb3b2af391baacc97`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:30.085417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ec5c7ddf-27f0-488f-a11e-97bd7b133888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:30.122325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 808/1604] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:30.123163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836cae6-825d-406e-822b-bddb00cc7e49 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:30.137218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836cae6-825d-406e-822b-bddb00cc7e49 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:30.141870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cee0c-a300-4a06-b8b3-8f0a079cc3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:30.142348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:30.142567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cee0c-a300-4a06-b8b3-8f0a079cc3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.142965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cee0c-a300-4a06-b8b3-8f0a079cc3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.143216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cee0c-a300-4a06-b8b3-8f0a079cc3ae admin admin] PATH_INFO: `/v3/projects/55904d87c35146e28a942d845d9db5c3/users/88c79e3d1b6e46d6aa15f5f6e2b5498e/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.158813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cee0c-a300-4a06-b8b3-8f0a079cc3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=55904d87c35146e28a942d845d9db5c3, user_id=88c79e3d1b6e46d6aa15f5f6e2b5498e, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:30.161484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cee0c-a300-4a06-b8b3-8f0a079cc3ae admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:30.162722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 797/1605] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:30.163347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7ddf-27f0-488f-a11e-97bd7b133888 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:30.173757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7ddf-27f0-488f-a11e-97bd7b133888 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:30.178462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adeddd-f1fc-48ae-be96-d46ef7f02b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:30.179071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adeddd-f1fc-48ae-be96-d46ef7f02b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.179434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adeddd-f1fc-48ae-be96-d46ef7f02b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.179889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adeddd-f1fc-48ae-be96-d46ef7f02b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.180802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adeddd-f1fc-48ae-be96-d46ef7f02b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:30.182045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adeddd-f1fc-48ae-be96-d46ef7f02b0e admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:30.194558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 798/1606] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:30.196817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adeddd-f1fc-48ae-be96-d46ef7f02b0e admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:30.208469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adeddd-f1fc-48ae-be96-d46ef7f02b0e admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:30.215049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaee05-eaed-46ac-b6e6-3b63c9e5c099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:30.217119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaee05-eaed-46ac-b6e6-3b63c9e5c099 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.217119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaee05-eaed-46ac-b6e6-3b63c9e5c099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.217119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaee05-eaed-46ac-b6e6-3b63c9e5c099 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.217119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaee05-eaed-46ac-b6e6-3b63c9e5c099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:30.218686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaee05-eaed-46ac-b6e6-3b63c9e5c099 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:30.276954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 809/1607] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:30 2022] PUT /identity/v3/projects/55904d87c35146e28a942d845d9db5c3/users/88c79e3d1b6e46d6aa15f5f6e2b5498e/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:30.284712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cee0c-a300-4a06-b8b3-8f0a079cc3ae admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:30.310225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 799/1608] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:30 2022] POST /identity/v3/users => generated 308 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:30.312360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addec0ee-ee6f-4c10-aa15-f2725f0e0fe2 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.313669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addec0ee-ee6f-4c10-aa15-f2725f0e0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.314524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addec0ee-ee6f-4c10-aa15-f2725f0e0fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.356107 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-addec0ee-ee6f-4c10-aa15-f2725f0e0fe2 None None] MFA Rules not processed for user `22a06dddf5ff41168826320561ad545c`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:30.357944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-addec0ee-ee6f-4c10-aa15-f2725f0e0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:30.368016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cee0c-a300-4a06-b8b3-8f0a079cc3ae admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:30.374747 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20289fbf-0519-45c1-8224-ebec504c4755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:30.375637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20289fbf-0519-45c1-8224-ebec504c4755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.376219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20289fbf-0519-45c1-8224-ebec504c4755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.376654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20289fbf-0519-45c1-8224-ebec504c4755 admin admin] PATH_INFO: `/v3/projects/daf5735dded8421289825afeab35746e/users/0939e2eb8df04dfa8f0d9f3789e8b6e7/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.403624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20289fbf-0519-45c1-8224-ebec504c4755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf5735dded8421289825afeab35746e, user_id=0939e2eb8df04dfa8f0d9f3789e8b6e7, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:30.408514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20289fbf-0519-45c1-8224-ebec504c4755 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:30.450036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 800/1609] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:30.451432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addec0ee-ee6f-4c10-aa15-f2725f0e0fe2 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:30.452935 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-addec0ee-ee6f-4c10-aa15-f2725f0e0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:30.517041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 810/1610] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:30 2022] PUT /identity/v3/projects/daf5735dded8421289825afeab35746e/users/0939e2eb8df04dfa8f0d9f3789e8b6e7/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:30.517041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423c7d0-d6b4-4c07-9c7a-72d6dce480b7 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.517041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423c7d0-d6b4-4c07-9c7a-72d6dce480b7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.517041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423c7d0-d6b4-4c07-9c7a-72d6dce480b7 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.517041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 811/1611] 10.222.0.77 () {54 vars in 962 bytes} [Wed Sep 14 12:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:08:30.517041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423c7d0-d6b4-4c07-9c7a-72d6dce480b7 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:30.530974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:30.543426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addec0ee-ee6f-4c10-aa15-f2725f0e0fe2 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:30.600868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423c7d0-d6b4-4c07-9c7a-72d6dce480b7 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:30.612718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ae8c1-0e61-4cb2-9e8b-6b46e49ecbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:30.614273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ae8c1-0e61-4cb2-9e8b-6b46e49ecbd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.614971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ae8c1-0e61-4cb2-9e8b-6b46e49ecbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.616418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ae8c1-0e61-4cb2-9e8b-6b46e49ecbd1 admin admin] PATH_INFO: `/v3/projects/d19b35c5d4e3437cabcfb2de67fbe6a2/users/912f4c5dd82a493ba2ea38244a6a8f9e/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.617748 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02372fbd-d5de-4890-ba51-056840c55d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:30.618483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02372fbd-d5de-4890-ba51-056840c55d71 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.620044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02372fbd-d5de-4890-ba51-056840c55d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.620401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02372fbd-d5de-4890-ba51-056840c55d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.638128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02372fbd-d5de-4890-ba51-056840c55d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:30.638463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ae8c1-0e61-4cb2-9e8b-6b46e49ecbd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19b35c5d4e3437cabcfb2de67fbe6a2, user_id=912f4c5dd82a493ba2ea38244a6a8f9e, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:30.640070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02372fbd-d5de-4890-ba51-056840c55d71 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:30.641418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ae8c1-0e61-4cb2-9e8b-6b46e49ecbd1 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:30.658075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 801/1612] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:30.658075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7273e-44d0-468c-aaea-0189f8d73792 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.658075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7273e-44d0-468c-aaea-0189f8d73792 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.658075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7273e-44d0-468c-aaea-0189f8d73792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.670357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:30.676592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-45a7273e-44d0-468c-aaea-0189f8d73792 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:30.677828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-45a7273e-44d0-468c-aaea-0189f8d73792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:30.686424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 802/1613] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:30.687178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7273e-44d0-468c-aaea-0189f8d73792 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:30.700536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7273e-44d0-468c-aaea-0189f8d73792 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:30.707272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e760665-3cf7-4b03-a933-2a794834e685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:30.708024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760665-3cf7-4b03-a933-2a794834e685 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.708302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760665-3cf7-4b03-a933-2a794834e685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.708577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760665-3cf7-4b03-a933-2a794834e685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.709264 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e760665-3cf7-4b03-a933-2a794834e685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:30.711143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e760665-3cf7-4b03-a933-2a794834e685 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:30.725352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 803/1614] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:30.725352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e760665-3cf7-4b03-a933-2a794834e685 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:30.755742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 812/1615] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:30 2022] PUT /identity/v3/projects/d19b35c5d4e3437cabcfb2de67fbe6a2/users/912f4c5dd82a493ba2ea38244a6a8f9e/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:30.759130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebebf1-ab7f-4b1d-92c9-b62ccb56b7f8 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.767182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebebf1-ab7f-4b1d-92c9-b62ccb56b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.767182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebebf1-ab7f-4b1d-92c9-b62ccb56b7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.807178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e760665-3cf7-4b03-a933-2a794834e685 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:30.914533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-8bebebf1-ab7f-4b1d-92c9-b62ccb56b7f8 None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:30.914533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8bebebf1-ab7f-4b1d-92c9-b62ccb56b7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:30.918775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f2f1f-f2aa-4846-a74c-774646ca9849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:30.918775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2f1f-f2aa-4846-a74c-774646ca9849 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.918775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2f1f-f2aa-4846-a74c-774646ca9849 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.918775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f2f1f-f2aa-4846-a74c-774646ca9849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.971043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 813/1616] 10.222.0.77 () {58 vars in 1059 bytes} [Wed Sep 14 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:30.980128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac295a-654a-40ba-bf2d-45517dae9894 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:30.980418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac295a-654a-40ba-bf2d-45517dae9894 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:30.980700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac295a-654a-40ba-bf2d-45517dae9894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:30.993799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f2f1f-f2aa-4846-a74c-774646ca9849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:30.995832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f2f1f-f2aa-4846-a74c-774646ca9849 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:31.008967 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 804/1617] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:31.009809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f2f1f-f2aa-4846-a74c-774646ca9849 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:31.031200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2dac295a-654a-40ba-bf2d-45517dae9894 None None] MFA Rules not processed for user `0939e2eb8df04dfa8f0d9f3789e8b6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:31.032479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2dac295a-654a-40ba-bf2d-45517dae9894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:31.082478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f2f1f-f2aa-4846-a74c-774646ca9849 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:31.086410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ec2ad-c73a-4f90-88b8-b2407d2113ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:31.087171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec2ad-c73a-4f90-88b8-b2407d2113ae service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:31.087456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec2ad-c73a-4f90-88b8-b2407d2113ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:31.087737 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec2ad-c73a-4f90-88b8-b2407d2113ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:31.102570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:31.146633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:31.157468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ec2ad-c73a-4f90-88b8-b2407d2113ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:31.157730 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 814/1618] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:31.159467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac295a-654a-40ba-bf2d-45517dae9894 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:31.159892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ec2ad-c73a-4f90-88b8-b2407d2113ae service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:31.181421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac295a-654a-40ba-bf2d-45517dae9894 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:31.186618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 805/1619] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:31.191529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463c776-ac8c-4611-909b-8e2858a5f58d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:31.191716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463c776-ac8c-4611-909b-8e2858a5f58d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:31.201271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463c776-ac8c-4611-909b-8e2858a5f58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:31.201374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676904-6470-4947-b379-ddfd2ada1226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:31.204831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676904-6470-4947-b379-ddfd2ada1226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:31.205271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676904-6470-4947-b379-ddfd2ada1226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:31.205722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676904-6470-4947-b379-ddfd2ada1226 admin admin] PATH_INFO: `/v3/projects/11a2de0bf4e14aeb8e98c881d6acc2d4/users/855628fba5334475b861ada413619f1f/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:31.228892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60676904-6470-4947-b379-ddfd2ada1226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a2de0bf4e14aeb8e98c881d6acc2d4, user_id=855628fba5334475b861ada413619f1f, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:31.231452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-7463c776-ac8c-4611-909b-8e2858a5f58d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:31.232211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60676904-6470-4947-b379-ddfd2ada1226 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:31.233479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7463c776-ac8c-4611-909b-8e2858a5f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:31.250412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 806/1620] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:31.250412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463c776-ac8c-4611-909b-8e2858a5f58d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:31.276490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463c776-ac8c-4611-909b-8e2858a5f58d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:31.283269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef20369-c64c-498b-aa73-e6f36e9b9c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:31.283889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef20369-c64c-498b-aa73-e6f36e9b9c26 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:31.284169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef20369-c64c-498b-aa73-e6f36e9b9c26 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:31.284440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef20369-c64c-498b-aa73-e6f36e9b9c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:31.352934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 815/1621] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:31 2022] PUT /identity/v3/projects/11a2de0bf4e14aeb8e98c881d6acc2d4/users/855628fba5334475b861ada413619f1f/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:31.353862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676904-6470-4947-b379-ddfd2ada1226 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:31.388365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef20369-c64c-498b-aa73-e6f36e9b9c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:31.390139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef20369-c64c-498b-aa73-e6f36e9b9c26 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:31.405004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 807/1622] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:31.406035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef20369-c64c-498b-aa73-e6f36e9b9c26 service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:31.422711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef20369-c64c-498b-aa73-e6f36e9b9c26 service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:31.463072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676904-6470-4947-b379-ddfd2ada1226 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:31.468721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6305ea-49c2-4988-8e1b-1693745baaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:31.469615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6305ea-49c2-4988-8e1b-1693745baaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:31.470065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6305ea-49c2-4988-8e1b-1693745baaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:31.470533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6305ea-49c2-4988-8e1b-1693745baaa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:31.471359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6305ea-49c2-4988-8e1b-1693745baaa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:31.474140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6305ea-49c2-4988-8e1b-1693745baaa3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:31.535095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e6b78-b769-4d20-986b-612441c59ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:31.535894 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e6b78-b769-4d20-986b-612441c59ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:31.536889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e6b78-b769-4d20-986b-612441c59ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:31.536889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e6b78-b769-4d20-986b-612441c59ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:31.552512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e6b78-b769-4d20-986b-612441c59ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:31.555076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e6b78-b769-4d20-986b-612441c59ba1 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:31.570368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 808/1623] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:31.571378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e6b78-b769-4d20-986b-612441c59ba1 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:31.587082 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e6b78-b769-4d20-986b-612441c59ba1 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:31.593365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 816/1624] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:31 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:31.597322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6305ea-49c2-4988-8e1b-1693745baaa3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:31.597464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb0e56-030e-45ef-935b-867147c2a3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:31.598783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb0e56-030e-45ef-935b-867147c2a3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:31.599078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb0e56-030e-45ef-935b-867147c2a3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:31.599356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb0e56-030e-45ef-935b-867147c2a3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:31.600015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb0e56-030e-45ef-935b-867147c2a3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:31.602035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb0e56-030e-45ef-935b-867147c2a3e5 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:31.619883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 809/1625] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:31.621423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb0e56-030e-45ef-935b-867147c2a3e5 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:31.636646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb0e56-030e-45ef-935b-867147c2a3e5 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:31.689671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:31.758843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3e842-3068-4385-a16b-676e165c32b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:31.759537 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3e842-3068-4385-a16b-676e165c32b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:31.759816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3e842-3068-4385-a16b-676e165c32b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:31.760088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3e842-3068-4385-a16b-676e165c32b2 admin admin] PATH_INFO: `/v3/projects/11a2de0bf4e14aeb8e98c881d6acc2d4/users/855628fba5334475b861ada413619f1f/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:31.765419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3e842-3068-4385-a16b-676e165c32b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a2de0bf4e14aeb8e98c881d6acc2d4, user_id=855628fba5334475b861ada413619f1f, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:31.765604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6305ea-49c2-4988-8e1b-1693745baaa3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:31.768493 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3e842-3068-4385-a16b-676e165c32b2 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:31.771420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d679b8e-db36-4968-8a33-f9d7e8d179da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:31.772351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679b8e-db36-4968-8a33-f9d7e8d179da admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:31.773684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679b8e-db36-4968-8a33-f9d7e8d179da admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:31.774385 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679b8e-db36-4968-8a33-f9d7e8d179da admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:31.776928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d679b8e-db36-4968-8a33-f9d7e8d179da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:31.778443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d679b8e-db36-4968-8a33-f9d7e8d179da admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:31.792922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 810/1626] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:31 2022] PUT /identity/v3/projects/11a2de0bf4e14aeb8e98c881d6acc2d4/users/855628fba5334475b861ada413619f1f/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:31.795260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53094-5324-4e83-b865-fb75fb10cf5e None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:31.795706 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53094-5324-4e83-b865-fb75fb10cf5e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:31.795980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53094-5324-4e83-b865-fb75fb10cf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.102718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c9d53094-5324-4e83-b865-fb75fb10cf5e None None] MFA Rules not processed for user `855628fba5334475b861ada413619f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:32.102718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c9d53094-5324-4e83-b865-fb75fb10cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:32.116942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 817/1627] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:31 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:08:32.116942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d679b8e-db36-4968-8a33-f9d7e8d179da admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:32.116942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d679b8e-db36-4968-8a33-f9d7e8d179da admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:32.123732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 811/1628] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:32.123732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53094-5324-4e83-b865-fb75fb10cf5e None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:32.125884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:32.125884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a0cb6-81ff-452e-a93e-4930084edb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:32.125884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0cb6-81ff-452e-a93e-4930084edb93 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:32.125884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0cb6-81ff-452e-a93e-4930084edb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:32.131102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0cb6-81ff-452e-a93e-4930084edb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.131102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a0cb6-81ff-452e-a93e-4930084edb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:32.131102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a0cb6-81ff-452e-a93e-4930084edb93 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:32.131102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 818/1629] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:08:32.131102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a0cb6-81ff-452e-a93e-4930084edb93 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:32.131102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a0cb6-81ff-452e-a93e-4930084edb93 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:32.145868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46b47f-998c-4e7a-994f-5fbb4f20b3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:32.149042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46b47f-998c-4e7a-994f-5fbb4f20b3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:32.149042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46b47f-998c-4e7a-994f-5fbb4f20b3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:32.149042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46b47f-998c-4e7a-994f-5fbb4f20b3ac admin admin] PATH_INFO: `/v3/projects/0f6b9b19610441b7895eab39fc66f453/users/ef6a61bdb1484ed382db298f82f7cc49/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.169777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46b47f-998c-4e7a-994f-5fbb4f20b3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6b9b19610441b7895eab39fc66f453, user_id=ef6a61bdb1484ed382db298f82f7cc49, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:32.172921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46b47f-998c-4e7a-994f-5fbb4f20b3ac admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:32.215200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53094-5324-4e83-b865-fb75fb10cf5e None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:32.221143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bad14b-4f7f-4cd0-9fba-0e252d8d1681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:32.221143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bad14b-4f7f-4cd0-9fba-0e252d8d1681 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:32.221455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bad14b-4f7f-4cd0-9fba-0e252d8d1681 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:32.221535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bad14b-4f7f-4cd0-9fba-0e252d8d1681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.233512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bad14b-4f7f-4cd0-9fba-0e252d8d1681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:32.235177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bad14b-4f7f-4cd0-9fba-0e252d8d1681 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:32.276270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 812/1630] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:32.321669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 819/1631] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:32 2022] PUT /identity/v3/projects/0f6b9b19610441b7895eab39fc66f453/users/ef6a61bdb1484ed382db298f82f7cc49/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:32.325212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bad14b-4f7f-4cd0-9fba-0e252d8d1681 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:32.363809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bad14b-4f7f-4cd0-9fba-0e252d8d1681 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:32.391330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d293-2a0b-4f53-8495-fe7878fd98b5 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:32.391576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d293-2a0b-4f53-8495-fe7878fd98b5 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:32.391863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d293-2a0b-4f53-8495-fe7878fd98b5 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.406584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 820/1632] 10.222.0.77 () {54 vars in 962 bytes} [Wed Sep 14 12:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:08:32.431600 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa22db-cb40-4adc-9b50-3a266a949aa0 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:32.431887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa22db-cb40-4adc-9b50-3a266a949aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:32.432169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa22db-cb40-4adc-9b50-3a266a949aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.471752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-97fa22db-cb40-4adc-9b50-3a266a949aa0 None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:32.473144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-97fa22db-cb40-4adc-9b50-3a266a949aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:32.531524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:32.552574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f27e4-4a03-4900-8940-3d4b88eba171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:32.555697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f27e4-4a03-4900-8940-3d4b88eba171 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:32.556295 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f27e4-4a03-4900-8940-3d4b88eba171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:32.556713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f27e4-4a03-4900-8940-3d4b88eba171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.557832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f27e4-4a03-4900-8940-3d4b88eba171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:32.573020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f27e4-4a03-4900-8940-3d4b88eba171 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:32.605990 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 813/1633] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:32.605990 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f27e4-4a03-4900-8940-3d4b88eba171 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:32.625339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f27e4-4a03-4900-8940-3d4b88eba171 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:32.637195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f7c8b-3701-48f8-a0ca-51beb54d1bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:32.638768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7c8b-3701-48f8-a0ca-51beb54d1bad admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:32.639138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7c8b-3701-48f8-a0ca-51beb54d1bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:32.639508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7c8b-3701-48f8-a0ca-51beb54d1bad admin admin] PATH_INFO: `/v3/projects/0f6b9b19610441b7895eab39fc66f453/users/ef6a61bdb1484ed382db298f82f7cc49/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.655482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f7c8b-3701-48f8-a0ca-51beb54d1bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6b9b19610441b7895eab39fc66f453, user_id=ef6a61bdb1484ed382db298f82f7cc49, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:32.655482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f7c8b-3701-48f8-a0ca-51beb54d1bad admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:32.674471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 814/1634] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:32 2022] PUT /identity/v3/projects/0f6b9b19610441b7895eab39fc66f453/users/ef6a61bdb1484ed382db298f82f7cc49/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:32.674471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f7c8b-3701-48f8-a0ca-51beb54d1bad admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:32.692731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 821/1635] 10.222.0.77 () {58 vars in 1059 bytes} [Wed Sep 14 12:08:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:08:32.694486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b64d0-11c3-4ea4-957f-4620f6491660 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:32.694826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b64d0-11c3-4ea4-957f-4620f6491660 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:32.696230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b64d0-11c3-4ea4-957f-4620f6491660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.784728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f7c8b-3701-48f8-a0ca-51beb54d1bad admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:32.785081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-1f0b64d0-11c3-4ea4-957f-4620f6491660 None None] MFA Rules not processed for user `ef6a61bdb1484ed382db298f82f7cc49`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:32.786809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1f0b64d0-11c3-4ea4-957f-4620f6491660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:32.819176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:32.820261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:32.821799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:32.823186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] PATH_INFO: `/v3/users/0396f1e976584ba4b6bfeb4688c7f062` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.834413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0396f1e976584ba4b6bfeb4688c7f062)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:32.836133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: WARNING py.warnings [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:08:32.836133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: warnings.warn(msg) Sep 14 12:08:32.836133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: Sep 14 12:08:32.837126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:32.937341 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 822/1636] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:32.939071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bf509-250d-458b-9ed0-08d683059a53 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:32.939624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bf509-250d-458b-9ed0-08d683059a53 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:32.940143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bf509-250d-458b-9ed0-08d683059a53 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:32.954935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 823/1637] 10.222.0.77 () {54 vars in 912 bytes} [Wed Sep 14 12:08:32 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:08:32.955877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bf509-250d-458b-9ed0-08d683059a53 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:33.060582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bf509-250d-458b-9ed0-08d683059a53 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:33.065441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122c855-29a6-4374-aa5f-7acb4985154a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:33.067061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122c855-29a6-4374-aa5f-7acb4985154a service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:33.067336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122c855-29a6-4374-aa5f-7acb4985154a service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:33.067613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122c855-29a6-4374-aa5f-7acb4985154a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:33.081034 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122c855-29a6-4374-aa5f-7acb4985154a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:33.082834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122c855-29a6-4374-aa5f-7acb4985154a service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:33.096776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 824/1638] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:33.098688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86543bee-2d85-4bcb-8a3a-34028a08d376 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:33.099246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86543bee-2d85-4bcb-8a3a-34028a08d376 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:33.099530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86543bee-2d85-4bcb-8a3a-34028a08d376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:33.144190 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-86543bee-2d85-4bcb-8a3a-34028a08d376 None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:33.159659 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-86543bee-2d85-4bcb-8a3a-34028a08d376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:33.235858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0396f1e976584ba4b6bfeb4688c7f062'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:33.265203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0396f1e976584ba4b6bfeb4688c7f062'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:33.321088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0396f1e976584ba4b6bfeb4688c7f062'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:33.341901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 825/1639] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:33.345394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86543bee-2d85-4bcb-8a3a-34028a08d376 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:33.374519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86543bee-2d85-4bcb-8a3a-34028a08d376 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:33.378606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2044f9c-1d38-41b6-a754-5b9d8f1bea3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:33.379242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2044f9c-1d38-41b6-a754-5b9d8f1bea3a service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:33.379526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2044f9c-1d38-41b6-a754-5b9d8f1bea3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:33.379804 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2044f9c-1d38-41b6-a754-5b9d8f1bea3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:33.402055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0396f1e976584ba4b6bfeb4688c7f062'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:33.402732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-738a7548-8b88-47c9-8c76-f03a972f90a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0396f1e976584ba4b6bfeb4688c7f062'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:33.403783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2044f9c-1d38-41b6-a754-5b9d8f1bea3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:33.405248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2044f9c-1d38-41b6-a754-5b9d8f1bea3a service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:33.411081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 815/1640] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:32 2022] DELETE /identity/v3/users/0396f1e976584ba4b6bfeb4688c7f062 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:33.416839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdf9ec-a99b-4568-86a4-8e5fc93a1f3d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:33.417959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdf9ec-a99b-4568-86a4-8e5fc93a1f3d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:33.418467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdf9ec-a99b-4568-86a4-8e5fc93a1f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:33.444433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 826/1641] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:33.455665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2044f9c-1d38-41b6-a754-5b9d8f1bea3a service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:33.458800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b8bdf9ec-a99b-4568-86a4-8e5fc93a1f3d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:33.460291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b8bdf9ec-a99b-4568-86a4-8e5fc93a1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:33.467510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2044f9c-1d38-41b6-a754-5b9d8f1bea3a service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:33.510880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:33.574799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da37fb9-74a6-4e5f-a5ef-3751049e4bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:33.575459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da37fb9-74a6-4e5f-a5ef-3751049e4bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:33.575746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da37fb9-74a6-4e5f-a5ef-3751049e4bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:33.576028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da37fb9-74a6-4e5f-a5ef-3751049e4bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:33.583129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2da37fb9-74a6-4e5f-a5ef-3751049e4bd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:33.599678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 816/1642] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:33.704606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdf9ec-a99b-4568-86a4-8e5fc93a1f3d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:33.706846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b8bdf9ec-a99b-4568-86a4-8e5fc93a1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:33.801969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da37fb9-74a6-4e5f-a5ef-3751049e4bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:33.803675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da37fb9-74a6-4e5f-a5ef-3751049e4bd2 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:33.826044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdf9ec-a99b-4568-86a4-8e5fc93a1f3d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:33.831244 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf5443-aa7a-408e-a005-986f701d6996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:33.832085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf5443-aa7a-408e-a005-986f701d6996 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:33.832952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf5443-aa7a-408e-a005-986f701d6996 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:33.832952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf5443-aa7a-408e-a005-986f701d6996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:33.835062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 827/1643] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:33.838888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b823-4a9e-4c6a-a142-0964434b44d9 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:33.839376 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b823-4a9e-4c6a-a142-0964434b44d9 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:33.841562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b823-4a9e-4c6a-a142-0964434b44d9 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:33.843047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 828/1644] 10.222.0.77 () {54 vars in 912 bytes} [Wed Sep 14 12:08:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:08:33.850904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf5443-aa7a-408e-a005-986f701d6996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:33.852499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb03ee-4540-4bed-a0e9-76f21a0c4800 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:33.852996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb03ee-4540-4bed-a0e9-76f21a0c4800 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:33.853267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb03ee-4540-4bed-a0e9-76f21a0c4800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:33.853919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf5443-aa7a-408e-a005-986f701d6996 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:33.866805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 817/1645] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:08:33.887064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e4cb03ee-4540-4bed-a0e9-76f21a0c4800 None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:33.889051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e4cb03ee-4540-4bed-a0e9-76f21a0c4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:33.968492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 829/1646] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:33.985831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf5443-aa7a-408e-a005-986f701d6996 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:33.987642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-cdcf5443-aa7a-408e-a005-986f701d6996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:33.999882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:34.009715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf5443-aa7a-408e-a005-986f701d6996 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:34.014238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee4fec-93ed-4973-b585-bc24de79a937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:34.015084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee4fec-93ed-4973-b585-bc24de79a937 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:34.015640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee4fec-93ed-4973-b585-bc24de79a937 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:34.016314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee4fec-93ed-4973-b585-bc24de79a937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:34.034171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee4fec-93ed-4973-b585-bc24de79a937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:34.036610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee4fec-93ed-4973-b585-bc24de79a937 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:34.051420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 818/1647] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:34.109458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d42898-1a7f-4549-bb24-3b9bc6feaf79 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:34.109458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d42898-1a7f-4549-bb24-3b9bc6feaf79 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:34.109458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d42898-1a7f-4549-bb24-3b9bc6feaf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:34.187538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-a1d42898-1a7f-4549-bb24-3b9bc6feaf79 None None] MFA Rules not processed for user `76789b4d2a2248cebebd87818f3d1491`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:34.187538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a1d42898-1a7f-4549-bb24-3b9bc6feaf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:34.189262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee4fec-93ed-4973-b585-bc24de79a937 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:34.189800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-eaee4fec-93ed-4973-b585-bc24de79a937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:34.209331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee4fec-93ed-4973-b585-bc24de79a937 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:34.219553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:34.220341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:34.220697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:34.221048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] PATH_INFO: `/v3/users/72fc1d9c3133459cb3b2af391baacc97` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:34.222314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72fc1d9c3133459cb3b2af391baacc97)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:34.224411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:34.297789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 830/1648] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:34 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:34.299463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d42898-1a7f-4549-bb24-3b9bc6feaf79 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:34.301402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a1d42898-1a7f-4549-bb24-3b9bc6feaf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:34.328466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d42898-1a7f-4549-bb24-3b9bc6feaf79 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:34.336778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced97e5-eca9-4e0b-a03c-e87861c3ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:34.337677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced97e5-eca9-4e0b-a03c-e87861c3ae7b admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:34.338066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced97e5-eca9-4e0b-a03c-e87861c3ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:34.338525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced97e5-eca9-4e0b-a03c-e87861c3ae7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:34.339233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced97e5-eca9-4e0b-a03c-e87861c3ae7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:34.342285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced97e5-eca9-4e0b-a03c-e87861c3ae7b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:34.515668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 831/1649] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:34 2022] POST /identity/v3/projects => generated 405 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:34.520910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced97e5-eca9-4e0b-a03c-e87861c3ae7b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:34.527536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72fc1d9c3133459cb3b2af391baacc97'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:34.541174 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72fc1d9c3133459cb3b2af391baacc97'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:34.574697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72fc1d9c3133459cb3b2af391baacc97'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:34.672290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72fc1d9c3133459cb3b2af391baacc97'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:34.673049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9bac654f-7519-4489-99e6-85c86660a40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72fc1d9c3133459cb3b2af391baacc97'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:34.680116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 819/1650] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:34 2022] DELETE /identity/v3/users/72fc1d9c3133459cb3b2af391baacc97 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:34.684672 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cebc49-bb40-4c4f-9dae-c24000ccd117 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:34.684991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cebc49-bb40-4c4f-9dae-c24000ccd117 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:34.685157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cebc49-bb40-4c4f-9dae-c24000ccd117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:34.686768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced97e5-eca9-4e0b-a03c-e87861c3ae7b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:34.737975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-49cebc49-bb40-4c4f-9dae-c24000ccd117 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:34.743193 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-49cebc49-bb40-4c4f-9dae-c24000ccd117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:34.860278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0d1a9-ba0f-40b1-898e-f66e6346ee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:34.862002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0d1a9-ba0f-40b1-898e-f66e6346ee09 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:34.864083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0d1a9-ba0f-40b1-898e-f66e6346ee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:34.866141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0d1a9-ba0f-40b1-898e-f66e6346ee09 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:34.871287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0d1a9-ba0f-40b1-898e-f66e6346ee09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:34.877495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0d1a9-ba0f-40b1-898e-f66e6346ee09 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:34.926354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 820/1651] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:08:34.927349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cebc49-bb40-4c4f-9dae-c24000ccd117 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:34.933694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-49cebc49-bb40-4c4f-9dae-c24000ccd117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:34.963089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cebc49-bb40-4c4f-9dae-c24000ccd117 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:34.981063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:34.981951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:34.982413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:34.982697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] PATH_INFO: `/v3/projects/7c867d6108c0406498212383fc925335` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:34.993035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c867d6108c0406498212383fc925335)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:34.993035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:35.019285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 832/1652] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:34 2022] POST /identity/v3/users => generated 309 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:35.020144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0d1a9-ba0f-40b1-898e-f66e6346ee09 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:35.024867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-36b0d1a9-ba0f-40b1-898e-f66e6346ee09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:35.113216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:35.197096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0d1a9-ba0f-40b1-898e-f66e6346ee09 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:35.201892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53250ba9-dcd7-42ca-b5e1-2a2d552423f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:35.202943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53250ba9-dcd7-42ca-b5e1-2a2d552423f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:35.203318 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53250ba9-dcd7-42ca-b5e1-2a2d552423f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:35.203670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53250ba9-dcd7-42ca-b5e1-2a2d552423f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:35.221072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53250ba9-dcd7-42ca-b5e1-2a2d552423f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:35.223324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53250ba9-dcd7-42ca-b5e1-2a2d552423f6 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:35.235425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c867d6108c0406498212383fc925335', 'request_id': 'req-3b4daf1d-b241-497c-a84c-0528bc37f2a8'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:35.235671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 833/1653] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:35.236655 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53250ba9-dcd7-42ca-b5e1-2a2d552423f6 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:35.238149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-53250ba9-dcd7-42ca-b5e1-2a2d552423f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:35.243816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c867d6108c0406498212383fc925335', 'request_id': 'req-3b4daf1d-b241-497c-a84c-0528bc37f2a8'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:35.253175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53250ba9-dcd7-42ca-b5e1-2a2d552423f6 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:35.261541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c867d6108c0406498212383fc925335', 'request_id': 'req-3b4daf1d-b241-497c-a84c-0528bc37f2a8'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:35.348269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] The token cache is being invalidate because project 7c867d6108c0406498212383fc925335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:08:35.348650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:35.352657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:35.354990 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 821/1654] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:08:34 2022] DELETE /identity/v3/projects/7c867d6108c0406498212383fc925335 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:35.359033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:35.360556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:35.376197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bb22f-73e8-404d-b144-b98b82bc2f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:35.376822 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bb22f-73e8-404d-b144-b98b82bc2f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:35.377108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bb22f-73e8-404d-b144-b98b82bc2f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:35.377453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bb22f-73e8-404d-b144-b98b82bc2f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:35.381250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bb22f-73e8-404d-b144-b98b82bc2f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:35.381250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bb22f-73e8-404d-b144-b98b82bc2f65 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:35.395573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 834/1655] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:35.400138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bb22f-73e8-404d-b144-b98b82bc2f65 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:35.403917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2e4bb22f-73e8-404d-b144-b98b82bc2f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:35.423372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bb22f-73e8-404d-b144-b98b82bc2f65 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:35.441167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a787b76-b558-4ddc-88a6-1e9c8f816367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:35.443891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a787b76-b558-4ddc-88a6-1e9c8f816367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:35.444363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a787b76-b558-4ddc-88a6-1e9c8f816367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:35.447339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a787b76-b558-4ddc-88a6-1e9c8f816367 admin admin] PATH_INFO: `/v3/projects/f52e72b124e5449ca3fc0e6e1dd68b0e/users/3e71a15eb25542b781811798f922e04a/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:35.482586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a787b76-b558-4ddc-88a6-1e9c8f816367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52e72b124e5449ca3fc0e6e1dd68b0e, user_id=3e71a15eb25542b781811798f922e04a, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:35.495876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a787b76-b558-4ddc-88a6-1e9c8f816367 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:35.505803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4daf1d-b241-497c-a84c-0528bc37f2a8 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:35.512945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:35.514889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:35.515389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:35.516048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] PATH_INFO: `/v3/users/855628fba5334475b861ada413619f1f` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:35.519510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855628fba5334475b861ada413619f1f)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:35.527401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:35.582928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 835/1656] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:35 2022] PUT /identity/v3/projects/f52e72b124e5449ca3fc0e6e1dd68b0e/users/3e71a15eb25542b781811798f922e04a/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:35.597979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a787b76-b558-4ddc-88a6-1e9c8f816367 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:35.740006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a787b76-b558-4ddc-88a6-1e9c8f816367 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:35.799066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caee56e-8a76-4ea3-a499-7e9a228ccf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:35.801816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caee56e-8a76-4ea3-a499-7e9a228ccf31 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:35.802514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caee56e-8a76-4ea3-a499-7e9a228ccf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:35.804654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caee56e-8a76-4ea3-a499-7e9a228ccf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:35.804654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caee56e-8a76-4ea3-a499-7e9a228ccf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:35.807549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caee56e-8a76-4ea3-a499-7e9a228ccf31 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:35.838048 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 836/1657] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:08:35.839330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caee56e-8a76-4ea3-a499-7e9a228ccf31 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:35.874900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caee56e-8a76-4ea3-a499-7e9a228ccf31 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:35.905145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0db067-789e-46f7-a888-ed265069a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:35.905846 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0db067-789e-46f7-a888-ed265069a1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:35.906020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855628fba5334475b861ada413619f1f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:35.906507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0db067-789e-46f7-a888-ed265069a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:35.907014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0db067-789e-46f7-a888-ed265069a1f0 admin admin] PATH_INFO: `/v3/projects/f52e72b124e5449ca3fc0e6e1dd68b0e/users/3e71a15eb25542b781811798f922e04a/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:35.916732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0db067-789e-46f7-a888-ed265069a1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52e72b124e5449ca3fc0e6e1dd68b0e, user_id=3e71a15eb25542b781811798f922e04a, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:35.925569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0db067-789e-46f7-a888-ed265069a1f0 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:35.932624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855628fba5334475b861ada413619f1f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:35.975813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855628fba5334475b861ada413619f1f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:35.977002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 837/1658] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:35 2022] PUT /identity/v3/projects/f52e72b124e5449ca3fc0e6e1dd68b0e/users/3e71a15eb25542b781811798f922e04a/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:36.089687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855628fba5334475b861ada413619f1f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:36.090886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e7ea34cb-8926-46f7-a303-31376120fd44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855628fba5334475b861ada413619f1f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:36.101517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 822/1659] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:35 2022] DELETE /identity/v3/users/855628fba5334475b861ada413619f1f => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:08:36.134439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:36.955106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0db067-789e-46f7-a888-ed265069a1f0 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:36.957286 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4a0db067-789e-46f7-a888-ed265069a1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:37.155173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0db067-789e-46f7-a888-ed265069a1f0 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:37.250987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:37.251671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:37.251958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:37.252234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] PATH_INFO: `/v3/projects/00c8fe2cfc344e3eab3daad48c0a47e8` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:37.255293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c8fe2cfc344e3eab3daad48c0a47e8)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:37.258939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: WARNING py.warnings [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:08:37.258939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: warnings.warn(msg) Sep 14 12:08:37.258939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: Sep 14 12:08:37.268857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:37.284368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:37.556386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c8fe2cfc344e3eab3daad48c0a47e8', 'request_id': 'req-c5b55fe3-67a5-4438-ba4d-32f280a942e3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:37.647369 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c8fe2cfc344e3eab3daad48c0a47e8', 'request_id': 'req-c5b55fe3-67a5-4438-ba4d-32f280a942e3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:37.679851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c8fe2cfc344e3eab3daad48c0a47e8', 'request_id': 'req-c5b55fe3-67a5-4438-ba4d-32f280a942e3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:37.695569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] The token cache is being invalidate because project 00c8fe2cfc344e3eab3daad48c0a47e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:08:37.696112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:37.696996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c5b55fe3-67a5-4438-ba4d-32f280a942e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:37.699054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 838/1660] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:08:36 2022] DELETE /identity/v3/projects/00c8fe2cfc344e3eab3daad48c0a47e8 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:37.703957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af6e9-1203-4c0b-9bf6-57ea1b6b3eb0 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:37.704460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af6e9-1203-4c0b-9bf6-57ea1b6b3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:37.704901 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af6e9-1203-4c0b-9bf6-57ea1b6b3eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:37.735801 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-427af6e9-1203-4c0b-9bf6-57ea1b6b3eb0 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:37.737088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-427af6e9-1203-4c0b-9bf6-57ea1b6b3eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:37.889832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 823/1661] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:37.891657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545918d6-c75b-4f00-a653-d73eec5807b7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:37.891953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545918d6-c75b-4f00-a653-d73eec5807b7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:37.892291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545918d6-c75b-4f00-a653-d73eec5807b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:37.926516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-545918d6-c75b-4f00-a653-d73eec5807b7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:37.932617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-545918d6-c75b-4f00-a653-d73eec5807b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:37.959531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 839/1662] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:37.961460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427af6e9-1203-4c0b-9bf6-57ea1b6b3eb0 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:38.006005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427af6e9-1203-4c0b-9bf6-57ea1b6b3eb0 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:38.033607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4865e-5794-4707-bddd-b06b0e8fa359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:38.034693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4865e-5794-4707-bddd-b06b0e8fa359 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:38.034991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4865e-5794-4707-bddd-b06b0e8fa359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:38.035273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4865e-5794-4707-bddd-b06b0e8fa359 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:38.035960 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4865e-5794-4707-bddd-b06b0e8fa359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:38.036409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4865e-5794-4707-bddd-b06b0e8fa359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:38.043941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4865e-5794-4707-bddd-b06b0e8fa359 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:38.070302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 824/1663] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:38.072975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545918d6-c75b-4f00-a653-d73eec5807b7 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:38.082945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545918d6-c75b-4f00-a653-d73eec5807b7 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:38.094247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbb3d4-87ca-4899-a2b5-d9578166f480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:38.094915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbb3d4-87ca-4899-a2b5-d9578166f480 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:38.095194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbb3d4-87ca-4899-a2b5-d9578166f480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:38.096112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbb3d4-87ca-4899-a2b5-d9578166f480 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:38.096270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbb3d4-87ca-4899-a2b5-d9578166f480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:38.098767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbb3d4-87ca-4899-a2b5-d9578166f480 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:38.256092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 840/1664] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:38 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:38.261665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4865e-5794-4707-bddd-b06b0e8fa359 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:38.294937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4865e-5794-4707-bddd-b06b0e8fa359 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:38.326321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:38.379646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700edaa0-a201-4bdb-a9b3-fbf1e6448c1b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:38.379956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700edaa0-a201-4bdb-a9b3-fbf1e6448c1b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:38.380238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700edaa0-a201-4bdb-a9b3-fbf1e6448c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:38.463762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-700edaa0-a201-4bdb-a9b3-fbf1e6448c1b None None] MFA Rules not processed for user `8f24308cb04a4229b770e58d6e7a832f`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:38.466807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98029bef-da82-4844-a736-46b560be730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:38.468548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98029bef-da82-4844-a736-46b560be730d admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:38.469036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98029bef-da82-4844-a736-46b560be730d admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:38.469480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-700edaa0-a201-4bdb-a9b3-fbf1e6448c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:38.470835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98029bef-da82-4844-a736-46b560be730d admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:38.473616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98029bef-da82-4844-a736-46b560be730d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:38.489080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98029bef-da82-4844-a736-46b560be730d admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:38.626488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 825/1665] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:38 2022] POST /identity/v3/users => generated 289 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:38.627484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98029bef-da82-4844-a736-46b560be730d admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:38.631531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-98029bef-da82-4844-a736-46b560be730d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:38.646853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 841/1666] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:08:38.649099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700edaa0-a201-4bdb-a9b3-fbf1e6448c1b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:38.667341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98029bef-da82-4844-a736-46b560be730d admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:38.676997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700edaa0-a201-4bdb-a9b3-fbf1e6448c1b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:38.678613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:38.680201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:38.681006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:38.683237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] PATH_INFO: `/v3/projects/11a2de0bf4e14aeb8e98c881d6acc2d4` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:38.687229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a2de0bf4e14aeb8e98c881d6acc2d4)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:38.689342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:38.690235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93397f2-75f1-4a47-a9c9-6228153967ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:38.691040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93397f2-75f1-4a47-a9c9-6228153967ad admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:38.691456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93397f2-75f1-4a47-a9c9-6228153967ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:38.691864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93397f2-75f1-4a47-a9c9-6228153967ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:38.693628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93397f2-75f1-4a47-a9c9-6228153967ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:38.697903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93397f2-75f1-4a47-a9c9-6228153967ad admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:38.726503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 842/1667] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:38.731301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b5ec-7b9b-4469-9378-9838dd12a765 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:38.731853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b5ec-7b9b-4469-9378-9838dd12a765 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:38.732313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b5ec-7b9b-4469-9378-9838dd12a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:38.811459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6ad9b5ec-7b9b-4469-9378-9838dd12a765 None None] MFA Rules not processed for user `8f24308cb04a4229b770e58d6e7a832f`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:38.812609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6ad9b5ec-7b9b-4469-9378-9838dd12a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:38.833792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 843/1668] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:38.838375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b5ec-7b9b-4469-9378-9838dd12a765 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:38.886922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a2de0bf4e14aeb8e98c881d6acc2d4', 'request_id': 'req-8f07af65-f211-444d-84d2-8092762ae6c5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:38.891216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b5ec-7b9b-4469-9378-9838dd12a765 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:38.900908 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a2de0bf4e14aeb8e98c881d6acc2d4', 'request_id': 'req-8f07af65-f211-444d-84d2-8092762ae6c5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:38.914755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a2de0bf4e14aeb8e98c881d6acc2d4', 'request_id': 'req-8f07af65-f211-444d-84d2-8092762ae6c5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:39.022076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] The token cache is being invalidate because project 11a2de0bf4e14aeb8e98c881d6acc2d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:08:39.023441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:39.024170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:39.026138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 826/1669] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:08:38 2022] DELETE /identity/v3/projects/11a2de0bf4e14aeb8e98c881d6acc2d4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:39.028447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:39.034985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:39.057113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dfe13-09e6-4772-8716-996636d988ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:39.063353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dfe13-09e6-4772-8716-996636d988ea admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:39.063921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dfe13-09e6-4772-8716-996636d988ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:39.066178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dfe13-09e6-4772-8716-996636d988ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:39.066178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dfe13-09e6-4772-8716-996636d988ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:39.079715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dfe13-09e6-4772-8716-996636d988ea admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:39.129149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 844/1670] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:39.141740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eca78d-277b-49ed-8737-c7fb418b0eea None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:39.143974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eca78d-277b-49ed-8737-c7fb418b0eea None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:39.144508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eca78d-277b-49ed-8737-c7fb418b0eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:39.175516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-a3eca78d-277b-49ed-8737-c7fb418b0eea None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:39.177689 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a3eca78d-277b-49ed-8737-c7fb418b0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:39.193544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 845/1671] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:39.195266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eca78d-277b-49ed-8737-c7fb418b0eea None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:39.198233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a3eca78d-277b-49ed-8737-c7fb418b0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:39.212136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07af65-f211-444d-84d2-8092762ae6c5 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:39.218516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eca78d-277b-49ed-8737-c7fb418b0eea None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:39.226460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e598c-6538-4a5d-b853-77ff14d2c095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:39.226748 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15f370-7a11-4adc-adbd-0fb450e7d9f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:39.227404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f370-7a11-4adc-adbd-0fb450e7d9f3 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:39.227530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e598c-6538-4a5d-b853-77ff14d2c095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:39.227695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f370-7a11-4adc-adbd-0fb450e7d9f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:39.227864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e598c-6538-4a5d-b853-77ff14d2c095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:39.227982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f370-7a11-4adc-adbd-0fb450e7d9f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:39.228293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e598c-6538-4a5d-b853-77ff14d2c095 admin admin] PATH_INFO: `/v3/projects/86f26d3eecc44f83bab200f4be380319/users/198720f503cb4727936faf59064335ad/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:39.235459 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-aa15f370-7a11-4adc-adbd-0fb450e7d9f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:39.259211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e598c-6538-4a5d-b853-77ff14d2c095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f26d3eecc44f83bab200f4be380319, user_id=198720f503cb4727936faf59064335ad, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:39.262566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e598c-6538-4a5d-b853-77ff14d2c095 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:39.345784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15f370-7a11-4adc-adbd-0fb450e7d9f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:39.347814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15f370-7a11-4adc-adbd-0fb450e7d9f3 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:39.374176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 846/1672] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:39 2022] PUT /identity/v3/projects/86f26d3eecc44f83bab200f4be380319/users/198720f503cb4727936faf59064335ad/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:39.376137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848d64c-844b-4704-954f-7a0a91d540d4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:39.376430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848d64c-844b-4704-954f-7a0a91d540d4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:39.376707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848d64c-844b-4704-954f-7a0a91d540d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:39.381732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 827/1673] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:39.387178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf778b6d-ef4a-41d2-8f6a-e60ccd2b67a5 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:39.387767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf778b6d-ef4a-41d2-8f6a-e60ccd2b67a5 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:39.387767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf778b6d-ef4a-41d2-8f6a-e60ccd2b67a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:39.428696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-3848d64c-844b-4704-954f-7a0a91d540d4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:39.432801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3848d64c-844b-4704-954f-7a0a91d540d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:39.449197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-cf778b6d-ef4a-41d2-8f6a-e60ccd2b67a5 None None] MFA Rules not processed for user `3e71a15eb25542b781811798f922e04a`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:39.450684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-cf778b6d-ef4a-41d2-8f6a-e60ccd2b67a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:39.585007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 847/1674] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:39.586737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39a64-8609-42fe-b5bd-3f3481b62696 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:39.587023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39a64-8609-42fe-b5bd-3f3481b62696 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:39.587295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39a64-8609-42fe-b5bd-3f3481b62696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:39.595028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 828/1675] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:39 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:39.596140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf778b6d-ef4a-41d2-8f6a-e60ccd2b67a5 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:39.610418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf778b6d-ef4a-41d2-8f6a-e60ccd2b67a5 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:39.615597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab78a37-c4a6-4d39-ac81-9720db02d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:39.617277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab78a37-c4a6-4d39-ac81-9720db02d6ca admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:39.617633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab78a37-c4a6-4d39-ac81-9720db02d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:39.617976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab78a37-c4a6-4d39-ac81-9720db02d6ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:39.618877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab78a37-c4a6-4d39-ac81-9720db02d6ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:39.619374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab78a37-c4a6-4d39-ac81-9720db02d6ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:39.622918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab78a37-c4a6-4d39-ac81-9720db02d6ca admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:39.641262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 829/1676] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:39.646734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab78a37-c4a6-4d39-ac81-9720db02d6ca admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:39.663931 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab78a37-c4a6-4d39-ac81-9720db02d6ca admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:39.669778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882a5f7-6b04-4359-a0e3-1ceebff7b220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:39.670648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882a5f7-6b04-4359-a0e3-1ceebff7b220 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:39.671069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882a5f7-6b04-4359-a0e3-1ceebff7b220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:39.671483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882a5f7-6b04-4359-a0e3-1ceebff7b220 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:39.672613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882a5f7-6b04-4359-a0e3-1ceebff7b220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:39.674922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882a5f7-6b04-4359-a0e3-1ceebff7b220 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:39.676974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d7c39a64-8609-42fe-b5bd-3f3481b62696 None None] MFA Rules not processed for user `198720f503cb4727936faf59064335ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:39.678267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d7c39a64-8609-42fe-b5bd-3f3481b62696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:39.859383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 830/1677] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:39 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:39.864227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882a5f7-6b04-4359-a0e3-1ceebff7b220 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:39.870119 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 848/1678] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:39.871129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39a64-8609-42fe-b5bd-3f3481b62696 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:39.911590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:39.912607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39a64-8609-42fe-b5bd-3f3481b62696 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:40.041821 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaadd96-1e37-44c3-9849-3b020e6b2237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:40.042635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaadd96-1e37-44c3-9849-3b020e6b2237 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.043015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaadd96-1e37-44c3-9849-3b020e6b2237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.043390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaadd96-1e37-44c3-9849-3b020e6b2237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.044155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaadd96-1e37-44c3-9849-3b020e6b2237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:40.046178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaadd96-1e37-44c3-9849-3b020e6b2237 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:40.061158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:40.120890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882a5f7-6b04-4359-a0e3-1ceebff7b220 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:40.138656 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070756-89e3-4fb2-b478-92810f0da9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:40.139290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070756-89e3-4fb2-b478-92810f0da9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.139608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070756-89e3-4fb2-b478-92810f0da9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.139883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070756-89e3-4fb2-b478-92810f0da9b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.140547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49070756-89e3-4fb2-b478-92810f0da9b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:40.142552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49070756-89e3-4fb2-b478-92810f0da9b8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:40.182493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 849/1679] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:39 2022] POST /identity/v3/projects => generated 379 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:40.184529 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaadd96-1e37-44c3-9849-3b020e6b2237 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:40.300202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 831/1680] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:39 2022] POST /identity/v3/users => generated 293 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:40.301169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070756-89e3-4fb2-b478-92810f0da9b8 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:40.325253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070756-89e3-4fb2-b478-92810f0da9b8 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:40.380060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaadd96-1e37-44c3-9849-3b020e6b2237 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:40.400580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12397eed-6c27-4498-b400-92daeeb12cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:40.402101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12397eed-6c27-4498-b400-92daeeb12cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.404744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12397eed-6c27-4498-b400-92daeeb12cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.405133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12397eed-6c27-4498-b400-92daeeb12cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.406053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12397eed-6c27-4498-b400-92daeeb12cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:40.409239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12397eed-6c27-4498-b400-92daeeb12cd5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:40.473471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84043928-dbfb-4884-9ef4-0873b518e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:40.474588 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84043928-dbfb-4884-9ef4-0873b518e800 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.475014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84043928-dbfb-4884-9ef4-0873b518e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.475348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84043928-dbfb-4884-9ef4-0873b518e800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.476819 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84043928-dbfb-4884-9ef4-0873b518e800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:40.479083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84043928-dbfb-4884-9ef4-0873b518e800 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:40.491444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 832/1681] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:40.496844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84043928-dbfb-4884-9ef4-0873b518e800 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:40.510764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84043928-dbfb-4884-9ef4-0873b518e800 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:40.517182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58006e-1e7b-48b0-a6b9-8c898dcd7c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:40.518781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58006e-1e7b-48b0-a6b9-8c898dcd7c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.519307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58006e-1e7b-48b0-a6b9-8c898dcd7c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.519692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58006e-1e7b-48b0-a6b9-8c898dcd7c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.520620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58006e-1e7b-48b0-a6b9-8c898dcd7c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:40.523284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58006e-1e7b-48b0-a6b9-8c898dcd7c88 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:40.543681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 850/1682] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:40 2022] POST /identity/v3/users => generated 296 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:40.547580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12397eed-6c27-4498-b400-92daeeb12cd5 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:40.573322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12397eed-6c27-4498-b400-92daeeb12cd5 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:40.574736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 833/1683] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:40.575903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58006e-1e7b-48b0-a6b9-8c898dcd7c88 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:40.588580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ac4e1-ecf5-41e9-81c8-8d9f6ef9d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:40.589937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ac4e1-ecf5-41e9-81c8-8d9f6ef9d216 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.590578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ac4e1-ecf5-41e9-81c8-8d9f6ef9d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.591452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ac4e1-ecf5-41e9-81c8-8d9f6ef9d216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.592481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ac4e1-ecf5-41e9-81c8-8d9f6ef9d216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:40.606822 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ac4e1-ecf5-41e9-81c8-8d9f6ef9d216 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:40.631808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58006e-1e7b-48b0-a6b9-8c898dcd7c88 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:40.654229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76097d9d-a3ec-47d9-9f1c-cedd33d54fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:40.655325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76097d9d-a3ec-47d9-9f1c-cedd33d54fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.655732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76097d9d-a3ec-47d9-9f1c-cedd33d54fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.656502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76097d9d-a3ec-47d9-9f1c-cedd33d54fb3 admin admin] PATH_INFO: `/v3/projects/2bc7cef1973d40259df2de9ecf3ef94e/users/fec50ee3d65f4457a7387b3683bde81d/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.671241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 851/1684] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:40.671241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ac4e1-ecf5-41e9-81c8-8d9f6ef9d216 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:40.688755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ac4e1-ecf5-41e9-81c8-8d9f6ef9d216 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:40.691537 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76097d9d-a3ec-47d9-9f1c-cedd33d54fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc7cef1973d40259df2de9ecf3ef94e, user_id=fec50ee3d65f4457a7387b3683bde81d, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:40.697948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76097d9d-a3ec-47d9-9f1c-cedd33d54fb3 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:40.708773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bb906-51c6-4b95-96a9-7db893c38152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:40.711051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb906-51c6-4b95-96a9-7db893c38152 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.714867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb906-51c6-4b95-96a9-7db893c38152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.715324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb906-51c6-4b95-96a9-7db893c38152 admin admin] PATH_INFO: `/v3/projects/16fa6c90f1b648c9873db930c1326694/users/0587ea75cd8a495095b5d35b3ba1012a/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.755705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb906-51c6-4b95-96a9-7db893c38152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16fa6c90f1b648c9873db930c1326694, user_id=0587ea75cd8a495095b5d35b3ba1012a, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:40.763446 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb906-51c6-4b95-96a9-7db893c38152 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:40.807277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 834/1685] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:40 2022] PUT /identity/v3/projects/2bc7cef1973d40259df2de9ecf3ef94e/users/fec50ee3d65f4457a7387b3683bde81d/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:40.808601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea69a05-fc17-428a-8708-fd1eb77f66f1 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.808887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea69a05-fc17-428a-8708-fd1eb77f66f1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.809435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea69a05-fc17-428a-8708-fd1eb77f66f1 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.814147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 835/1686] 10.222.0.77 () {54 vars in 912 bytes} [Wed Sep 14 12:08:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:08:40.820136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051320e8-b796-44bc-8df3-334b60bcaafd None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.824116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051320e8-b796-44bc-8df3-334b60bcaafd None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.824116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051320e8-b796-44bc-8df3-334b60bcaafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.905604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 852/1687] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:40 2022] PUT /identity/v3/projects/16fa6c90f1b648c9873db930c1326694/users/0587ea75cd8a495095b5d35b3ba1012a/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:40.907167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e81206-91e9-49ff-812d-575ac252117c None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:40.909630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e81206-91e9-49ff-812d-575ac252117c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:40.910411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e81206-91e9-49ff-812d-575ac252117c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:40.924334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-051320e8-b796-44bc-8df3-334b60bcaafd None None] MFA Rules not processed for user `fec50ee3d65f4457a7387b3683bde81d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:40.925619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-051320e8-b796-44bc-8df3-334b60bcaafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:41.033416 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-83e81206-91e9-49ff-812d-575ac252117c None None] MFA Rules not processed for user `67880641bc954088bef0b601a8410f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:41.036034 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-83e81206-91e9-49ff-812d-575ac252117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:41.105161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 836/1688] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:41.112716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051320e8-b796-44bc-8df3-334b60bcaafd None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:41.183883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 853/1689] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:08:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:41.184702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e81206-91e9-49ff-812d-575ac252117c None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:41.188017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051320e8-b796-44bc-8df3-334b60bcaafd None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:41.193584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c44e71-b004-48d7-9a38-b00f42d01b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:41.196310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c44e71-b004-48d7-9a38-b00f42d01b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:41.196599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c44e71-b004-48d7-9a38-b00f42d01b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:41.197008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c44e71-b004-48d7-9a38-b00f42d01b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:41.198029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c44e71-b004-48d7-9a38-b00f42d01b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:41.199906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c44e71-b004-48d7-9a38-b00f42d01b0b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:41.213143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e81206-91e9-49ff-812d-575ac252117c None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:41.218895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 837/1690] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:41.223852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc975c-a376-4e32-b909-49c392e88055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:41.224636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc975c-a376-4e32-b909-49c392e88055 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:41.225025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc975c-a376-4e32-b909-49c392e88055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:41.225406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc975c-a376-4e32-b909-49c392e88055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:41.225508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c44e71-b004-48d7-9a38-b00f42d01b0b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:41.226787 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc975c-a376-4e32-b909-49c392e88055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:41.228953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc975c-a376-4e32-b909-49c392e88055 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:41.240807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c44e71-b004-48d7-9a38-b00f42d01b0b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:41.245840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dff3ea-a638-4d1d-b07c-239e327a8a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:41.246661 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dff3ea-a638-4d1d-b07c-239e327a8a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:41.246949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dff3ea-a638-4d1d-b07c-239e327a8a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:41.247220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dff3ea-a638-4d1d-b07c-239e327a8a5f admin admin] PATH_INFO: `/v3/projects/16fa6c90f1b648c9873db930c1326694/users/0587ea75cd8a495095b5d35b3ba1012a/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:41.249861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dff3ea-a638-4d1d-b07c-239e327a8a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16fa6c90f1b648c9873db930c1326694, user_id=0587ea75cd8a495095b5d35b3ba1012a, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:41.253156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dff3ea-a638-4d1d-b07c-239e327a8a5f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:41.267771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 838/1691] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:41 2022] PUT /identity/v3/projects/16fa6c90f1b648c9873db930c1326694/users/0587ea75cd8a495095b5d35b3ba1012a/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:41.269269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dff3ea-a638-4d1d-b07c-239e327a8a5f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:41.275873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c3dff3ea-a638-4d1d-b07c-239e327a8a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:41.364812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dff3ea-a638-4d1d-b07c-239e327a8a5f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:41.370978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2f530-46a3-41a9-8fc6-f78ad283488c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:41.372312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2f530-46a3-41a9-8fc6-f78ad283488c service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:41.372670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2f530-46a3-41a9-8fc6-f78ad283488c service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:41.373013 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2f530-46a3-41a9-8fc6-f78ad283488c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:41.381366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2f530-46a3-41a9-8fc6-f78ad283488c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:41.383287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2f530-46a3-41a9-8fc6-f78ad283488c service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:41.393650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 839/1692] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:41.395382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779782-e87d-4239-bd8a-c89a13826523 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:41.395765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779782-e87d-4239-bd8a-c89a13826523 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:41.396668 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779782-e87d-4239-bd8a-c89a13826523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:41.411955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 854/1693] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:41 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:41.416671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc975c-a376-4e32-b909-49c392e88055 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:41.468091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-98779782-e87d-4239-bd8a-c89a13826523 None None] MFA Rules not processed for user `0587ea75cd8a495095b5d35b3ba1012a`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:41.469770 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-98779782-e87d-4239-bd8a-c89a13826523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:41.549506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc975c-a376-4e32-b909-49c392e88055 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:41.564972 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656a795-0441-43ad-906e-018b5d5c8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:41.565863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656a795-0441-43ad-906e-018b5d5c8588 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:41.566341 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656a795-0441-43ad-906e-018b5d5c8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:41.566697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:41.567237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656a795-0441-43ad-906e-018b5d5c8588 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:41.570386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656a795-0441-43ad-906e-018b5d5c8588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:41.570386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656a795-0441-43ad-906e-018b5d5c8588 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:41.647391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 840/1694] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:41.649408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:41.678054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98779782-e87d-4239-bd8a-c89a13826523 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:41.683134 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-98779782-e87d-4239-bd8a-c89a13826523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:41.696420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 855/1695] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:41 2022] POST /identity/v3/users => generated 299 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:41.700367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656a795-0441-43ad-906e-018b5d5c8588 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:41.720186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656a795-0441-43ad-906e-018b5d5c8588 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:41.736229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f17ce-f710-4045-9dec-3c190950997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:41.737416 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f17ce-f710-4045-9dec-3c190950997d admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:41.737857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f17ce-f710-4045-9dec-3c190950997d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:41.738499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f17ce-f710-4045-9dec-3c190950997d admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:41.739594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f17ce-f710-4045-9dec-3c190950997d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:41.742284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f17ce-f710-4045-9dec-3c190950997d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:41.767426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 856/1696] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:08:41.771111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f17ce-f710-4045-9dec-3c190950997d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:41.798815 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f17ce-f710-4045-9dec-3c190950997d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:41.808221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c241730-0f78-42d4-88a1-70a952c258a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:41.808915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c241730-0f78-42d4-88a1-70a952c258a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:41.809210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c241730-0f78-42d4-88a1-70a952c258a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:41.809497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c241730-0f78-42d4-88a1-70a952c258a0 admin admin] PATH_INFO: `/v3/projects/33fd2baf749846baaa2cd61263846f72/users/4ae595ccce0c4b6ab4d497826ff05b31/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:41.844975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c241730-0f78-42d4-88a1-70a952c258a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fd2baf749846baaa2cd61263846f72, user_id=4ae595ccce0c4b6ab4d497826ff05b31, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:41.847692 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c241730-0f78-42d4-88a1-70a952c258a0 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:41.865741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98779782-e87d-4239-bd8a-c89a13826523 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:41.887809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c01cb-4689-478f-9c67-d39fb0ac040e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:41.888470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c01cb-4689-478f-9c67-d39fb0ac040e service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:41.888756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c01cb-4689-478f-9c67-d39fb0ac040e service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:41.889035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c01cb-4689-478f-9c67-d39fb0ac040e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:41.991051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c01cb-4689-478f-9c67-d39fb0ac040e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:41.993089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c01cb-4689-478f-9c67-d39fb0ac040e service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:42.003071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 857/1697] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:41 2022] PUT /identity/v3/projects/33fd2baf749846baaa2cd61263846f72/users/4ae595ccce0c4b6ab4d497826ff05b31/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:08:42.004564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04a9c-4c11-4316-a555-11d02bf24c25 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:42.004994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04a9c-4c11-4316-a555-11d02bf24c25 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:42.005276 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04a9c-4c11-4316-a555-11d02bf24c25 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:42.010781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 858/1698] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:08:42.010781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce04a9c-4c11-4316-a555-11d02bf24c25 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:42.033056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 841/1699] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:42.090343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8274-5c27-455e-86e0-55fe81063f28 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:42.090620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8274-5c27-455e-86e0-55fe81063f28 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:42.090893 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8274-5c27-455e-86e0-55fe81063f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:42.138305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5e6a8274-5c27-455e-86e0-55fe81063f28 None None] MFA Rules not processed for user `877b59ec265f42e4bf8edbd9767e3319`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:42.140884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5e6a8274-5c27-455e-86e0-55fe81063f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:42.186423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce04a9c-4c11-4316-a555-11d02bf24c25 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:42.196020 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eae18-e7d9-422a-9d7f-c45f9eefb26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:42.197117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eae18-e7d9-422a-9d7f-c45f9eefb26f admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:42.197249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eae18-e7d9-422a-9d7f-c45f9eefb26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:42.197644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eae18-e7d9-422a-9d7f-c45f9eefb26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:42.198339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eae18-e7d9-422a-9d7f-c45f9eefb26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:42.200123 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eae18-e7d9-422a-9d7f-c45f9eefb26f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:42.214403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 859/1700] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:42.220387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eae18-e7d9-422a-9d7f-c45f9eefb26f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:42.257486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eae18-e7d9-422a-9d7f-c45f9eefb26f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:42.283475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed45b73-3905-4316-8643-69c5f9eb5394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:42.284275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed45b73-3905-4316-8643-69c5f9eb5394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:42.286288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed45b73-3905-4316-8643-69c5f9eb5394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:42.286931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed45b73-3905-4316-8643-69c5f9eb5394 admin admin] PATH_INFO: `/v3/projects/33fd2baf749846baaa2cd61263846f72/users/4ae595ccce0c4b6ab4d497826ff05b31/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:42.294878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed45b73-3905-4316-8643-69c5f9eb5394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fd2baf749846baaa2cd61263846f72, user_id=4ae595ccce0c4b6ab4d497826ff05b31, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:42.298708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed45b73-3905-4316-8643-69c5f9eb5394 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:42.308685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 842/1701] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:42.328691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8274-5c27-455e-86e0-55fe81063f28 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:42.330145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5e6a8274-5c27-455e-86e0-55fe81063f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:42.332881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 860/1702] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:42 2022] PUT /identity/v3/projects/33fd2baf749846baaa2cd61263846f72/users/4ae595ccce0c4b6ab4d497826ff05b31/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:42.343908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dfe2d-5b13-4474-875c-22a3f916b7c1 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:42.344385 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dfe2d-5b13-4474-875c-22a3f916b7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:42.345464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dfe2d-5b13-4474-875c-22a3f916b7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:42.368785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8274-5c27-455e-86e0-55fe81063f28 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:42.385985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-fb7dfe2d-5b13-4474-875c-22a3f916b7c1 None None] MFA Rules not processed for user `4ae595ccce0c4b6ab4d497826ff05b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:42.387531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fb7dfe2d-5b13-4474-875c-22a3f916b7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:42.501971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85980ed-ff22-43fa-b7a6-004ac1895efa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:42.502916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85980ed-ff22-43fa-b7a6-004ac1895efa service placement] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:42.503199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85980ed-ff22-43fa-b7a6-004ac1895efa service placement] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:42.503470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85980ed-ff22-43fa-b7a6-004ac1895efa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:42.518464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85980ed-ff22-43fa-b7a6-004ac1895efa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:42.523588 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85980ed-ff22-43fa-b7a6-004ac1895efa service placement] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:42.542506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 861/1703] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:08:42.551091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 843/1704] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:42.807571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dfe2d-5b13-4474-875c-22a3f916b7c1 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:42.808346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fb7dfe2d-5b13-4474-875c-22a3f916b7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:43.031567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dfe2d-5b13-4474-875c-22a3f916b7c1 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:43.046897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b442-abf2-4f9e-818a-3384da8734ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:43.047777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b442-abf2-4f9e-818a-3384da8734ad service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:43.048546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b442-abf2-4f9e-818a-3384da8734ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:43.048996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b442-abf2-4f9e-818a-3384da8734ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:43.110125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b442-abf2-4f9e-818a-3384da8734ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:43.122594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b442-abf2-4f9e-818a-3384da8734ad service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:43.140446 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 862/1705] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:43.203494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85980ed-ff22-43fa-b7a6-004ac1895efa service placement] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:43.479009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b442-abf2-4f9e-818a-3384da8734ad service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:43.500428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b442-abf2-4f9e-818a-3384da8734ad service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:43.515097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85980ed-ff22-43fa-b7a6-004ac1895efa service placement] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:43.522128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60f060-3921-4aac-bf6a-747b65daa801 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:43.526542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60f060-3921-4aac-bf6a-747b65daa801 service placement] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:43.526975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60f060-3921-4aac-bf6a-747b65daa801 service placement] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:43.527351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60f060-3921-4aac-bf6a-747b65daa801 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:43.531770 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:43.533726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:43.534367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:43.536052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-bb60f060-3921-4aac-bf6a-747b65daa801 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:43.536402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] PATH_INFO: `/v3/users/fec50ee3d65f4457a7387b3683bde81d` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:43.541674 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec50ee3d65f4457a7387b3683bde81d)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:43.550461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:43.580224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60f060-3921-4aac-bf6a-747b65daa801 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:43.582081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60f060-3921-4aac-bf6a-747b65daa801 service placement] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:43.619402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 863/1706] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:43.855408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec50ee3d65f4457a7387b3683bde81d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:43.874538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec50ee3d65f4457a7387b3683bde81d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:43.895944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec50ee3d65f4457a7387b3683bde81d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:44.016050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec50ee3d65f4457a7387b3683bde81d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:44.016708 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec50ee3d65f4457a7387b3683bde81d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:44.029515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 844/1707] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:43 2022] DELETE /identity/v3/users/fec50ee3d65f4457a7387b3683bde81d => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:08:44.035065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c90c-a8fc-448a-8b8d-73558f7ea53a None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:44.035556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c90c-a8fc-448a-8b8d-73558f7ea53a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:44.035996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c90c-a8fc-448a-8b8d-73558f7ea53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:44.135191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b2e9c90c-a8fc-448a-8b8d-73558f7ea53a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:44.144749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b2e9c90c-a8fc-448a-8b8d-73558f7ea53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:44.186482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:44.186696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:44.229675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:44.372630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 864/1708] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:44.383085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9c90c-a8fc-448a-8b8d-73558f7ea53a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:44.385363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b2e9c90c-a8fc-448a-8b8d-73558f7ea53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:44.395802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da483520-74bd-4d64-9955-6425808a3e23 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:44.419991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:44.419991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:44.419991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:44.420701 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] PATH_INFO: `/v3/users/76789b4d2a2248cebebd87818f3d1491` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:44.422133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] RBAC: Authorizing `identity:delete_user(user_id=76789b4d2a2248cebebd87818f3d1491)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:44.424190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:44.542089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9c90c-a8fc-448a-8b8d-73558f7ea53a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:44.554367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45c427-4eb4-4669-8a27-ccabf383865e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:44.555315 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45c427-4eb4-4669-8a27-ccabf383865e service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:44.555863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45c427-4eb4-4669-8a27-ccabf383865e service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:44.556309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45c427-4eb4-4669-8a27-ccabf383865e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:44.567359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45c427-4eb4-4669-8a27-ccabf383865e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:44.569088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45c427-4eb4-4669-8a27-ccabf383865e service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:44.584371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 865/1709] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:08:44.698075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:44.743602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76789b4d2a2248cebebd87818f3d1491'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:44.774987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76789b4d2a2248cebebd87818f3d1491'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:44.831691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76789b4d2a2248cebebd87818f3d1491'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:44.942435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45c427-4eb4-4669-8a27-ccabf383865e service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:44.943944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-be45c427-4eb4-4669-8a27-ccabf383865e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:45.004362 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76789b4d2a2248cebebd87818f3d1491'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:45.005152 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76789b4d2a2248cebebd87818f3d1491'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:45.013727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 845/1710] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:44 2022] DELETE /identity/v3/users/76789b4d2a2248cebebd87818f3d1491 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:45.159389 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45c427-4eb4-4669-8a27-ccabf383865e service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:45.254968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641b4e7-8d92-4c25-95bb-6a9c74086312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:45.256510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641b4e7-8d92-4c25-95bb-6a9c74086312 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:45.258634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641b4e7-8d92-4c25-95bb-6a9c74086312 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:45.259235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641b4e7-8d92-4c25-95bb-6a9c74086312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:45.263157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8641b4e7-8d92-4c25-95bb-6a9c74086312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:45.433874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:45.477891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641b4e7-8d92-4c25-95bb-6a9c74086312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:45.480314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641b4e7-8d92-4c25-95bb-6a9c74086312 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:45.496200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 866/1711] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:08:45.676170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:45.678018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:45.782972 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c0b33-871d-4661-b7c7-dd3ad69f891f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:45.790145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:45.790952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:45.791359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:45.791785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] PATH_INFO: `/v3/projects/17be41a20bda43dcacd7aab3a1246c54` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:45.793348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=17be41a20bda43dcacd7aab3a1246c54)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:45.795810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:45.999586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17be41a20bda43dcacd7aab3a1246c54', 'request_id': 'req-aa84a62f-0225-4b25-aff1-64c90946c16f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.018696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17be41a20bda43dcacd7aab3a1246c54', 'request_id': 'req-aa84a62f-0225-4b25-aff1-64c90946c16f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.035302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17be41a20bda43dcacd7aab3a1246c54', 'request_id': 'req-aa84a62f-0225-4b25-aff1-64c90946c16f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.158485 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] The token cache is being invalidate because project 17be41a20bda43dcacd7aab3a1246c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:08:46.158666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.159567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.161652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 846/1712] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:08:45 2022] DELETE /identity/v3/projects/17be41a20bda43dcacd7aab3a1246c54 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:46.166447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641b4e7-8d92-4c25-95bb-6a9c74086312 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:46.180240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641b4e7-8d92-4c25-95bb-6a9c74086312 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:46.244379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:46.245278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:46.245750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:46.246331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] PATH_INFO: `/v3/users/3e71a15eb25542b781811798f922e04a` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:46.247759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e71a15eb25542b781811798f922e04a)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:46.249892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:46.284633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:46.286582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:46.301718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84a62f-0225-4b25-aff1-64c90946c16f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:46.307735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:46.308395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:46.308680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:46.308954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] PATH_INFO: `/v3/projects/2bc7cef1973d40259df2de9ecf3ef94e` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:46.311005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc7cef1973d40259df2de9ecf3ef94e)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:46.313682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:46.554581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc7cef1973d40259df2de9ecf3ef94e', 'request_id': 'req-6113208b-5b6b-4d68-ba95-208ad5f1c857'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.560266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e71a15eb25542b781811798f922e04a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.561359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e71a15eb25542b781811798f922e04a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.570912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc7cef1973d40259df2de9ecf3ef94e', 'request_id': 'req-6113208b-5b6b-4d68-ba95-208ad5f1c857'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.578537 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e71a15eb25542b781811798f922e04a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.582831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc7cef1973d40259df2de9ecf3ef94e', 'request_id': 'req-6113208b-5b6b-4d68-ba95-208ad5f1c857'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.635727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e71a15eb25542b781811798f922e04a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.636693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e71a15eb25542b781811798f922e04a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.765940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] The token cache is being invalidate because project 2bc7cef1973d40259df2de9ecf3ef94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:08:46.768487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.771324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:46.775191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 847/1713] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:08:46 2022] DELETE /identity/v3/projects/2bc7cef1973d40259df2de9ecf3ef94e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:46.776304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:46.779448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:46.876239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 867/1714] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:46 2022] DELETE /identity/v3/users/3e71a15eb25542b781811798f922e04a => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:46.877409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:46.887737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:46.903564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:46.906888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113208b-5b6b-4d68-ba95-208ad5f1c857 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:46.999985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:47.000650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:47.001076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:47.001363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] PATH_INFO: `/v3/users/22a06dddf5ff41168826320561ad545c` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:47.005229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a06dddf5ff41168826320561ad545c)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:47.008057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:47.072836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a5381-d88e-4313-a7a7-fb7ad3a50b99 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:47.080429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:47.081561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:47.082080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:47.082624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] PATH_INFO: `/v3/users/4ae595ccce0c4b6ab4d497826ff05b31` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:47.084367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae595ccce0c4b6ab4d497826ff05b31)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:47.087178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:47.328052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a06dddf5ff41168826320561ad545c'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:47.347694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a06dddf5ff41168826320561ad545c'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:47.367779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a06dddf5ff41168826320561ad545c'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:47.420806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae595ccce0c4b6ab4d497826ff05b31'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:47.427151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae595ccce0c4b6ab4d497826ff05b31'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:47.455443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a06dddf5ff41168826320561ad545c'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:47.456557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a9c8f579-aad3-4d83-a9ed-64948478924f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a06dddf5ff41168826320561ad545c'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:47.456688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae595ccce0c4b6ab4d497826ff05b31'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:47.467352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 848/1715] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:46 2022] DELETE /identity/v3/users/22a06dddf5ff41168826320561ad545c => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:47.469001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e558e6f-d90c-48fd-83bc-0c54b037111e None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:47.470384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e558e6f-d90c-48fd-83bc-0c54b037111e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:47.472002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e558e6f-d90c-48fd-83bc-0c54b037111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:47.485889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae595ccce0c4b6ab4d497826ff05b31'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:47.487652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae595ccce0c4b6ab4d497826ff05b31'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:47.555344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-7e558e6f-d90c-48fd-83bc-0c54b037111e None None] MFA Rules not processed for user `88c79e3d1b6e46d6aa15f5f6e2b5498e`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:47.558517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7e558e6f-d90c-48fd-83bc-0c54b037111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:47.599349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 868/1716] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:46 2022] DELETE /identity/v3/users/4ae595ccce0c4b6ab4d497826ff05b31 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:47.601121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:47.627087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:47.636881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:47.745168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 849/1717] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:47.754075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413765-db4e-4b74-ac29-2056a771668b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:47.754431 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413765-db4e-4b74-ac29-2056a771668b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:47.754711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21413765-db4e-4b74-ac29-2056a771668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:47.806558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f2d37-89f8-4b83-aa37-e0e9f02956b4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:47.818611 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:47.820654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:47.820943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:47.824302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] PATH_INFO: `/v3/projects/f52e72b124e5449ca3fc0e6e1dd68b0e` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:47.824302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52e72b124e5449ca3fc0e6e1dd68b0e)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:47.826914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:47.840624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-21413765-db4e-4b74-ac29-2056a771668b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:47.854580 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-21413765-db4e-4b74-ac29-2056a771668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:47.887530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 850/1718] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:47.890133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b829c-2f2d-41f2-866a-c332e2300b07 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:47.898149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b829c-2f2d-41f2-866a-c332e2300b07 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:47.900169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b829c-2f2d-41f2-866a-c332e2300b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:47.941842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-cb9b829c-2f2d-41f2-866a-c332e2300b07 None None] MFA Rules not processed for user `88c79e3d1b6e46d6aa15f5f6e2b5498e`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:47.943118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-cb9b829c-2f2d-41f2-866a-c332e2300b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:48.035471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52e72b124e5449ca3fc0e6e1dd68b0e', 'request_id': 'req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:48.124738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 851/1719] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:48.124738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b829c-2f2d-41f2-866a-c332e2300b07 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:48.124738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-cb9b829c-2f2d-41f2-866a-c332e2300b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:48.174820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52e72b124e5449ca3fc0e6e1dd68b0e', 'request_id': 'req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:48.184610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52e72b124e5449ca3fc0e6e1dd68b0e', 'request_id': 'req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:48.229291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] The token cache is being invalidate because project f52e72b124e5449ca3fc0e6e1dd68b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:08:48.229600 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:48.234086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:48.240314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 869/1720] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:08:47 2022] DELETE /identity/v3/projects/f52e72b124e5449ca3fc0e6e1dd68b0e => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:48.242242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:48.257834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:48.269346 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b829c-2f2d-41f2-866a-c332e2300b07 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:48.398989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a48ce-98f7-478b-b71b-e67166f53a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:48.399716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a48ce-98f7-478b-b71b-e67166f53a68 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:48.400096 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a48ce-98f7-478b-b71b-e67166f53a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:48.400470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a48ce-98f7-478b-b71b-e67166f53a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:48.403905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-231a48ce-98f7-478b-b71b-e67166f53a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:48.461471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a3ab3-82b3-4537-a82a-228bf55a9af0 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:48.476127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fa9b5-f158-4d91-a7eb-fbb36eb2d5ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:48.478194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fa9b5-f158-4d91-a7eb-fbb36eb2d5ee service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:48.478672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fa9b5-f158-4d91-a7eb-fbb36eb2d5ee service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:48.479117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fa9b5-f158-4d91-a7eb-fbb36eb2d5ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:48.503392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ef6fa9b5-f158-4d91-a7eb-fbb36eb2d5ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:48.670798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a48ce-98f7-478b-b71b-e67166f53a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:48.672974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a48ce-98f7-478b-b71b-e67166f53a68 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:48.689483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 852/1721] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:48.691675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a135eec-fdfa-4e23-ab8c-2d1d9e5a066c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:48.692114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a135eec-fdfa-4e23-ab8c-2d1d9e5a066c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:48.692538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a135eec-fdfa-4e23-ab8c-2d1d9e5a066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:48.727311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2a135eec-fdfa-4e23-ab8c-2d1d9e5a066c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:48.728934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2a135eec-fdfa-4e23-ab8c-2d1d9e5a066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:48.734728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fa9b5-f158-4d91-a7eb-fbb36eb2d5ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:48.736582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fa9b5-f158-4d91-a7eb-fbb36eb2d5ee service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:48.750941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 853/1722] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:48.751829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a135eec-fdfa-4e23-ab8c-2d1d9e5a066c None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:48.753407 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2a135eec-fdfa-4e23-ab8c-2d1d9e5a066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:48.754053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 870/1723] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:48.763902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb08a2f-cc2b-4e6f-8716-0fb1a9a2238d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:48.764413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb08a2f-cc2b-4e6f-8716-0fb1a9a2238d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:48.764880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb08a2f-cc2b-4e6f-8716-0fb1a9a2238d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:48.767437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a135eec-fdfa-4e23-ab8c-2d1d9e5a066c None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:48.774072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:48.780799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:48.780799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:48.780799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] PATH_INFO: `/v3/projects/33fd2baf749846baaa2cd61263846f72` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:48.780799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fd2baf749846baaa2cd61263846f72)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:48.781896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:48.816066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-bdb08a2f-cc2b-4e6f-8716-0fb1a9a2238d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:48.817927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-bdb08a2f-cc2b-4e6f-8716-0fb1a9a2238d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:48.829061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 871/1724] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:48.832625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:48.834657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb08a2f-cc2b-4e6f-8716-0fb1a9a2238d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:48.857594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb08a2f-cc2b-4e6f-8716-0fb1a9a2238d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:48.876990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c18cbd-e20a-4db2-ac7d-11b7225bf97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:48.879147 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c18cbd-e20a-4db2-ac7d-11b7225bf97b admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:48.879425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c18cbd-e20a-4db2-ac7d-11b7225bf97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:48.893489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c18cbd-e20a-4db2-ac7d-11b7225bf97b admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:48.895937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c18cbd-e20a-4db2-ac7d-11b7225bf97b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:48.896987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c18cbd-e20a-4db2-ac7d-11b7225bf97b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:48.898779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c18cbd-e20a-4db2-ac7d-11b7225bf97b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:48.960631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 872/1725] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:48.964967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c18cbd-e20a-4db2-ac7d-11b7225bf97b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:48.981548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c18cbd-e20a-4db2-ac7d-11b7225bf97b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:48.995403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fd2baf749846baaa2cd61263846f72', 'request_id': 'req-360facb5-4d55-4646-aa29-4ce3928b310b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:49.005423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fd2baf749846baaa2cd61263846f72', 'request_id': 'req-360facb5-4d55-4646-aa29-4ce3928b310b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:49.013422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fd2baf749846baaa2cd61263846f72', 'request_id': 'req-360facb5-4d55-4646-aa29-4ce3928b310b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:49.093522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c1032-5829-4a5a-8e61-848f5c71c999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:49.094232 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1032-5829-4a5a-8e61-848f5c71c999 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:49.094521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1032-5829-4a5a-8e61-848f5c71c999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:49.094795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1032-5829-4a5a-8e61-848f5c71c999 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:49.095615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c1032-5829-4a5a-8e61-848f5c71c999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:49.097548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c1032-5829-4a5a-8e61-848f5c71c999 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:49.196775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] The token cache is being invalidate because project 33fd2baf749846baaa2cd61263846f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:08:49.197161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:49.200559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-360facb5-4d55-4646-aa29-4ce3928b310b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:49.202983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 854/1726] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:08:48 2022] DELETE /identity/v3/projects/33fd2baf749846baaa2cd61263846f72 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:49.213535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec6724-1926-424e-ad32-5775b0ed6432 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:49.213985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec6724-1926-424e-ad32-5775b0ed6432 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:49.214463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec6724-1926-424e-ad32-5775b0ed6432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:49.253773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-48ec6724-1926-424e-ad32-5775b0ed6432 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:49.256219 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-48ec6724-1926-424e-ad32-5775b0ed6432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:49.329866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 855/1727] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:49.331857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4549d1-3be3-4556-9014-d8bb5a7d3e31 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:49.331857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4549d1-3be3-4556-9014-d8bb5a7d3e31 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:49.332028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4549d1-3be3-4556-9014-d8bb5a7d3e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:49.337842 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 873/1728] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:48 2022] POST /identity/v3/projects => generated 373 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:08:49.341684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c1032-5829-4a5a-8e61-848f5c71c999 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:49.344227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a31c1032-5829-4a5a-8e61-848f5c71c999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:49.407086 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5a4549d1-3be3-4556-9014-d8bb5a7d3e31 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:49.408315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5a4549d1-3be3-4556-9014-d8bb5a7d3e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:49.516050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:49.572231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 856/1729] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:49.573783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6ba63-d6a8-4de2-98fa-fe5a2da49434 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:49.574427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6ba63-d6a8-4de2-98fa-fe5a2da49434 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:49.574887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6ba63-d6a8-4de2-98fa-fe5a2da49434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:49.603508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c1032-5829-4a5a-8e61-848f5c71c999 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:49.621454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb602f6-9740-4d91-8973-803b874a6d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:49.622226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb602f6-9740-4d91-8973-803b874a6d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:49.622627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb602f6-9740-4d91-8973-803b874a6d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:49.622979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb602f6-9740-4d91-8973-803b874a6d0d admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:49.624293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb602f6-9740-4d91-8973-803b874a6d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:49.632759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb602f6-9740-4d91-8973-803b874a6d0d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:49.666655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-dfc6ba63-d6a8-4de2-98fa-fe5a2da49434 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:49.667909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-dfc6ba63-d6a8-4de2-98fa-fe5a2da49434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:49.796090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 857/1730] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:49.798680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6ba63-d6a8-4de2-98fa-fe5a2da49434 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:49.814782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 874/1731] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:49 2022] POST /identity/v3/users => generated 287 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:49.816247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7215a37-e714-4bb4-8d14-4ec14728e439 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:49.817065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7215a37-e714-4bb4-8d14-4ec14728e439 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:49.817803 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7215a37-e714-4bb4-8d14-4ec14728e439 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:49.824450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 875/1732] 10.222.0.77 () {54 vars in 912 bytes} [Wed Sep 14 12:08:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:08:49.829825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7215a37-e714-4bb4-8d14-4ec14728e439 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:49.837194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6ba63-d6a8-4de2-98fa-fe5a2da49434 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:49.843216 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c6a6-e66f-46c4-ba43-7e39e6498a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:49.852435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c6a6-e66f-46c4-ba43-7e39e6498a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:49.852435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c6a6-e66f-46c4-ba43-7e39e6498a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:49.852435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c6a6-e66f-46c4-ba43-7e39e6498a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:49.852435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c6a6-e66f-46c4-ba43-7e39e6498a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:49.852435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c6a6-e66f-46c4-ba43-7e39e6498a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:49.852435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c6a6-e66f-46c4-ba43-7e39e6498a0c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:49.864161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7215a37-e714-4bb4-8d14-4ec14728e439 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:49.869659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 858/1733] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:49.873114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594e41b-6aa6-4303-b3dc-d6b148dae700 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:49.875066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b5be5-b78b-4afa-a9b6-eb169dc42268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:49.875566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594e41b-6aa6-4303-b3dc-d6b148dae700 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:49.875719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b5be5-b78b-4afa-a9b6-eb169dc42268 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:49.875985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b5be5-b78b-4afa-a9b6-eb169dc42268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:49.876381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b5be5-b78b-4afa-a9b6-eb169dc42268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:49.876919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b5be5-b78b-4afa-a9b6-eb169dc42268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:49.878403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594e41b-6aa6-4303-b3dc-d6b148dae700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:49.878675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b5be5-b78b-4afa-a9b6-eb169dc42268 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:49.895768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 876/1734] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:49.896788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b5be5-b78b-4afa-a9b6-eb169dc42268 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:49.908777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b5be5-b78b-4afa-a9b6-eb169dc42268 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:49.915065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb19ede-1687-4239-8258-dc73771d10c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:49.916596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb19ede-1687-4239-8258-dc73771d10c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:49.916878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb19ede-1687-4239-8258-dc73771d10c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:49.917154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb19ede-1687-4239-8258-dc73771d10c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:49.918007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb19ede-1687-4239-8258-dc73771d10c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:49.918549 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b594e41b-6aa6-4303-b3dc-d6b148dae700 None None] MFA Rules not processed for user `67880641bc954088bef0b601a8410f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:49.919840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b594e41b-6aa6-4303-b3dc-d6b148dae700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:49.920154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb19ede-1687-4239-8258-dc73771d10c3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:49.988010 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 859/1735] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:49.999356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594e41b-6aa6-4303-b3dc-d6b148dae700 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:50.012384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594e41b-6aa6-4303-b3dc-d6b148dae700 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:50.017418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd71e2-2535-415c-949b-2d3c3c665f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:50.018490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd71e2-2535-415c-949b-2d3c3c665f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:50.018966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd71e2-2535-415c-949b-2d3c3c665f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:50.019410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd71e2-2535-415c-949b-2d3c3c665f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:50.020429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd71e2-2535-415c-949b-2d3c3c665f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:50.024483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd71e2-2535-415c-949b-2d3c3c665f43 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:50.040433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 860/1736] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:50.046330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd71e2-2535-415c-949b-2d3c3c665f43 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:50.049678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 877/1737] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:49 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:50.050853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb19ede-1687-4239-8258-dc73771d10c3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:50.054236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-80fd71e2-2535-415c-949b-2d3c3c665f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:50.073120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd71e2-2535-415c-949b-2d3c3c665f43 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:50.141605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb19ede-1687-4239-8258-dc73771d10c3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:50.148748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cb3fd-db94-4b11-9fcb-d871c0b0ac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:50.149991 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cb3fd-db94-4b11-9fcb-d871c0b0ac1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:50.150400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cb3fd-db94-4b11-9fcb-d871c0b0ac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:50.150741 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cb3fd-db94-4b11-9fcb-d871c0b0ac1f admin admin] PATH_INFO: `/v3/projects/23748fa315084b24b50f283eceb934b3/users/23d5e9d797114445849943562c69d50a/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:50.169237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647397-0038-4d12-a779-c4090408b6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:50.170076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647397-0038-4d12-a779-c4090408b6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:50.170448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647397-0038-4d12-a779-c4090408b6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:50.170821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647397-0038-4d12-a779-c4090408b6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:50.179773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cb3fd-db94-4b11-9fcb-d871c0b0ac1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23748fa315084b24b50f283eceb934b3, user_id=23d5e9d797114445849943562c69d50a, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:50.186335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0647397-0038-4d12-a779-c4090408b6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:50.186594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cb3fd-db94-4b11-9fcb-d871c0b0ac1f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:50.188310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0647397-0038-4d12-a779-c4090408b6f3 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:50.214804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 861/1738] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:50.216459 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647397-0038-4d12-a779-c4090408b6f3 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:50.236939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647397-0038-4d12-a779-c4090408b6f3 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:50.262175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bdad4-e2c4-4406-b87d-7d1487b5193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:50.262922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bdad4-e2c4-4406-b87d-7d1487b5193e admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:50.263150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bdad4-e2c4-4406-b87d-7d1487b5193e admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:50.263428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bdad4-e2c4-4406-b87d-7d1487b5193e admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:50.264550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bdad4-e2c4-4406-b87d-7d1487b5193e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:50.267899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bdad4-e2c4-4406-b87d-7d1487b5193e admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:50.320085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 878/1739] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:50 2022] PUT /identity/v3/projects/23748fa315084b24b50f283eceb934b3/users/23d5e9d797114445849943562c69d50a/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:50.325486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96b0fb-bef5-4ec2-b5b3-b3b1c314d6ba None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:50.325486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96b0fb-bef5-4ec2-b5b3-b3b1c314d6ba None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:50.325486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96b0fb-bef5-4ec2-b5b3-b3b1c314d6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:50.403149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 862/1740] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:50 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:50.404553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bdad4-e2c4-4406-b87d-7d1487b5193e admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:50.415153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-957bdad4-e2c4-4406-b87d-7d1487b5193e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:50.446040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-ed96b0fb-bef5-4ec2-b5b3-b3b1c314d6ba None None] MFA Rules not processed for user `912f4c5dd82a493ba2ea38244a6a8f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:50.447349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ed96b0fb-bef5-4ec2-b5b3-b3b1c314d6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:50.638454 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:50.672600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bdad4-e2c4-4406-b87d-7d1487b5193e admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:50.695513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 879/1741] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:50.695513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ba6a-2daa-457d-9c61-5b7e204195a8 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:50.695513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ba6a-2daa-457d-9c61-5b7e204195a8 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:50.695513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ba6a-2daa-457d-9c61-5b7e204195a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:50.799995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c902ba6a-2daa-457d-9c61-5b7e204195a8 None None] MFA Rules not processed for user `23d5e9d797114445849943562c69d50a`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:50.803284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c902ba6a-2daa-457d-9c61-5b7e204195a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:50.814797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:50.878677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2702656-578d-4549-957e-a91781f381a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:50.879325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702656-578d-4549-957e-a91781f381a6 service swift] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:50.879596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702656-578d-4549-957e-a91781f381a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:50.879868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702656-578d-4549-957e-a91781f381a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:51.001328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 880/1742] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:51.002268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902ba6a-2daa-457d-9c61-5b7e204195a8 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:51.004046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c902ba6a-2daa-457d-9c61-5b7e204195a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:51.007011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2702656-578d-4549-957e-a91781f381a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:51.009195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2702656-578d-4549-957e-a91781f381a6 service swift] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:51.051047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 863/1743] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:08:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:08:51.052385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2702656-578d-4549-957e-a91781f381a6 service swift] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:51.207506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902ba6a-2daa-457d-9c61-5b7e204195a8 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:51.229168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:51.230276 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:51.230705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:51.231126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] PATH_INFO: `/v3/projects/3df3c28aa5994fce86ca3df186232f3c` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:51.234025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df3c28aa5994fce86ca3df186232f3c)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:51.236180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:51.290289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2702656-578d-4549-957e-a91781f381a6 service swift] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:51.333252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5375-4442-4921-9c41-cb7a5df25cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:51.337789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5375-4442-4921-9c41-cb7a5df25cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:51.339799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5375-4442-4921-9c41-cb7a5df25cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:51.341086 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5375-4442-4921-9c41-cb7a5df25cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:51.342640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a5375-4442-4921-9c41-cb7a5df25cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:51.350427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a5375-4442-4921-9c41-cb7a5df25cbd admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:51.386858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 864/1744] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:51.389535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5375-4442-4921-9c41-cb7a5df25cbd admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:51.391913 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-221a5375-4442-4921-9c41-cb7a5df25cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:51.486610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df3c28aa5994fce86ca3df186232f3c', 'request_id': 'req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:51.615389 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df3c28aa5994fce86ca3df186232f3c', 'request_id': 'req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:51.623405 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:51.629694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df3c28aa5994fce86ca3df186232f3c', 'request_id': 'req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:51.681486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] The token cache is being invalidate because project 3df3c28aa5994fce86ca3df186232f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:08:51.683908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:51.687111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:51.697878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 881/1745] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:08:51 2022] DELETE /identity/v3/projects/3df3c28aa5994fce86ca3df186232f3c => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:51.701843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:51.707744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:51.814824 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5375-4442-4921-9c41-cb7a5df25cbd admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:52.039317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b2462-1dd4-4b95-b5b3-4d5f869396bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:52.040161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2462-1dd4-4b95-b5b3-4d5f869396bc service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:52.040452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2462-1dd4-4b95-b5b3-4d5f869396bc service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:52.040909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b2462-1dd4-4b95-b5b3-4d5f869396bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:52.044785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f82b2462-1dd4-4b95-b5b3-4d5f869396bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:52.062033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2eb68-1ca5-4bae-a539-53b9c2925bb8 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:52.106493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149c289-5202-475c-b378-8c751973adac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:52.106493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149c289-5202-475c-b378-8c751973adac admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:52.106493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149c289-5202-475c-b378-8c751973adac admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:52.106493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149c289-5202-475c-b378-8c751973adac admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:52.106893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149c289-5202-475c-b378-8c751973adac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:52.113432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149c289-5202-475c-b378-8c751973adac admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:52.315742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2462-1dd4-4b95-b5b3-4d5f869396bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:52.318510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b2462-1dd4-4b95-b5b3-4d5f869396bc service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:52.366908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 882/1746] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:51 2022] POST /identity/v3/projects => generated 367 bytes in 668 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:52.370974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149c289-5202-475c-b378-8c751973adac admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:52.374697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c149c289-5202-475c-b378-8c751973adac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:52.379441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 865/1747] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 992 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:52.383606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195739-9657-4df4-8e78-4e15d1007a44 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:52.384261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195739-9657-4df4-8e78-4e15d1007a44 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:52.384733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93195739-9657-4df4-8e78-4e15d1007a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:52.489815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-93195739-9657-4df4-8e78-4e15d1007a44 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:52.495797 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-93195739-9657-4df4-8e78-4e15d1007a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:52.579812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149c289-5202-475c-b378-8c751973adac admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:52.609497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d4b07-7527-4235-bd85-741183cd4dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:52.610219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d4b07-7527-4235-bd85-741183cd4dff admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:52.610517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d4b07-7527-4235-bd85-741183cd4dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:52.611108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d4b07-7527-4235-bd85-741183cd4dff admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:52.613726 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d4b07-7527-4235-bd85-741183cd4dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:52.617305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d4b07-7527-4235-bd85-741183cd4dff admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:52.650666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 883/1748] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:52.653708 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc158f-63f9-4b5a-b9d8-99a77c35c6dd None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:52.654085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc158f-63f9-4b5a-b9d8-99a77c35c6dd None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:52.655709 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc158f-63f9-4b5a-b9d8-99a77c35c6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:52.683075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 866/1749] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:52.684045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93195739-9657-4df4-8e78-4e15d1007a44 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:52.690822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-93195739-9657-4df4-8e78-4e15d1007a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:52.697636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-5abc158f-63f9-4b5a-b9d8-99a77c35c6dd None None] MFA Rules not processed for user `67880641bc954088bef0b601a8410f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:52.699070 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5abc158f-63f9-4b5a-b9d8-99a77c35c6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:52.727840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93195739-9657-4df4-8e78-4e15d1007a44 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:52.758084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:52.765644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:52.766030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:52.766319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] PATH_INFO: `/v3/users/198720f503cb4727936faf59064335ad` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:52.773691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=198720f503cb4727936faf59064335ad)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:52.780372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:52.830955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 884/1750] 10.222.0.75 () {58 vars in 1015 bytes} [Wed Sep 14 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:52.832180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe6a4-1fc9-4fa3-9ebe-c37bd7266073 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:52.832468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe6a4-1fc9-4fa3-9ebe-c37bd7266073 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:52.832734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe6a4-1fc9-4fa3-9ebe-c37bd7266073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:52.874852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-799fe6a4-1fc9-4fa3-9ebe-c37bd7266073 None None] MFA Rules not processed for user `88c79e3d1b6e46d6aa15f5f6e2b5498e`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:52.876137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-799fe6a4-1fc9-4fa3-9ebe-c37bd7266073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:53.210323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 885/1751] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:53.210323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe6a4-1fc9-4fa3-9ebe-c37bd7266073 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:53.210323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe6a4-1fc9-4fa3-9ebe-c37bd7266073 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:53.210323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c0ea7-6c70-4430-9cbb-4b2ffbbb7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:53.214057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c0ea7-6c70-4430-9cbb-4b2ffbbb7f97 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:53.214057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c0ea7-6c70-4430-9cbb-4b2ffbbb7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:53.214057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c0ea7-6c70-4430-9cbb-4b2ffbbb7f97 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:53.214057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c0ea7-6c70-4430-9cbb-4b2ffbbb7f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:53.214057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c0ea7-6c70-4430-9cbb-4b2ffbbb7f97 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:53.653241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 886/1752] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:52 2022] POST /identity/v3/users => generated 290 bytes in 671 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:53.654264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c0ea7-6c70-4430-9cbb-4b2ffbbb7f97 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:53.701850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c0ea7-6c70-4430-9cbb-4b2ffbbb7f97 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:53.709245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c48b8-f17b-47e9-b2ae-518ab18022ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:53.712885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c48b8-f17b-47e9-b2ae-518ab18022ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:53.713288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c48b8-f17b-47e9-b2ae-518ab18022ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:53.713740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c48b8-f17b-47e9-b2ae-518ab18022ee admin admin] PATH_INFO: `/v3/projects/672877d0ca71402e83a67b1fd1dceb8b/users/5b5fd7925d674fe3ac378ba89eb7fa5b/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:53.741238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c48b8-f17b-47e9-b2ae-518ab18022ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=672877d0ca71402e83a67b1fd1dceb8b, user_id=5b5fd7925d674fe3ac378ba89eb7fa5b, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:53.745874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '198720f503cb4727936faf59064335ad'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:53.750595 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c48b8-f17b-47e9-b2ae-518ab18022ee admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:53.760102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:53.775535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '198720f503cb4727936faf59064335ad'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:53.811314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '198720f503cb4727936faf59064335ad'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:53.900949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '198720f503cb4727936faf59064335ad'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:53.901643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-dd33ac18-5ded-4be4-99aa-942f130ffb27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '198720f503cb4727936faf59064335ad'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:53.912237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 867/1753] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:52 2022] DELETE /identity/v3/users/198720f503cb4727936faf59064335ad => generated 0 bytes in 1226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:53.912237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4bc5e-e88d-4f3b-84b1-7a5a6ba5a469 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:53.912237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4bc5e-e88d-4f3b-84b1-7a5a6ba5a469 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:53.912237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4bc5e-e88d-4f3b-84b1-7a5a6ba5a469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:53.921671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 887/1754] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:53 2022] PUT /identity/v3/projects/672877d0ca71402e83a67b1fd1dceb8b/users/5b5fd7925d674fe3ac378ba89eb7fa5b/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:53.921671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c48b8-f17b-47e9-b2ae-518ab18022ee admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:53.927383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e74c48b8-f17b-47e9-b2ae-518ab18022ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:53.985978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-61e4bc5e-e88d-4f3b-84b1-7a5a6ba5a469 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:53.988607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-61e4bc5e-e88d-4f3b-84b1-7a5a6ba5a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:54.041099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c48b8-f17b-47e9-b2ae-518ab18022ee admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:54.099862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 868/1755] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:54.101348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4bc5e-e88d-4f3b-84b1-7a5a6ba5a469 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:54.109175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-61e4bc5e-e88d-4f3b-84b1-7a5a6ba5a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:54.128405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4bc5e-e88d-4f3b-84b1-7a5a6ba5a469 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:54.138664 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21995201-9f02-4ff9-8e9e-4b99e4295c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:54.139302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21995201-9f02-4ff9-8e9e-4b99e4295c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:54.139586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21995201-9f02-4ff9-8e9e-4b99e4295c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:54.139856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21995201-9f02-4ff9-8e9e-4b99e4295c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:54.140518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21995201-9f02-4ff9-8e9e-4b99e4295c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:54.142137 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21995201-9f02-4ff9-8e9e-4b99e4295c3f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:54.182509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 869/1756] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:54.184791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb817951-7ff5-4f99-974f-53386db0e97b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:54.185076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb817951-7ff5-4f99-974f-53386db0e97b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:54.185361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb817951-7ff5-4f99-974f-53386db0e97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:54.188470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:54.205213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1078d4-229d-40bc-8d34-88a634d66400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:54.205969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1078d4-229d-40bc-8d34-88a634d66400 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:54.206573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1078d4-229d-40bc-8d34-88a634d66400 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:54.206851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1078d4-229d-40bc-8d34-88a634d66400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:54.209653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ae1078d4-229d-40bc-8d34-88a634d66400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:54.229351 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-eb817951-7ff5-4f99-974f-53386db0e97b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:54.233791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-eb817951-7ff5-4f99-974f-53386db0e97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:54.257526 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 870/1757] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:54.258995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da209f04-1d4e-4cd4-b1b7-f8dcf61797cb None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:54.259447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da209f04-1d4e-4cd4-b1b7-f8dcf61797cb None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:54.259738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1078d4-229d-40bc-8d34-88a634d66400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:54.259859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da209f04-1d4e-4cd4-b1b7-f8dcf61797cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:54.262563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1078d4-229d-40bc-8d34-88a634d66400 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:54.292540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 888/1758] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:54.293485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1078d4-229d-40bc-8d34-88a634d66400 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:54.331212 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1078d4-229d-40bc-8d34-88a634d66400 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:54.355694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6f2fc-5b22-43eb-91d3-a8f4faf5d9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:54.355694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f2fc-5b22-43eb-91d3-a8f4faf5d9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:54.355694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f2fc-5b22-43eb-91d3-a8f4faf5d9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:54.355694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f2fc-5b22-43eb-91d3-a8f4faf5d9c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:54.360271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6f2fc-5b22-43eb-91d3-a8f4faf5d9c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:08:54.360592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6f2fc-5b22-43eb-91d3-a8f4faf5d9c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:54.363193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6f2fc-5b22-43eb-91d3-a8f4faf5d9c4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:54.365314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-da209f04-1d4e-4cd4-b1b7-f8dcf61797cb None None] MFA Rules not processed for user `5b5fd7925d674fe3ac378ba89eb7fa5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:54.367156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-da209f04-1d4e-4cd4-b1b7-f8dcf61797cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:54.416418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 889/1759] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:08:54.417412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6f2fc-5b22-43eb-91d3-a8f4faf5d9c4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:54.441617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6f2fc-5b22-43eb-91d3-a8f4faf5d9c4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:54.447071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fa074-b1cf-452d-bfe7-a0b257319eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:54.447746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fa074-b1cf-452d-bfe7-a0b257319eda admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:54.448122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fa074-b1cf-452d-bfe7-a0b257319eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:54.448401 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fa074-b1cf-452d-bfe7-a0b257319eda admin admin] PATH_INFO: `/v3/projects/8a4df64056d34705a69eda8535226180/users/e13100b9c8bc4f5da98f9741404d5908/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:54.482658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fa074-b1cf-452d-bfe7-a0b257319eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4df64056d34705a69eda8535226180, user_id=e13100b9c8bc4f5da98f9741404d5908, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:54.486474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fa074-b1cf-452d-bfe7-a0b257319eda admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:54.618106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 890/1760] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:54 2022] PUT /identity/v3/projects/8a4df64056d34705a69eda8535226180/users/e13100b9c8bc4f5da98f9741404d5908/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:54.618106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fa074-b1cf-452d-bfe7-a0b257319eda admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:54.736601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 871/1761] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:54.737990 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da209f04-1d4e-4cd4-b1b7-f8dcf61797cb None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:54.757467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da209f04-1d4e-4cd4-b1b7-f8dcf61797cb None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:54.853158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fa074-b1cf-452d-bfe7-a0b257319eda admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:54.860504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985b5f3-0dd3-4239-a659-20793a4e197e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:54.861148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985b5f3-0dd3-4239-a659-20793a4e197e service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:54.861486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985b5f3-0dd3-4239-a659-20793a4e197e service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:54.861773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985b5f3-0dd3-4239-a659-20793a4e197e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:54.877721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3ff50-cbb4-4c6e-8a13-e0d69ae0164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:54.878701 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3ff50-cbb4-4c6e-8a13-e0d69ae0164c admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:54.879247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3ff50-cbb4-4c6e-8a13-e0d69ae0164c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:54.879789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3ff50-cbb4-4c6e-8a13-e0d69ae0164c admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:54.880696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3ff50-cbb4-4c6e-8a13-e0d69ae0164c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:54.883755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3ff50-cbb4-4c6e-8a13-e0d69ae0164c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:55.032059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985b5f3-0dd3-4239-a659-20793a4e197e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:55.052026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 872/1762] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:54 2022] POST /identity/v3/projects => generated 385 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:55.052655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3ff50-cbb4-4c6e-8a13-e0d69ae0164c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:55.070152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985b5f3-0dd3-4239-a659-20793a4e197e service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:55.108429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 891/1763] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:55.110428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985b5f3-0dd3-4239-a659-20793a4e197e service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:55.119912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9985b5f3-0dd3-4239-a659-20793a4e197e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:55.184545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985b5f3-0dd3-4239-a659-20793a4e197e service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:55.310521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3ff50-cbb4-4c6e-8a13-e0d69ae0164c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:55.335284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb049f-5719-438e-8281-e6365a10a98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:55.336224 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb049f-5719-438e-8281-e6365a10a98f admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:55.337051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb049f-5719-438e-8281-e6365a10a98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:55.337051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb049f-5719-438e-8281-e6365a10a98f admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:55.337952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb049f-5719-438e-8281-e6365a10a98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:55.343024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb049f-5719-438e-8281-e6365a10a98f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:55.347372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fed1ce-528c-401e-a7df-c5559a06775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:55.348370 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fed1ce-528c-401e-a7df-c5559a06775d admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:55.348370 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fed1ce-528c-401e-a7df-c5559a06775d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:55.348641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fed1ce-528c-401e-a7df-c5559a06775d admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:55.349244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fed1ce-528c-401e-a7df-c5559a06775d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:55.363342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fed1ce-528c-401e-a7df-c5559a06775d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:55.386413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 873/1764] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:55.388957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb049f-5719-438e-8281-e6365a10a98f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:55.423809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb049f-5719-438e-8281-e6365a10a98f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:55.430148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0b226-ba8f-4ed9-a883-fd9936d6f597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:55.431040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b226-ba8f-4ed9-a883-fd9936d6f597 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:55.431467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b226-ba8f-4ed9-a883-fd9936d6f597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:55.431876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0b226-ba8f-4ed9-a883-fd9936d6f597 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:55.432643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0b226-ba8f-4ed9-a883-fd9936d6f597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:55.435002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0b226-ba8f-4ed9-a883-fd9936d6f597 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:55.558488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 892/1765] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:55 2022] POST /identity/v3/projects => generated 379 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:55.558488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fed1ce-528c-401e-a7df-c5559a06775d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:55.605651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 874/1766] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:55 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:55.613196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0b226-ba8f-4ed9-a883-fd9936d6f597 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:55.716001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0b226-ba8f-4ed9-a883-fd9936d6f597 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:55.765300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fed1ce-528c-401e-a7df-c5559a06775d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:55.776423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca013d70-adb7-4704-8c39-cec2c0a5b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:55.778058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca013d70-adb7-4704-8c39-cec2c0a5b4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:55.778574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca013d70-adb7-4704-8c39-cec2c0a5b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:55.778994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca013d70-adb7-4704-8c39-cec2c0a5b4c6 admin admin] PATH_INFO: `/v3/projects/8a4df64056d34705a69eda8535226180/users/e13100b9c8bc4f5da98f9741404d5908/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:55.781712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca013d70-adb7-4704-8c39-cec2c0a5b4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4df64056d34705a69eda8535226180, user_id=e13100b9c8bc4f5da98f9741404d5908, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:55.785986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca013d70-adb7-4704-8c39-cec2c0a5b4c6 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:55.851507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 893/1767] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:55 2022] PUT /identity/v3/projects/8a4df64056d34705a69eda8535226180/users/e13100b9c8bc4f5da98f9741404d5908/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:55.853134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca013d70-adb7-4704-8c39-cec2c0a5b4c6 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:55.984317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bb328-0063-4c8a-b189-a08b138f44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:55.987159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bb328-0063-4c8a-b189-a08b138f44ff admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:55.987739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bb328-0063-4c8a-b189-a08b138f44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:55.988368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bb328-0063-4c8a-b189-a08b138f44ff admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:56.007726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bb328-0063-4c8a-b189-a08b138f44ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:56.015617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bb328-0063-4c8a-b189-a08b138f44ff admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:56.080837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca013d70-adb7-4704-8c39-cec2c0a5b4c6 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:56.096143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90305bc-fbb8-4c60-9b79-3376f3ca19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:56.096908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90305bc-fbb8-4c60-9b79-3376f3ca19f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:56.097254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90305bc-fbb8-4c60-9b79-3376f3ca19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:56.097687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90305bc-fbb8-4c60-9b79-3376f3ca19f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:56.098435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90305bc-fbb8-4c60-9b79-3376f3ca19f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:56.101847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90305bc-fbb8-4c60-9b79-3376f3ca19f9 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:56.152217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 875/1768] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:55 2022] POST /identity/v3/users => generated 296 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:56.153866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8c844-ee34-48b0-8f22-0fd8217ad002 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:56.154149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8c844-ee34-48b0-8f22-0fd8217ad002 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:56.154444 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8c844-ee34-48b0-8f22-0fd8217ad002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:56.160085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 894/1769] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:56.161025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90305bc-fbb8-4c60-9b79-3376f3ca19f9 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:56.204154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90305bc-fbb8-4c60-9b79-3376f3ca19f9 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:56.222802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5a0c3-3522-4c3f-94e0-963ce84de89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:56.224734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5a0c3-3522-4c3f-94e0-963ce84de89b admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:56.226189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5a0c3-3522-4c3f-94e0-963ce84de89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:56.226492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5a0c3-3522-4c3f-94e0-963ce84de89b admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:56.228707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5a0c3-3522-4c3f-94e0-963ce84de89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:56.233924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5a0c3-3522-4c3f-94e0-963ce84de89b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:56.261497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-0fc8c844-ee34-48b0-8f22-0fd8217ad002 None None] MFA Rules not processed for user `e13100b9c8bc4f5da98f9741404d5908`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:56.271429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0fc8c844-ee34-48b0-8f22-0fd8217ad002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:56.271576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 895/1770] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:56.273672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5a0c3-3522-4c3f-94e0-963ce84de89b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:56.306631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5a0c3-3522-4c3f-94e0-963ce84de89b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:56.313956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cda6b-c4b4-4ecf-ab19-54dee82f772e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:56.315576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cda6b-c4b4-4ecf-ab19-54dee82f772e admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:56.315882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cda6b-c4b4-4ecf-ab19-54dee82f772e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:56.316193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cda6b-c4b4-4ecf-ab19-54dee82f772e admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:56.316936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cda6b-c4b4-4ecf-ab19-54dee82f772e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:56.319140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cda6b-c4b4-4ecf-ab19-54dee82f772e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:56.339045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 896/1771] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:56.340001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cda6b-c4b4-4ecf-ab19-54dee82f772e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:56.353483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cda6b-c4b4-4ecf-ab19-54dee82f772e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:56.369426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5b5f-823c-4130-b5a0-8c0e796baee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:56.371162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5b5f-823c-4130-b5a0-8c0e796baee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:56.373612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5b5f-823c-4130-b5a0-8c0e796baee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:56.373939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5b5f-823c-4130-b5a0-8c0e796baee1 admin admin] PATH_INFO: `/v3/projects/5ad22ada448846cd80215d3df54b3cfc/users/19b86a53a20644bcacd280b2db893ea4/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:56.459952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a5b5f-823c-4130-b5a0-8c0e796baee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad22ada448846cd80215d3df54b3cfc, user_id=19b86a53a20644bcacd280b2db893ea4, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:56.467429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a5b5f-823c-4130-b5a0-8c0e796baee1 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:56.545840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 876/1772] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:56.554738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8c844-ee34-48b0-8f22-0fd8217ad002 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:56.603268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8c844-ee34-48b0-8f22-0fd8217ad002 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:56.622987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e070a-b15c-4fa8-80fa-78af20e92bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:56.623680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e070a-b15c-4fa8-80fa-78af20e92bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:56.623968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e070a-b15c-4fa8-80fa-78af20e92bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:56.624246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e070a-b15c-4fa8-80fa-78af20e92bd3 admin admin] PATH_INFO: `/v3/projects/59ebe1bccad5484ab1454308f9579cdd/users/bba50044cd2e411c853d73310df3a98b/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:56.673129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e070a-b15c-4fa8-80fa-78af20e92bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ebe1bccad5484ab1454308f9579cdd, user_id=bba50044cd2e411c853d73310df3a98b, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:56.675718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e070a-b15c-4fa8-80fa-78af20e92bd3 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:56.691221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 897/1773] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:56 2022] PUT /identity/v3/projects/5ad22ada448846cd80215d3df54b3cfc/users/19b86a53a20644bcacd280b2db893ea4/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:56.696920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5b5f-823c-4130-b5a0-8c0e796baee1 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:56.703501 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-290a5b5f-823c-4130-b5a0-8c0e796baee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:56.828749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 877/1774] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:56 2022] PUT /identity/v3/projects/59ebe1bccad5484ab1454308f9579cdd/users/bba50044cd2e411c853d73310df3a98b/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:56.829879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e070a-b15c-4fa8-80fa-78af20e92bd3 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:56.958684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5b5f-823c-4130-b5a0-8c0e796baee1 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:57.039786 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e070a-b15c-4fa8-80fa-78af20e92bd3 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:57.078918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2be7a-4fb2-4e1b-9b70-2b058b72a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:57.083227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2be7a-4fb2-4e1b-9b70-2b058b72a16a admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:57.083517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2be7a-4fb2-4e1b-9b70-2b058b72a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:57.083801 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2be7a-4fb2-4e1b-9b70-2b058b72a16a admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:57.102453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2be7a-4fb2-4e1b-9b70-2b058b72a16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:57.116230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2be7a-4fb2-4e1b-9b70-2b058b72a16a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:57.119426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563b352-779d-45dd-8dcc-8cfc7def5dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:57.120109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563b352-779d-45dd-8dcc-8cfc7def5dfc service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:57.120452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563b352-779d-45dd-8dcc-8cfc7def5dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:57.120800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563b352-779d-45dd-8dcc-8cfc7def5dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:57.156653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 878/1775] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:57.160089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b743-8bf0-473c-9385-c921754bd194 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:57.160205 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b743-8bf0-473c-9385-c921754bd194 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:57.160469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b743-8bf0-473c-9385-c921754bd194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:57.250370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-08a9b743-8bf0-473c-9385-c921754bd194 None None] MFA Rules not processed for user `bba50044cd2e411c853d73310df3a98b`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:57.253125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:57.254237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-08a9b743-8bf0-473c-9385-c921754bd194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:57.375992 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563b352-779d-45dd-8dcc-8cfc7def5dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:57.378857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563b352-779d-45dd-8dcc-8cfc7def5dfc service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:57.393360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 898/1776] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:57.394760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563b352-779d-45dd-8dcc-8cfc7def5dfc service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:57.408995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563b352-779d-45dd-8dcc-8cfc7def5dfc service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:57.416802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be19ca-c31e-4153-bf41-5cdc9ac776fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:57.418295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be19ca-c31e-4153-bf41-5cdc9ac776fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:57.418923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be19ca-c31e-4153-bf41-5cdc9ac776fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:57.419877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be19ca-c31e-4153-bf41-5cdc9ac776fa admin admin] PATH_INFO: `/v3/projects/5ad22ada448846cd80215d3df54b3cfc/users/19b86a53a20644bcacd280b2db893ea4/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:57.422706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be19ca-c31e-4153-bf41-5cdc9ac776fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad22ada448846cd80215d3df54b3cfc, user_id=19b86a53a20644bcacd280b2db893ea4, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:57.429037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be19ca-c31e-4153-bf41-5cdc9ac776fa admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:57.436486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 879/1777] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:57.436486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9b743-8bf0-473c-9385-c921754bd194 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:57.436486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-08a9b743-8bf0-473c-9385-c921754bd194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:57.444628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 899/1778] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:57 2022] PUT /identity/v3/projects/5ad22ada448846cd80215d3df54b3cfc/users/19b86a53a20644bcacd280b2db893ea4/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:57.454322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be19ca-c31e-4153-bf41-5cdc9ac776fa admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:57.454716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9b743-8bf0-473c-9385-c921754bd194 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:57.669618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be19ca-c31e-4153-bf41-5cdc9ac776fa admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:57.675428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6066fb2-8500-4ee2-8f87-8606641de7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:57.676304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6066fb2-8500-4ee2-8f87-8606641de7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:57.676795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6066fb2-8500-4ee2-8f87-8606641de7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:57.676936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6066fb2-8500-4ee2-8f87-8606641de7d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:57.677507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6066fb2-8500-4ee2-8f87-8606641de7d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:57.680450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6066fb2-8500-4ee2-8f87-8606641de7d7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:57.681105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:57.683232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:57.684509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:57.685845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] PATH_INFO: `/v3/projects/86f26d3eecc44f83bab200f4be380319` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:57.687656 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f26d3eecc44f83bab200f4be380319)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:57.690331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:57.915073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 900/1779] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:57 2022] POST /identity/v3/projects => generated 387 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:57.915073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e9b96-4aef-42ca-a8ed-f1f73161bfa0 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:57.915073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e9b96-4aef-42ca-a8ed-f1f73161bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:57.915073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e9b96-4aef-42ca-a8ed-f1f73161bfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:57.924988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f26d3eecc44f83bab200f4be380319', 'request_id': 'req-f899b494-c848-4edc-9660-d42ddf64ddf1'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:57.935032 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f26d3eecc44f83bab200f4be380319', 'request_id': 'req-f899b494-c848-4edc-9660-d42ddf64ddf1'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:57.947225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f26d3eecc44f83bab200f4be380319', 'request_id': 'req-f899b494-c848-4edc-9660-d42ddf64ddf1'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:57.987013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-468e9b96-4aef-42ca-a8ed-f1f73161bfa0 None None] MFA Rules not processed for user `19b86a53a20644bcacd280b2db893ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:57.989170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-468e9b96-4aef-42ca-a8ed-f1f73161bfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:58.045098 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:08:58.124803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] The token cache is being invalidate because project 86f26d3eecc44f83bab200f4be380319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:08:58.138287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:58.138287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f899b494-c848-4edc-9660-d42ddf64ddf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:58.138287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 880/1780] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:08:57 2022] DELETE /identity/v3/projects/86f26d3eecc44f83bab200f4be380319 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:58.143678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41d1ba-7cb8-4cfc-8cba-b117372b1fe3 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:58.143991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41d1ba-7cb8-4cfc-8cba-b117372b1fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:58.144235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41d1ba-7cb8-4cfc-8cba-b117372b1fe3 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:58.149169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 881/1781] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:08:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:08:58.150005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41d1ba-7cb8-4cfc-8cba-b117372b1fe3 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:58.153861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 901/1782] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:58.155871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e9b96-4aef-42ca-a8ed-f1f73161bfa0 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:58.158648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ab41d1ba-7cb8-4cfc-8cba-b117372b1fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:58.269548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e9b96-4aef-42ca-a8ed-f1f73161bfa0 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:58.281074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:58.282672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:58.282968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:58.283280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] PATH_INFO: `/v3/users/0587ea75cd8a495095b5d35b3ba1012a` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:58.285076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0587ea75cd8a495095b5d35b3ba1012a)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:58.287428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:58.314764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41d1ba-7cb8-4cfc-8cba-b117372b1fe3 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:58.326612 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c01bd-084c-4be0-b417-19bb074ee226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:58.327322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c01bd-084c-4be0-b417-19bb074ee226 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:58.327525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c01bd-084c-4be0-b417-19bb074ee226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:58.327801 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c01bd-084c-4be0-b417-19bb074ee226 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:58.329714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c01bd-084c-4be0-b417-19bb074ee226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:58.331655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c01bd-084c-4be0-b417-19bb074ee226 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:58.476895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 882/1783] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:08:58 2022] POST /identity/v3/users => generated 294 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:08:58.476895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c01bd-084c-4be0-b417-19bb074ee226 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:58.481676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e28c01bd-084c-4be0-b417-19bb074ee226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:58.621350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c01bd-084c-4be0-b417-19bb074ee226 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:58.628924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0587ea75cd8a495095b5d35b3ba1012a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:58.629902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0587ea75cd8a495095b5d35b3ba1012a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:58.633991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045efd0-57e9-44fd-b1d6-8ebbe6ce22fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:58.636535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045efd0-57e9-44fd-b1d6-8ebbe6ce22fc service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:58.644042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045efd0-57e9-44fd-b1d6-8ebbe6ce22fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:58.644579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045efd0-57e9-44fd-b1d6-8ebbe6ce22fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:58.648762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9045efd0-57e9-44fd-b1d6-8ebbe6ce22fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:58.651716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0587ea75cd8a495095b5d35b3ba1012a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:58.681747 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045efd0-57e9-44fd-b1d6-8ebbe6ce22fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:58.683671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045efd0-57e9-44fd-b1d6-8ebbe6ce22fc service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:58.685863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0587ea75cd8a495095b5d35b3ba1012a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:58.687440 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0587ea75cd8a495095b5d35b3ba1012a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:08:58.705272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 883/1784] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:58.706738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe2222-fb1f-4450-aca5-29173664b874 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:58.707026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe2222-fb1f-4450-aca5-29173664b874 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:58.707308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe2222-fb1f-4450-aca5-29173664b874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:58.754781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6cbe2222-fb1f-4450-aca5-29173664b874 None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:58.756219 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6cbe2222-fb1f-4450-aca5-29173664b874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:58.883677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 902/1785] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:58 2022] DELETE /identity/v3/users/0587ea75cd8a495095b5d35b3ba1012a => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:58.891877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:58.891877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:58.895804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 884/1786] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:08:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:58.898539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d23d-02ae-4a9f-9f07-26767419d479 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:58.899098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d23d-02ae-4a9f-9f07-26767419d479 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:58.899449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d23d-02ae-4a9f-9f07-26767419d479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:58.938094 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-d054d23d-02ae-4a9f-9f07-26767419d479 None None] MFA Rules not processed for user `912f4c5dd82a493ba2ea38244a6a8f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:58.939668 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d054d23d-02ae-4a9f-9f07-26767419d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:59.050835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 885/1787] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:59.050835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d23d-02ae-4a9f-9f07-26767419d479 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:59.051324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d054d23d-02ae-4a9f-9f07-26767419d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:59.076176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39d97-dad1-4a23-81cb-e949e0390fe6 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:59.094285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8865f-197e-40b6-8837-b9b6a9027ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:59.095298 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8865f-197e-40b6-8837-b9b6a9027ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:59.095811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8865f-197e-40b6-8837-b9b6a9027ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:59.096240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8865f-197e-40b6-8837-b9b6a9027ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:59.100055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8865f-197e-40b6-8837-b9b6a9027ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:59.107429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8865f-197e-40b6-8837-b9b6a9027ea7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:59.136885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 903/1788] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:59.138923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8865f-197e-40b6-8837-b9b6a9027ea7 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:59.160694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8865f-197e-40b6-8837-b9b6a9027ea7 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:59.175253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f276c-fb5c-4587-9b9d-ea23004b04bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:59.176724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f276c-fb5c-4587-9b9d-ea23004b04bc admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:59.177031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f276c-fb5c-4587-9b9d-ea23004b04bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:59.177352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f276c-fb5c-4587-9b9d-ea23004b04bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:59.179574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f276c-fb5c-4587-9b9d-ea23004b04bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:59.184439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f276c-fb5c-4587-9b9d-ea23004b04bc admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:59.205050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 904/1789] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:08:59.206192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f276c-fb5c-4587-9b9d-ea23004b04bc admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:59.238167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d23d-02ae-4a9f-9f07-26767419d479 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:59.241793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f276c-fb5c-4587-9b9d-ea23004b04bc admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:59.259364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9770d10-7f6b-4f6e-93c2-1bd92606c026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:59.260261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9770d10-7f6b-4f6e-93c2-1bd92606c026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:59.260544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9770d10-7f6b-4f6e-93c2-1bd92606c026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:59.260844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9770d10-7f6b-4f6e-93c2-1bd92606c026 admin admin] PATH_INFO: `/v3/projects/5686ddcfc19d480f8a881460770f3d3b/users/3cf4e69040934a068d7542ddbc02e993/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:59.267636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ac662-097d-4f57-92a8-b184a45085b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:59.269210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac662-097d-4f57-92a8-b184a45085b8 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:59.270070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac662-097d-4f57-92a8-b184a45085b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:59.270786 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac662-097d-4f57-92a8-b184a45085b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:59.297209 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ac662-097d-4f57-92a8-b184a45085b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:59.299965 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ac662-097d-4f57-92a8-b184a45085b8 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:59.318803 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9770d10-7f6b-4f6e-93c2-1bd92606c026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5686ddcfc19d480f8a881460770f3d3b, user_id=3cf4e69040934a068d7542ddbc02e993, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:59.323045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9770d10-7f6b-4f6e-93c2-1bd92606c026 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:08:59.333696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 886/1790] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:08:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:08:59.474157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 905/1791] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:08:59 2022] PUT /identity/v3/projects/5686ddcfc19d480f8a881460770f3d3b/users/3cf4e69040934a068d7542ddbc02e993/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:08:59.487049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb042-19d9-41e4-8e27-9d9fff3119af None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:59.487390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb042-19d9-41e4-8e27-9d9fff3119af None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:59.487720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb042-19d9-41e4-8e27-9d9fff3119af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:59.571914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-4a6fb042-19d9-41e4-8e27-9d9fff3119af None None] MFA Rules not processed for user `3cf4e69040934a068d7542ddbc02e993`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:08:59.573215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4a6fb042-19d9-41e4-8e27-9d9fff3119af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:59.786707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 887/1792] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:08:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:08:59.788449 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9770d10-7f6b-4f6e-93c2-1bd92606c026 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:59.839120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fb042-19d9-41e4-8e27-9d9fff3119af None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:08:59.842019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4a6fb042-19d9-41e4-8e27-9d9fff3119af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:08:59.947134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9770d10-7f6b-4f6e-93c2-1bd92606c026 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:08:59.961173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b5f00-2a9b-44f8-81c3-37e40ecd4c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:08:59.962030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5f00-2a9b-44f8-81c3-37e40ecd4c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:08:59.962416 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5f00-2a9b-44f8-81c3-37e40ecd4c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:08:59.962767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5f00-2a9b-44f8-81c3-37e40ecd4c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:08:59.963494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b5f00-2a9b-44f8-81c3-37e40ecd4c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:08:59.965561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b5f00-2a9b-44f8-81c3-37e40ecd4c3c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:00.018166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fb042-19d9-41e4-8e27-9d9fff3119af None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:00.044998 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:00.048785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:00.049591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:00.050527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] PATH_INFO: `/v3/users/23d5e9d797114445849943562c69d50a` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:00.054622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d5e9d797114445849943562c69d50a)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:00.062650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:00.117348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 906/1793] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:08:59 2022] POST /identity/v3/projects => generated 385 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:00.118133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b5f00-2a9b-44f8-81c3-37e40ecd4c3c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:00.121353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ea4b5f00-2a9b-44f8-81c3-37e40ecd4c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:00.219947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b5f00-2a9b-44f8-81c3-37e40ecd4c3c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:00.227470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:00.228450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:00.228967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:00.229468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] PATH_INFO: `/v3/projects/16fa6c90f1b648c9873db930c1326694` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:00.230960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=16fa6c90f1b648c9873db930c1326694)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:00.233273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:00.559695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d5e9d797114445849943562c69d50a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:00.560807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16fa6c90f1b648c9873db930c1326694', 'request_id': 'req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:00.573377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d5e9d797114445849943562c69d50a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:00.586539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d5e9d797114445849943562c69d50a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:00.682833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16fa6c90f1b648c9873db930c1326694', 'request_id': 'req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:00.692024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16fa6c90f1b648c9873db930c1326694', 'request_id': 'req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:00.710420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] The token cache is being invalidate because project 16fa6c90f1b648c9873db930c1326694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:00.711069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:00.712011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:00.713894 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 907/1794] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:00 2022] DELETE /identity/v3/projects/16fa6c90f1b648c9873db930c1326694 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:00.714540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:00.715899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:00.769071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d5e9d797114445849943562c69d50a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:00.769724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d5e9d797114445849943562c69d50a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:00.777588 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 888/1795] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:08:59 2022] DELETE /identity/v3/users/23d5e9d797114445849943562c69d50a => generated 0 bytes in 939 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:00.779510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:00.783552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:00.912674 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30006c44-aab4-4ab1-b63c-c841e8e4ade3 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:00.933381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8185-a486-4045-b1a3-51ba8c39ce1a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:00.948220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:00.948220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e0044-3fb7-49fc-aab1-31aaa843a650 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19b86a53a20644bcacd280b2db893ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ad22ada448846cd80215d3df54b3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:00.948220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0044-3fb7-49fc-aab1-31aaa843a650 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:00.949061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0044-3fb7-49fc-aab1-31aaa843a650 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:00.949061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0044-3fb7-49fc-aab1-31aaa843a650 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:00.949061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e0044-3fb7-49fc-aab1-31aaa843a650 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:00.949061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e0044-3fb7-49fc-aab1-31aaa843a650 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:00.950492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e0044-3fb7-49fc-aab1-31aaa843a650 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:00.977197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 889/1796] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:00.978671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6bb69-7a39-4841-a639-a039c72eef79 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:00.979316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6bb69-7a39-4841-a639-a039c72eef79 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:00.979958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6bb69-7a39-4841-a639-a039c72eef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:01.047082 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-e4e6bb69-7a39-4841-a639-a039c72eef79 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:01.048730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e4e6bb69-7a39-4841-a639-a039c72eef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:01.116858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a281e2-2e27-4157-911a-83e297ddf7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:01.117536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a281e2-2e27-4157-911a-83e297ddf7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:01.117858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a281e2-2e27-4157-911a-83e297ddf7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:01.118090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a281e2-2e27-4157-911a-83e297ddf7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:01.118812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a281e2-2e27-4157-911a-83e297ddf7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:01.121514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a281e2-2e27-4157-911a-83e297ddf7a8 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:01.178335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 890/1797] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:01.180669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d317b-7e87-49d5-b3d5-df9970ca4311 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:01.195044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d317b-7e87-49d5-b3d5-df9970ca4311 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:01.195044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d317b-7e87-49d5-b3d5-df9970ca4311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:01.223957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-4c5d317b-7e87-49d5-b3d5-df9970ca4311 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:01.225934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4c5d317b-7e87-49d5-b3d5-df9970ca4311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:01.243009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 891/1798] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:01.250005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d317b-7e87-49d5-b3d5-df9970ca4311 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:01.264941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d317b-7e87-49d5-b3d5-df9970ca4311 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:01.271114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed32ba0-21e7-4c5a-840f-c27dd71b779d tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19b86a53a20644bcacd280b2db893ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ad22ada448846cd80215d3df54b3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:01.272668 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed32ba0-21e7-4c5a-840f-c27dd71b779d tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:01.273393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed32ba0-21e7-4c5a-840f-c27dd71b779d tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:01.273958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed32ba0-21e7-4c5a-840f-c27dd71b779d tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:01.275141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed32ba0-21e7-4c5a-840f-c27dd71b779d tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:01.277605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed32ba0-21e7-4c5a-840f-c27dd71b779d tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:01.334146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 908/1799] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:00 2022] POST /identity/v3/users => generated 299 bytes in 616 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:01.334146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8431-6851-41ab-833c-021e32ed0ae8 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:01.334146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8431-6851-41ab-833c-021e32ed0ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:01.334146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f8431-6851-41ab-833c-021e32ed0ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:01.404531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d58f8431-6851-41ab-833c-021e32ed0ae8 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:01.405865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d58f8431-6851-41ab-833c-021e32ed0ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:01.437140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 909/1800] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:01.438124 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f8431-6851-41ab-833c-021e32ed0ae8 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:01.440424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 892/1801] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:01 2022] POST /identity/v3/projects => generated 354 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:01.441359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed32ba0-21e7-4c5a-840f-c27dd71b779d tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:01.445245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d58f8431-6851-41ab-833c-021e32ed0ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:01.446982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0ed32ba0-21e7-4c5a-840f-c27dd71b779d tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:01.605322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:01.645687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f8431-6851-41ab-833c-021e32ed0ae8 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:01.654926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed32ba0-21e7-4c5a-840f-c27dd71b779d tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:01.661213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd2d3e-7cc9-4302-b623-435b88472548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:01.662087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2d3e-7cc9-4302-b623-435b88472548 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:01.663309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2d3e-7cc9-4302-b623-435b88472548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:01.663739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2d3e-7cc9-4302-b623-435b88472548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:01.665513 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd2d3e-7cc9-4302-b623-435b88472548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:01.667696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd2d3e-7cc9-4302-b623-435b88472548 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:01.691092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 893/1802] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:01.692230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd2d3e-7cc9-4302-b623-435b88472548 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:01.704753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd2d3e-7cc9-4302-b623-435b88472548 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:01.717315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf1087-f9ed-40b4-b90d-5713fff92c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:01.718322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf1087-f9ed-40b4-b90d-5713fff92c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:01.718742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf1087-f9ed-40b4-b90d-5713fff92c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:01.719156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf1087-f9ed-40b4-b90d-5713fff92c0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:01.719964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf1087-f9ed-40b4-b90d-5713fff92c0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:01.721049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf1087-f9ed-40b4-b90d-5713fff92c0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:01.722993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf1087-f9ed-40b4-b90d-5713fff92c0c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:01.739014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 894/1803] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:01.740219 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf1087-f9ed-40b4-b90d-5713fff92c0c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:01.787702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17227418-cddc-4d7a-bc57-f0a2bedd1e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:01.788598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17227418-cddc-4d7a-bc57-f0a2bedd1e8b service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:01.788918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17227418-cddc-4d7a-bc57-f0a2bedd1e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:01.789301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17227418-cddc-4d7a-bc57-f0a2bedd1e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:01.837019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17227418-cddc-4d7a-bc57-f0a2bedd1e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:01.838936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17227418-cddc-4d7a-bc57-f0a2bedd1e8b service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:01.866919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 910/1804] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:01.868155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17227418-cddc-4d7a-bc57-f0a2bedd1e8b service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:01.909209 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17227418-cddc-4d7a-bc57-f0a2bedd1e8b service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:01.916402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf1087-f9ed-40b4-b90d-5713fff92c0c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:01.921621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ee4e-23df-4a2a-86a3-a0c17d779cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:01.923324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ee4e-23df-4a2a-86a3-a0c17d779cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:01.924166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ee4e-23df-4a2a-86a3-a0c17d779cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:01.924818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ee4e-23df-4a2a-86a3-a0c17d779cd4 admin admin] PATH_INFO: `/v3/projects/09e1a63ec4474a21b6cfa5f0cfd9757c/users/45e6d38b332245aa92faf569ae3ebb55/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:01.934130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825659d6-c76d-457d-ade4-070a0e8f9c97 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19b86a53a20644bcacd280b2db893ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ad22ada448846cd80215d3df54b3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:01.934374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825659d6-c76d-457d-ade4-070a0e8f9c97 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:01.934581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825659d6-c76d-457d-ade4-070a0e8f9c97 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:01.934860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825659d6-c76d-457d-ade4-070a0e8f9c97 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:01.935786 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825659d6-c76d-457d-ade4-070a0e8f9c97 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:01.936100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825659d6-c76d-457d-ade4-070a0e8f9c97 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:01.937947 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825659d6-c76d-457d-ade4-070a0e8f9c97 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:01.956839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295ee4e-23df-4a2a-86a3-a0c17d779cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e1a63ec4474a21b6cfa5f0cfd9757c, user_id=45e6d38b332245aa92faf569ae3ebb55, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:01.963683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295ee4e-23df-4a2a-86a3-a0c17d779cd4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:01.966238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 895/1805] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:01.967291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825659d6-c76d-457d-ade4-070a0e8f9c97 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:01.992065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825659d6-c76d-457d-ade4-070a0e8f9c97 tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:02.005927 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988034f-c310-4bc0-ba6c-82ce93475f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:02.006601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988034f-c310-4bc0-ba6c-82ce93475f12 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:02.006976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988034f-c310-4bc0-ba6c-82ce93475f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:02.007251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988034f-c310-4bc0-ba6c-82ce93475f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:02.007937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988034f-c310-4bc0-ba6c-82ce93475f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:02.009859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988034f-c310-4bc0-ba6c-82ce93475f12 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:02.110156 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 911/1806] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:01 2022] PUT /identity/v3/projects/09e1a63ec4474a21b6cfa5f0cfd9757c/users/45e6d38b332245aa92faf569ae3ebb55/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:02.113005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ee4e-23df-4a2a-86a3-a0c17d779cd4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:02.215915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ee4e-23df-4a2a-86a3-a0c17d779cd4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:02.227241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19b86a53a20644bcacd280b2db893ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ad22ada448846cd80215d3df54b3cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:02.229872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 896/1807] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:01 2022] POST /identity/v3/projects => generated 381 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:02.230910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988034f-c310-4bc0-ba6c-82ce93475f12 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:02.233925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:02.236696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:02.237651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] PATH_INFO: `/v3/projects/ee775b03fb414769ad5e3d5a88aee954` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:02.241849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee775b03fb414769ad5e3d5a88aee954)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:02.249650 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:02.323929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988034f-c310-4bc0-ba6c-82ce93475f12 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:02.344236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbe17d-01b0-46d1-8290-d34ccae07749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:02.345215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbe17d-01b0-46d1-8290-d34ccae07749 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:02.345885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbe17d-01b0-46d1-8290-d34ccae07749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:02.346407 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbe17d-01b0-46d1-8290-d34ccae07749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:02.347293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbe17d-01b0-46d1-8290-d34ccae07749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:02.349419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbe17d-01b0-46d1-8290-d34ccae07749 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:02.369234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 897/1808] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:02.371331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbe17d-01b0-46d1-8290-d34ccae07749 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:02.384842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbe17d-01b0-46d1-8290-d34ccae07749 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:02.390690 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dbb86-e0bb-4110-8340-5669021935ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:02.391425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbb86-e0bb-4110-8340-5669021935ed admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:02.391825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbb86-e0bb-4110-8340-5669021935ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:02.392393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbb86-e0bb-4110-8340-5669021935ed admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:02.393120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dbb86-e0bb-4110-8340-5669021935ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:02.406243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dbb86-e0bb-4110-8340-5669021935ed admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:02.431289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee775b03fb414769ad5e3d5a88aee954', 'request_id': 'req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:02.534048 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee775b03fb414769ad5e3d5a88aee954', 'request_id': 'req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:02.547147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 898/1809] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:02 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:02.548052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dbb86-e0bb-4110-8340-5669021935ed admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:02.554866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee775b03fb414769ad5e3d5a88aee954', 'request_id': 'req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:02.569904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dbb86-e0bb-4110-8340-5669021935ed admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:02.618179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] The token cache is being invalidate because project ee775b03fb414769ad5e3d5a88aee954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:02.627729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:02.631301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:02.640742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 912/1810] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:02 2022] DELETE /identity/v3/projects/ee775b03fb414769ad5e3d5a88aee954 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:02.643104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:02.645220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:02.736407 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d5f71-8e55-4243-9bf1-98c354ad0e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:02.736407 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d5f71-8e55-4243-9bf1-98c354ad0e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:02.737044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d5f71-8e55-4243-9bf1-98c354ad0e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:02.737044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d5f71-8e55-4243-9bf1-98c354ad0e94 admin admin] PATH_INFO: `/v3/projects/09e1a63ec4474a21b6cfa5f0cfd9757c/users/45e6d38b332245aa92faf569ae3ebb55/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:02.741866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d5f71-8e55-4243-9bf1-98c354ad0e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e1a63ec4474a21b6cfa5f0cfd9757c, user_id=45e6d38b332245aa92faf569ae3ebb55, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:02.744645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d5f71-8e55-4243-9bf1-98c354ad0e94 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:02.773559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 899/1811] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:02 2022] PUT /identity/v3/projects/09e1a63ec4474a21b6cfa5f0cfd9757c/users/45e6d38b332245aa92faf569ae3ebb55/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:02.786243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502501f-aed7-4423-bc59-ad88dc51097f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:02.786571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502501f-aed7-4423-bc59-ad88dc51097f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:02.786869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502501f-aed7-4423-bc59-ad88dc51097f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:02.823540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375adb8b-d88e-4d32-af07-e92d6ed9e8ce tempest-VolumeQuotaClassesTest-108284531 tempest-VolumeQuotaClassesTest-108284531-project-admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:02.856901 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-9502501f-aed7-4423-bc59-ad88dc51097f None None] MFA Rules not processed for user `45e6d38b332245aa92faf569ae3ebb55`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:02.858441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9502501f-aed7-4423-bc59-ad88dc51097f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:03.044242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 900/1812] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:03.077382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502501f-aed7-4423-bc59-ad88dc51097f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:03.077382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9502501f-aed7-4423-bc59-ad88dc51097f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:03.121915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcc7b1-e5c7-478a-bf5b-aae95ad40ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:03.122821 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcc7b1-e5c7-478a-bf5b-aae95ad40ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:03.123746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcc7b1-e5c7-478a-bf5b-aae95ad40ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:03.123746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcc7b1-e5c7-478a-bf5b-aae95ad40ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:03.124971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcc7b1-e5c7-478a-bf5b-aae95ad40ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:03.126239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcc7b1-e5c7-478a-bf5b-aae95ad40ce7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:03.171939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 913/1813] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 529 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:03.174296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcc7b1-e5c7-478a-bf5b-aae95ad40ce7 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:03.209514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcc7b1-e5c7-478a-bf5b-aae95ad40ce7 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:03.222978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052404d-5134-45f3-af7d-e0bbef1b1318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:03.223789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052404d-5134-45f3-af7d-e0bbef1b1318 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:03.224197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052404d-5134-45f3-af7d-e0bbef1b1318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:03.225161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052404d-5134-45f3-af7d-e0bbef1b1318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:03.225541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052404d-5134-45f3-af7d-e0bbef1b1318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:03.227379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052404d-5134-45f3-af7d-e0bbef1b1318 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:03.234467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502501f-aed7-4423-bc59-ad88dc51097f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:03.242032 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4052ab-93f9-4a8b-9d87-1473ee8c5f97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:03.243582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4052ab-93f9-4a8b-9d87-1473ee8c5f97 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:03.244009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4052ab-93f9-4a8b-9d87-1473ee8c5f97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:03.247395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4052ab-93f9-4a8b-9d87-1473ee8c5f97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:03.262265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 914/1814] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:03.264052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052404d-5134-45f3-af7d-e0bbef1b1318 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:03.267478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4052ab-93f9-4a8b-9d87-1473ee8c5f97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:03.270743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4052ab-93f9-4a8b-9d87-1473ee8c5f97 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:03.284459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052404d-5134-45f3-af7d-e0bbef1b1318 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:03.288269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 901/1815] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:03.310353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5999d-abed-47c9-b0ac-72e35598826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:03.311301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5999d-abed-47c9-b0ac-72e35598826b admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:03.311587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5999d-abed-47c9-b0ac-72e35598826b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:03.311866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5999d-abed-47c9-b0ac-72e35598826b admin admin] PATH_INFO: `/v3/projects/ce9d3708e9044f77936036676ec167df/users/59553184ebc9434cafc7a4d92ff312c5/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:03.366729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5999d-abed-47c9-b0ac-72e35598826b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9d3708e9044f77936036676ec167df, user_id=59553184ebc9434cafc7a4d92ff312c5, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:03.374770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5999d-abed-47c9-b0ac-72e35598826b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:03.503384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 915/1816] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:03 2022] PUT /identity/v3/projects/ce9d3708e9044f77936036676ec167df/users/59553184ebc9434cafc7a4d92ff312c5/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:03.509065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9303eb-73b2-4b29-a844-d95eb4372f43 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:03.509597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9303eb-73b2-4b29-a844-d95eb4372f43 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:03.509961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9303eb-73b2-4b29-a844-d95eb4372f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:03.584080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-bc9303eb-73b2-4b29-a844-d95eb4372f43 None None] MFA Rules not processed for user `59553184ebc9434cafc7a4d92ff312c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:03.586998 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-bc9303eb-73b2-4b29-a844-d95eb4372f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:03.638348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5999d-abed-47c9-b0ac-72e35598826b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:03.644012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3ab5999d-abed-47c9-b0ac-72e35598826b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:03.924288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5999d-abed-47c9-b0ac-72e35598826b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:03.928190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 902/1817] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:03.930026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9303eb-73b2-4b29-a844-d95eb4372f43 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:03.951700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:03.952802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:03.956658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:03.957911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] PATH_INFO: `/v3/projects/23748fa315084b24b50f283eceb934b3` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:03.968671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9303eb-73b2-4b29-a844-d95eb4372f43 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:03.971400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23748fa315084b24b50f283eceb934b3)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:03.982763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:03.987280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5f762-ce4c-495a-b956-66a19842bcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:03.987922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5f762-ce4c-495a-b956-66a19842bcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:03.988349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5f762-ce4c-495a-b956-66a19842bcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:03.988630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5f762-ce4c-495a-b956-66a19842bcd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:03.991454 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5f762-ce4c-495a-b956-66a19842bcd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:03.992042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5f762-ce4c-495a-b956-66a19842bcd2 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:04.184006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 903/1818] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:03 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:04.189733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5f762-ce4c-495a-b956-66a19842bcd2 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:04.193951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-eaf5f762-ce4c-495a-b956-66a19842bcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:04.288177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23748fa315084b24b50f283eceb934b3', 'request_id': 'req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:04.320923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5f762-ce4c-495a-b956-66a19842bcd2 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:04.387410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23748fa315084b24b50f283eceb934b3', 'request_id': 'req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:04.407196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23748fa315084b24b50f283eceb934b3', 'request_id': 'req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:04.432453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:04.435079 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:04.436195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:04.437366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] PATH_INFO: `/v3/users/5b5fd7925d674fe3ac378ba89eb7fa5b` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:04.440598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5fd7925d674fe3ac378ba89eb7fa5b)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:04.445854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] The token cache is being invalidate because project 23748fa315084b24b50f283eceb934b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:04.448525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:04.453597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:04.454713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:04.461318 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 916/1819] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:03 2022] DELETE /identity/v3/projects/23748fa315084b24b50f283eceb934b3 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:04.465793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:04.468793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:04.538564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1dc80-eb44-46f5-b31e-6743b5ea3eb3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:04.549164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abf68c-48a3-41b7-8da8-c1791597c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:04.550920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abf68c-48a3-41b7-8da8-c1791597c5fe admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:04.551226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abf68c-48a3-41b7-8da8-c1791597c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:04.551487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abf68c-48a3-41b7-8da8-c1791597c5fe admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:04.553767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abf68c-48a3-41b7-8da8-c1791597c5fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:04.559032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abf68c-48a3-41b7-8da8-c1791597c5fe admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:04.582268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:04.740678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 917/1820] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:04 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:04.740678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abf68c-48a3-41b7-8da8-c1791597c5fe admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:04.744888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-37abf68c-48a3-41b7-8da8-c1791597c5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:04.772755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abf68c-48a3-41b7-8da8-c1791597c5fe admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:04.788788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:04.789953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:04.790399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:04.790802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] PATH_INFO: `/v3/users/e13100b9c8bc4f5da98f9741404d5908` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:04.792843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13100b9c8bc4f5da98f9741404d5908)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:04.794960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:04.842419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5fd7925d674fe3ac378ba89eb7fa5b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:04.857873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5fd7925d674fe3ac378ba89eb7fa5b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:04.879814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5fd7925d674fe3ac378ba89eb7fa5b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:05.081188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5fd7925d674fe3ac378ba89eb7fa5b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:05.082429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5fd7925d674fe3ac378ba89eb7fa5b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:05.090862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 904/1821] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:04 2022] DELETE /identity/v3/users/5b5fd7925d674fe3ac378ba89eb7fa5b => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:05.091732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:05.093088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:05.128719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:05.145274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13100b9c8bc4f5da98f9741404d5908'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:05.146021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13100b9c8bc4f5da98f9741404d5908'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:05.162657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13100b9c8bc4f5da98f9741404d5908'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:05.169332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13100b9c8bc4f5da98f9741404d5908'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:05.170251 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13100b9c8bc4f5da98f9741404d5908'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:05.185366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e49995-8774-4c80-841a-59722b98bbe8 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:05.190406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c22256-1a07-470a-a347-85fd172526a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:05.191043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c22256-1a07-470a-a347-85fd172526a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:05.191327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c22256-1a07-470a-a347-85fd172526a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:05.196330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c22256-1a07-470a-a347-85fd172526a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:05.196330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c22256-1a07-470a-a347-85fd172526a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:05.196330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c22256-1a07-470a-a347-85fd172526a9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:05.204579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 905/1822] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:05.205899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9904d-3b09-41ff-8e4e-af07ad8b93a2 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:05.206214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9904d-3b09-41ff-8e4e-af07ad8b93a2 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:05.206491 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9904d-3b09-41ff-8e4e-af07ad8b93a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:05.225247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-75d9904d-3b09-41ff-8e4e-af07ad8b93a2 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:05.226704 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-75d9904d-3b09-41ff-8e4e-af07ad8b93a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:05.235160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 906/1823] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:05.236026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9904d-3b09-41ff-8e4e-af07ad8b93a2 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:05.238358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-75d9904d-3b09-41ff-8e4e-af07ad8b93a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:05.254512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9904d-3b09-41ff-8e4e-af07ad8b93a2 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:05.259221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1354c2f-b4c5-4fb0-a9ed-5b3e628cc38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:05.259900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1354c2f-b4c5-4fb0-a9ed-5b3e628cc38f admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:05.260182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1354c2f-b4c5-4fb0-a9ed-5b3e628cc38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:05.260630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1354c2f-b4c5-4fb0-a9ed-5b3e628cc38f admin admin] PATH_INFO: `/v3/projects/44d65397bc79457ab1ed419ceb99e0a9/users/0f79e9387a3f4f5fbac8c9b6bbcdbb9c/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:05.274944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1354c2f-b4c5-4fb0-a9ed-5b3e628cc38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d65397bc79457ab1ed419ceb99e0a9, user_id=0f79e9387a3f4f5fbac8c9b6bbcdbb9c, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:05.277643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1354c2f-b4c5-4fb0-a9ed-5b3e628cc38f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:05.283853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 918/1824] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:04 2022] DELETE /identity/v3/users/e13100b9c8bc4f5da98f9741404d5908 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:05.284945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:05.286452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:05.357674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca156-7af2-4aea-9315-ef534ec54025 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:05.361515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65912779-51ff-4d8e-9f53-27c25efe0fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:05.362132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912779-51ff-4d8e-9f53-27c25efe0fcd service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:05.362442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912779-51ff-4d8e-9f53-27c25efe0fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:05.362746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912779-51ff-4d8e-9f53-27c25efe0fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:05.387518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 907/1825] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:05 2022] PUT /identity/v3/projects/44d65397bc79457ab1ed419ceb99e0a9/users/0f79e9387a3f4f5fbac8c9b6bbcdbb9c/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:05.391499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1354c2f-b4c5-4fb0-a9ed-5b3e628cc38f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:05.447238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65912779-51ff-4d8e-9f53-27c25efe0fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:05.449410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65912779-51ff-4d8e-9f53-27c25efe0fcd service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:05.467310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 919/1826] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:05.477291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1354c2f-b4c5-4fb0-a9ed-5b3e628cc38f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:05.487227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcfc73-c435-4641-895b-b833f7b69687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:05.488126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcfc73-c435-4641-895b-b833f7b69687 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:05.488565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcfc73-c435-4641-895b-b833f7b69687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:05.489269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcfc73-c435-4641-895b-b833f7b69687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:05.490851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcfc73-c435-4641-895b-b833f7b69687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:05.493057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcfc73-c435-4641-895b-b833f7b69687 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:05.504634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 908/1827] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:05.509891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65912779-51ff-4d8e-9f53-27c25efe0fcd service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:05.520673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65912779-51ff-4d8e-9f53-27c25efe0fcd service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:05.526233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a8c7b-341a-4934-a3b5-00df4dd0a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:05.526983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8c7b-341a-4934-a3b5-00df4dd0a78b admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:05.527446 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8c7b-341a-4934-a3b5-00df4dd0a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:05.527552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8c7b-341a-4934-a3b5-00df4dd0a78b admin admin] PATH_INFO: `/v3/projects/44d65397bc79457ab1ed419ceb99e0a9/users/0f79e9387a3f4f5fbac8c9b6bbcdbb9c/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:05.529671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a8c7b-341a-4934-a3b5-00df4dd0a78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d65397bc79457ab1ed419ceb99e0a9, user_id=0f79e9387a3f4f5fbac8c9b6bbcdbb9c, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:05.532390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a8c7b-341a-4934-a3b5-00df4dd0a78b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:05.553343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 920/1828] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:05 2022] PUT /identity/v3/projects/44d65397bc79457ab1ed419ceb99e0a9/users/0f79e9387a3f4f5fbac8c9b6bbcdbb9c/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:05.563945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b91ea7-3d4e-4b9f-a8b5-f1d012915fcc None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:05.564251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b91ea7-3d4e-4b9f-a8b5-f1d012915fcc None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:05.564508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b91ea7-3d4e-4b9f-a8b5-f1d012915fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:05.638375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-11b91ea7-3d4e-4b9f-a8b5-f1d012915fcc None None] MFA Rules not processed for user `0f79e9387a3f4f5fbac8c9b6bbcdbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:05.639739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-11b91ea7-3d4e-4b9f-a8b5-f1d012915fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:05.768959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 909/1829] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:05.813934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a8c7b-341a-4934-a3b5-00df4dd0a78b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:05.815713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-da9a8c7b-341a-4934-a3b5-00df4dd0a78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:05.904359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a8c7b-341a-4934-a3b5-00df4dd0a78b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:05.908052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9d19d-9317-4c74-85a5-45fed350cfde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:05.908696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9d19d-9317-4c74-85a5-45fed350cfde service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:05.908981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9d19d-9317-4c74-85a5-45fed350cfde service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:05.909261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9d19d-9317-4c74-85a5-45fed350cfde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:05.920126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9d19d-9317-4c74-85a5-45fed350cfde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:05.921491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9d19d-9317-4c74-85a5-45fed350cfde service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:05.933275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 921/1830] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:05.995740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b91ea7-3d4e-4b9f-a8b5-f1d012915fcc None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:06.008144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b91ea7-3d4e-4b9f-a8b5-f1d012915fcc None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:06.012659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5191e-f667-44c2-9601-e77852e72683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:06.013373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5191e-f667-44c2-9601-e77852e72683 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:06.013743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5191e-f667-44c2-9601-e77852e72683 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:06.014085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5191e-f667-44c2-9601-e77852e72683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:06.016614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-adc5191e-f667-44c2-9601-e77852e72683 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:06.092913 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5191e-f667-44c2-9601-e77852e72683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:06.094435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5191e-f667-44c2-9601-e77852e72683 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:06.104740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 910/1831] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:06.369064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9d19d-9317-4c74-85a5-45fed350cfde service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:06.370479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5191e-f667-44c2-9601-e77852e72683 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:06.371326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c0b9d19d-9317-4c74-85a5-45fed350cfde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:06.372832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-adc5191e-f667-44c2-9601-e77852e72683 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:06.387488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5191e-f667-44c2-9601-e77852e72683 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:06.393072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280c7d1-fbef-4c19-ab57-70fbcb118c59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:06.393834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280c7d1-fbef-4c19-ab57-70fbcb118c59 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:06.394111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280c7d1-fbef-4c19-ab57-70fbcb118c59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:06.394411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280c7d1-fbef-4c19-ab57-70fbcb118c59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:06.397614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8280c7d1-fbef-4c19-ab57-70fbcb118c59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:06.460907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9d19d-9317-4c74-85a5-45fed350cfde service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:06.467189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:06.469121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:06.469121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:06.469121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] PATH_INFO: `/v3/projects/8a4df64056d34705a69eda8535226180` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:06.470293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4df64056d34705a69eda8535226180)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:06.470687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280c7d1-fbef-4c19-ab57-70fbcb118c59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:06.471928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280c7d1-fbef-4c19-ab57-70fbcb118c59 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:06.472525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:06.481966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 911/1832] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:06.618325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280c7d1-fbef-4c19-ab57-70fbcb118c59 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:06.618325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8280c7d1-fbef-4c19-ab57-70fbcb118c59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:06.636550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280c7d1-fbef-4c19-ab57-70fbcb118c59 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:06.653371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4df64056d34705a69eda8535226180', 'request_id': 'req-56681425-250c-4791-9b49-b358db69aa73'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:06.672573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:06.714489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:06.715268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:06.715842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:06.715948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] PATH_INFO: `/v3/projects/672877d0ca71402e83a67b1fd1dceb8b` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:06.717120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=672877d0ca71402e83a67b1fd1dceb8b)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:06.719227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:06.812749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4df64056d34705a69eda8535226180', 'request_id': 'req-56681425-250c-4791-9b49-b358db69aa73'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:06.822574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4df64056d34705a69eda8535226180', 'request_id': 'req-56681425-250c-4791-9b49-b358db69aa73'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:06.836707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] The token cache is being invalidate because project 8a4df64056d34705a69eda8535226180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:06.837322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:06.838375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-56681425-250c-4791-9b49-b358db69aa73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:06.844235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 922/1833] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:06 2022] DELETE /identity/v3/projects/8a4df64056d34705a69eda8535226180 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:06.846292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721b09d-0098-41ed-8597-15f3fb71c112 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:06.846863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721b09d-0098-41ed-8597-15f3fb71c112 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:06.847344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721b09d-0098-41ed-8597-15f3fb71c112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:06.873949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-8721b09d-0098-41ed-8597-15f3fb71c112 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:06.875455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8721b09d-0098-41ed-8597-15f3fb71c112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:06.886738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 923/1834] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:06.894516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac71d6-3be6-48d6-bb08-e65aa46f7c7d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:06.895043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac71d6-3be6-48d6-bb08-e65aa46f7c7d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:06.895458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac71d6-3be6-48d6-bb08-e65aa46f7c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:06.913678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672877d0ca71402e83a67b1fd1dceb8b', 'request_id': 'req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:06.919469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-05ac71d6-3be6-48d6-bb08-e65aa46f7c7d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:06.920773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672877d0ca71402e83a67b1fd1dceb8b', 'request_id': 'req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:06.921196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-05ac71d6-3be6-48d6-bb08-e65aa46f7c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:06.926585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672877d0ca71402e83a67b1fd1dceb8b', 'request_id': 'req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:06.989291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 924/1835] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:06.993907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac71d6-3be6-48d6-bb08-e65aa46f7c7d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:07.007205 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac71d6-3be6-48d6-bb08-e65aa46f7c7d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:07.016114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a8e37-22c0-4b25-96ce-60ee7b5ca5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:07.016114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a8e37-22c0-4b25-96ce-60ee7b5ca5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:07.016114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a8e37-22c0-4b25-96ce-60ee7b5ca5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:07.016114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a8e37-22c0-4b25-96ce-60ee7b5ca5b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:07.016563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a8e37-22c0-4b25-96ce-60ee7b5ca5b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:07.016563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a8e37-22c0-4b25-96ce-60ee7b5ca5b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:07.016792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a8e37-22c0-4b25-96ce-60ee7b5ca5b9 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:07.043143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 925/1836] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:09:07.044765 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d80dd0-d78a-47fb-a352-24320faa8124 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:07.045375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d80dd0-d78a-47fb-a352-24320faa8124 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:07.045882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d80dd0-d78a-47fb-a352-24320faa8124 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:07.048734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 926/1837] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:09:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:09:07.050695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d80dd0-d78a-47fb-a352-24320faa8124 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:07.058460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] The token cache is being invalidate because project 672877d0ca71402e83a67b1fd1dceb8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:07.059033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:07.060884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:07.071958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 912/1838] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:06 2022] DELETE /identity/v3/projects/672877d0ca71402e83a67b1fd1dceb8b => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:07.075595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:07.077340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:07.117904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d80dd0-d78a-47fb-a352-24320faa8124 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:07.124069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d616d9-3b5d-4e28-a1aa-8f7329d2eccc admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:07.126987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36ca6d-a27d-492d-a132-9279e4f5eac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:07.127620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ca6d-a27d-492d-a132-9279e4f5eac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:07.138577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ca6d-a27d-492d-a132-9279e4f5eac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:07.138922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ca6d-a27d-492d-a132-9279e4f5eac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:07.139025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:07.139629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ca6d-a27d-492d-a132-9279e4f5eac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:07.139734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:07.139941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:07.140222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] PATH_INFO: `/v3/users/19b86a53a20644bcacd280b2db893ea4` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:07.144586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b86a53a20644bcacd280b2db893ea4)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:07.145054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ca6d-a27d-492d-a132-9279e4f5eac7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:07.150306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:07.505106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 927/1839] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:07 2022] POST /identity/v3/projects => generated 377 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:07.506677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef022478-fd3a-4c17-8360-2132a405cf17 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:07.507023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef022478-fd3a-4c17-8360-2132a405cf17 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:07.507305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef022478-fd3a-4c17-8360-2132a405cf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:07.527592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-ef022478-fd3a-4c17-8360-2132a405cf17 None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:07.528821 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ef022478-fd3a-4c17-8360-2132a405cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:07.574122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b86a53a20644bcacd280b2db893ea4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:07.582578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b86a53a20644bcacd280b2db893ea4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:07.606697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b86a53a20644bcacd280b2db893ea4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:07.633637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 928/1840] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:09:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:07.634442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef022478-fd3a-4c17-8360-2132a405cf17 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:07.635793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ef022478-fd3a-4c17-8360-2132a405cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:07.686652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b86a53a20644bcacd280b2db893ea4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:07.687276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b86a53a20644bcacd280b2db893ea4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:07.694649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 913/1841] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:07 2022] DELETE /identity/v3/users/19b86a53a20644bcacd280b2db893ea4 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:07.698839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:07.706651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:07.712041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef022478-fd3a-4c17-8360-2132a405cf17 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:07.822664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5732a-5a8b-4355-8425-575f732f9309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:07.825561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5732a-5a8b-4355-8425-575f732f9309 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:07.825561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5732a-5a8b-4355-8425-575f732f9309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:07.825561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5732a-5a8b-4355-8425-575f732f9309 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:07.825561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5732a-5a8b-4355-8425-575f732f9309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:07.828146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5732a-5a8b-4355-8425-575f732f9309 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:07.877542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62f702-399d-4761-8382-fce84b41ed67 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:07.887933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea34d9f-23a4-404c-a7a8-204ce5cf95e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:07.888675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34d9f-23a4-404c-a7a8-204ce5cf95e3 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:07.894102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34d9f-23a4-404c-a7a8-204ce5cf95e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:07.894102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34d9f-23a4-404c-a7a8-204ce5cf95e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:07.894102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5ea34d9f-23a4-404c-a7a8-204ce5cf95e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:07.907014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea34d9f-23a4-404c-a7a8-204ce5cf95e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:07.908695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea34d9f-23a4-404c-a7a8-204ce5cf95e3 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:07.919741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 914/1842] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:07.952224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 929/1843] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:07 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:07.956619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea34d9f-23a4-404c-a7a8-204ce5cf95e3 service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:07.958070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5ea34d9f-23a4-404c-a7a8-204ce5cf95e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:07.972176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea34d9f-23a4-404c-a7a8-204ce5cf95e3 service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:07.977404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ef24b-17ef-47d5-8769-049a65fa0d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:07.978018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ef24b-17ef-47d5-8769-049a65fa0d27 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:07.978340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ef24b-17ef-47d5-8769-049a65fa0d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:07.978691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ef24b-17ef-47d5-8769-049a65fa0d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:07.979424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ef24b-17ef-47d5-8769-049a65fa0d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:07.981026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ef24b-17ef-47d5-8769-049a65fa0d27 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:07.994389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 915/1844] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:07.996896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5732a-5a8b-4355-8425-575f732f9309 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:08.012644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5732a-5a8b-4355-8425-575f732f9309 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:08.018881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdefc32-0fe7-4382-8aae-d12a612ba444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:08.020535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdefc32-0fe7-4382-8aae-d12a612ba444 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:08.020535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdefc32-0fe7-4382-8aae-d12a612ba444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:08.020535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdefc32-0fe7-4382-8aae-d12a612ba444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:08.020737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdefc32-0fe7-4382-8aae-d12a612ba444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:08.023357 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdefc32-0fe7-4382-8aae-d12a612ba444 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:08.035929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 930/1845] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:08.040621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ef24b-17ef-47d5-8769-049a65fa0d27 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:08.051636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ef24b-17ef-47d5-8769-049a65fa0d27 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:08.057828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfeaa8-d80d-4f9d-ae1c-86578bbf4bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:08.058600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfeaa8-d80d-4f9d-ae1c-86578bbf4bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:08.058889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfeaa8-d80d-4f9d-ae1c-86578bbf4bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:08.059346 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfeaa8-d80d-4f9d-ae1c-86578bbf4bc3 admin admin] PATH_INFO: `/v3/projects/920a62885f3b4526a4c51c02b1ab75e5/users/407556624c6b43a894325a0696c84a54/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:08.079758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfeaa8-d80d-4f9d-ae1c-86578bbf4bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920a62885f3b4526a4c51c02b1ab75e5, user_id=407556624c6b43a894325a0696c84a54, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:08.082480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfeaa8-d80d-4f9d-ae1c-86578bbf4bc3 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:08.224130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 916/1846] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:08 2022] PUT /identity/v3/projects/920a62885f3b4526a4c51c02b1ab75e5/users/407556624c6b43a894325a0696c84a54/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:08.234995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c086-94f1-4550-958a-9514434e5e7a None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:08.235312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c086-94f1-4550-958a-9514434e5e7a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:08.235563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c086-94f1-4550-958a-9514434e5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:08.265539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6929c086-94f1-4550-958a-9514434e5e7a None None] MFA Rules not processed for user `407556624c6b43a894325a0696c84a54`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:08.266790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6929c086-94f1-4550-958a-9514434e5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:08.344701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 931/1847] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:08.348662 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfeaa8-d80d-4f9d-ae1c-86578bbf4bc3 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:08.359170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929c086-94f1-4550-958a-9514434e5e7a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:08.363823 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6929c086-94f1-4550-958a-9514434e5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:08.484900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfeaa8-d80d-4f9d-ae1c-86578bbf4bc3 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:08.492448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af702f6-eb69-4d7c-8a76-5b926b45228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:08.492796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929c086-94f1-4550-958a-9514434e5e7a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:08.493248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af702f6-eb69-4d7c-8a76-5b926b45228c admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:08.493591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af702f6-eb69-4d7c-8a76-5b926b45228c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:08.493936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af702f6-eb69-4d7c-8a76-5b926b45228c admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:08.494835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af702f6-eb69-4d7c-8a76-5b926b45228c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:08.497297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af702f6-eb69-4d7c-8a76-5b926b45228c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:08.505090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:08.507406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:08.507579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:08.508071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] PATH_INFO: `/v3/projects/5ad22ada448846cd80215d3df54b3cfc` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:08.509358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad22ada448846cd80215d3df54b3cfc)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:08.515403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:08.629782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:08.637442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 917/1848] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:08 2022] POST /identity/v3/projects => generated 377 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:08.642319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af702f6-eb69-4d7c-8a76-5b926b45228c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:08.675450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad22ada448846cd80215d3df54b3cfc', 'request_id': 'req-eb600a04-6820-460f-8529-97152611e1c6'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:08.786389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af702f6-eb69-4d7c-8a76-5b926b45228c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:08.801210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1568f19-df96-4801-88be-1cab3bbb6803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:08.802120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1568f19-df96-4801-88be-1cab3bbb6803 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:08.802738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1568f19-df96-4801-88be-1cab3bbb6803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:08.802972 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1568f19-df96-4801-88be-1cab3bbb6803 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:08.803996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1568f19-df96-4801-88be-1cab3bbb6803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:08.810104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1568f19-df96-4801-88be-1cab3bbb6803 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:08.880744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad22ada448846cd80215d3df54b3cfc', 'request_id': 'req-eb600a04-6820-460f-8529-97152611e1c6'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:08.888117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad22ada448846cd80215d3df54b3cfc', 'request_id': 'req-eb600a04-6820-460f-8529-97152611e1c6'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:08.960078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] The token cache is being invalidate because project 5ad22ada448846cd80215d3df54b3cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:08.960078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:08.960078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb600a04-6820-460f-8529-97152611e1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:08.960078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 932/1849] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:08 2022] DELETE /identity/v3/projects/5ad22ada448846cd80215d3df54b3cfc => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:08.960078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73f402-9314-4bba-a3b8-21e9a35c6a97 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:08.960720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73f402-9314-4bba-a3b8-21e9a35c6a97 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:08.960720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73f402-9314-4bba-a3b8-21e9a35c6a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:08.998436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-ce73f402-9314-4bba-a3b8-21e9a35c6a97 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:09.000164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ce73f402-9314-4bba-a3b8-21e9a35c6a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:09.010719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 933/1850] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:09.024069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33523480-6a34-43a3-b003-de919f2dedde None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.024069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33523480-6a34-43a3-b003-de919f2dedde None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.024069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33523480-6a34-43a3-b003-de919f2dedde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.058136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-33523480-6a34-43a3-b003-de919f2dedde None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:09.061317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-33523480-6a34-43a3-b003-de919f2dedde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:09.079880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 934/1851] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:09.080814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33523480-6a34-43a3-b003-de919f2dedde None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.091862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33523480-6a34-43a3-b003-de919f2dedde None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.102245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 918/1852] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:08 2022] POST /identity/v3/users => generated 295 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:09.106997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc734-476d-4808-9c1f-be4c4b23a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.107688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc734-476d-4808-9c1f-be4c4b23a9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.107967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc734-476d-4808-9c1f-be4c4b23a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.108237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc734-476d-4808-9c1f-be4c4b23a9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.108422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1568f19-df96-4801-88be-1cab3bbb6803 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.108947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cc734-476d-4808-9c1f-be4c4b23a9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:09.109245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cc734-476d-4808-9c1f-be4c4b23a9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.110531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d1568f19-df96-4801-88be-1cab3bbb6803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:09.111191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cc734-476d-4808-9c1f-be4c4b23a9e5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.125054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1568f19-df96-4801-88be-1cab3bbb6803 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.131944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17066143-45f1-4a95-ad95-0d489c523a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.132791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17066143-45f1-4a95-ad95-0d489c523a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.133163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17066143-45f1-4a95-ad95-0d489c523a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.133504 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17066143-45f1-4a95-ad95-0d489c523a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.134306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17066143-45f1-4a95-ad95-0d489c523a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.136479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 935/1853] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:09.137230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc734-476d-4808-9c1f-be4c4b23a9e5 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.137688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17066143-45f1-4a95-ad95-0d489c523a04 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.152009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc734-476d-4808-9c1f-be4c4b23a9e5 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.160153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 919/1854] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:09.160414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab08a3f-363a-4fa5-a91d-b820359a8f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.160414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08a3f-363a-4fa5-a91d-b820359a8f0a admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.160414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08a3f-363a-4fa5-a91d-b820359a8f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.160414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08a3f-363a-4fa5-a91d-b820359a8f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.160754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab08a3f-363a-4fa5-a91d-b820359a8f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.161041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab08a3f-363a-4fa5-a91d-b820359a8f0a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.164434 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17066143-45f1-4a95-ad95-0d489c523a04 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.179252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17066143-45f1-4a95-ad95-0d489c523a04 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.185223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ae285-3108-4813-ae64-0732b81b0081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.186499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ae285-3108-4813-ae64-0732b81b0081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.186997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ae285-3108-4813-ae64-0732b81b0081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.187481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ae285-3108-4813-ae64-0732b81b0081 admin admin] PATH_INFO: `/v3/projects/c5d1f382d55446058681c103f325980c/users/d8afd707958045668b48674181c4214e/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.204570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ae285-3108-4813-ae64-0732b81b0081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d1f382d55446058681c103f325980c, user_id=d8afd707958045668b48674181c4214e, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.207477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ae285-3108-4813-ae64-0732b81b0081 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.348268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 920/1855] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:09 2022] PUT /identity/v3/projects/c5d1f382d55446058681c103f325980c/users/d8afd707958045668b48674181c4214e/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:09.352013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 936/1856] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:09 2022] POST /identity/v3/projects => generated 391 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:09.355246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ae285-3108-4813-ae64-0732b81b0081 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.356074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab08a3f-363a-4fa5-a91d-b820359a8f0a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.485153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ae285-3108-4813-ae64-0732b81b0081 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.493218 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602920ce-d373-48de-b6fa-621ae0caf9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.494437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602920ce-d373-48de-b6fa-621ae0caf9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.494437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602920ce-d373-48de-b6fa-621ae0caf9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.495460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab08a3f-363a-4fa5-a91d-b820359a8f0a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.496340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602920ce-d373-48de-b6fa-621ae0caf9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.497027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602920ce-d373-48de-b6fa-621ae0caf9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.498971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602920ce-d373-48de-b6fa-621ae0caf9cb admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.502621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20920bd-e527-4fd4-a4b3-664187323a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.503370 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20920bd-e527-4fd4-a4b3-664187323a69 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.503807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20920bd-e527-4fd4-a4b3-664187323a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.504180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20920bd-e527-4fd4-a4b3-664187323a69 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.505003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20920bd-e527-4fd4-a4b3-664187323a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.508560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20920bd-e527-4fd4-a4b3-664187323a69 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.511778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 921/1857] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:09.515663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602920ce-d373-48de-b6fa-621ae0caf9cb admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.534427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602920ce-d373-48de-b6fa-621ae0caf9cb admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.539168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02472d8d-2d3c-4924-9bfe-cd5c4aad3acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.540012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02472d8d-2d3c-4924-9bfe-cd5c4aad3acb admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.540299 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02472d8d-2d3c-4924-9bfe-cd5c4aad3acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.540646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02472d8d-2d3c-4924-9bfe-cd5c4aad3acb admin admin] PATH_INFO: `/v3/projects/c5d1f382d55446058681c103f325980c/users/d8afd707958045668b48674181c4214e/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.543210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02472d8d-2d3c-4924-9bfe-cd5c4aad3acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d1f382d55446058681c103f325980c, user_id=d8afd707958045668b48674181c4214e, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.547335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02472d8d-2d3c-4924-9bfe-cd5c4aad3acb admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.566270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 922/1858] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:09 2022] PUT /identity/v3/projects/c5d1f382d55446058681c103f325980c/users/d8afd707958045668b48674181c4214e/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:09.577238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446aa95-2dc6-40ac-9b1c-cf50c8ff78e3 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.577563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446aa95-2dc6-40ac-9b1c-cf50c8ff78e3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.577792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446aa95-2dc6-40ac-9b1c-cf50c8ff78e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.617312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2446aa95-2dc6-40ac-9b1c-cf50c8ff78e3 None None] MFA Rules not processed for user `d8afd707958045668b48674181c4214e`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:09.618840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2446aa95-2dc6-40ac-9b1c-cf50c8ff78e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:09.678498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 937/1859] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:09 2022] POST /identity/v3/users => generated 296 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:09.681164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20920bd-e527-4fd4-a4b3-664187323a69 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.698410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20920bd-e527-4fd4-a4b3-664187323a69 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.722341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 923/1860] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:09.733953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446aa95-2dc6-40ac-9b1c-cf50c8ff78e3 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.735881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2446aa95-2dc6-40ac-9b1c-cf50c8ff78e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:09.776158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887d90e-74db-4ae1-acec-edf35de9af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.776792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887d90e-74db-4ae1-acec-edf35de9af01 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.777073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887d90e-74db-4ae1-acec-edf35de9af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.777348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887d90e-74db-4ae1-acec-edf35de9af01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.778053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887d90e-74db-4ae1-acec-edf35de9af01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.780215 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887d90e-74db-4ae1-acec-edf35de9af01 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.794947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 938/1861] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:09.803000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887d90e-74db-4ae1-acec-edf35de9af01 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.814162 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446aa95-2dc6-40ac-9b1c-cf50c8ff78e3 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.819478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887d90e-74db-4ae1-acec-edf35de9af01 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.820285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b625a8-d426-43d4-bcec-e9be33a2c35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.821144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b625a8-d426-43d4-bcec-e9be33a2c35e service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.821616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b625a8-d426-43d4-bcec-e9be33a2c35e service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.822194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b625a8-d426-43d4-bcec-e9be33a2c35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.824777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e1b625a8-d426-43d4-bcec-e9be33a2c35e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:09.825870 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1246c-7a4e-42d8-b53d-b7d65277f799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.826533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1246c-7a4e-42d8-b53d-b7d65277f799 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.826818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1246c-7a4e-42d8-b53d-b7d65277f799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.827093 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1246c-7a4e-42d8-b53d-b7d65277f799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.827746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1246c-7a4e-42d8-b53d-b7d65277f799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.829962 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1246c-7a4e-42d8-b53d-b7d65277f799 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.866666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 939/1862] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:09.866666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1246c-7a4e-42d8-b53d-b7d65277f799 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:09.883460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1246c-7a4e-42d8-b53d-b7d65277f799 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:09.905187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f558b7e-9fc8-42c6-b42f-0f6bc7960cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:09.905187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558b7e-9fc8-42c6-b42f-0f6bc7960cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:09.905187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558b7e-9fc8-42c6-b42f-0f6bc7960cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:09.905187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f558b7e-9fc8-42c6-b42f-0f6bc7960cb5 admin admin] PATH_INFO: `/v3/projects/21875d9429f7496f9d6c6424c2994837/users/f0da2ad74a3b4f6e8863643756f18514/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:09.939478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f558b7e-9fc8-42c6-b42f-0f6bc7960cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21875d9429f7496f9d6c6424c2994837, user_id=f0da2ad74a3b4f6e8863643756f18514, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.943867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f558b7e-9fc8-42c6-b42f-0f6bc7960cb5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.965135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b625a8-d426-43d4-bcec-e9be33a2c35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:09.979502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b625a8-d426-43d4-bcec-e9be33a2c35e service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:09.992679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 924/1863] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:10.015664 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:10.055429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 940/1864] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:09 2022] PUT /identity/v3/projects/21875d9429f7496f9d6c6424c2994837/users/f0da2ad74a3b4f6e8863643756f18514/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:10.066462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8295-41ba-4d9b-8969-a83cac8ee24f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:10.066462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8295-41ba-4d9b-8969-a83cac8ee24f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:10.066663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8295-41ba-4d9b-8969-a83cac8ee24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:10.108192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-11ea8295-41ba-4d9b-8969-a83cac8ee24f None None] MFA Rules not processed for user `f0da2ad74a3b4f6e8863643756f18514`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:10.109419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-11ea8295-41ba-4d9b-8969-a83cac8ee24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:10.219515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 925/1865] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:10.221009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f558b7e-9fc8-42c6-b42f-0f6bc7960cb5 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:10.290750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f558b7e-9fc8-42c6-b42f-0f6bc7960cb5 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:10.295705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5079b-7359-46e0-a603-c2df54455391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:10.296325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5079b-7359-46e0-a603-c2df54455391 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:10.296613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5079b-7359-46e0-a603-c2df54455391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:10.296896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5079b-7359-46e0-a603-c2df54455391 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:10.297715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5079b-7359-46e0-a603-c2df54455391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:10.299667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5079b-7359-46e0-a603-c2df54455391 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:10.444615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 941/1866] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:10 2022] POST /identity/v3/projects => generated 391 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:10.446125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8295-41ba-4d9b-8969-a83cac8ee24f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:10.459184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8295-41ba-4d9b-8969-a83cac8ee24f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:10.563506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c460d-3a5f-46d0-99b6-61784135d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:10.563814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c460d-3a5f-46d0-99b6-61784135d415 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:10.564165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c460d-3a5f-46d0-99b6-61784135d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:10.564501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c460d-3a5f-46d0-99b6-61784135d415 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:10.565237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c460d-3a5f-46d0-99b6-61784135d415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:10.567365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c460d-3a5f-46d0-99b6-61784135d415 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:10.587706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5079b-7359-46e0-a603-c2df54455391 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:10.590825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-62d5079b-7359-46e0-a603-c2df54455391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:10.606606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5079b-7359-46e0-a603-c2df54455391 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:10.611585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:10.612263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:10.612548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:10.612827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] PATH_INFO: `/v3/users/59553184ebc9434cafc7a4d92ff312c5` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:10.617277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59553184ebc9434cafc7a4d92ff312c5)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:10.618346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:10.715828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 926/1867] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:10 2022] POST /identity/v3/users => generated 302 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:10.720161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c460d-3a5f-46d0-99b6-61784135d415 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:10.737796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c460d-3a5f-46d0-99b6-61784135d415 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:10.744659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d79bc-cb29-427e-bf9b-e82d746032f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:10.746006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d79bc-cb29-427e-bf9b-e82d746032f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:10.746006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d79bc-cb29-427e-bf9b-e82d746032f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:10.746006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d79bc-cb29-427e-bf9b-e82d746032f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:10.746651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d79bc-cb29-427e-bf9b-e82d746032f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:10.748377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d79bc-cb29-427e-bf9b-e82d746032f5 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:10.761119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 927/1868] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:10.766849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d79bc-cb29-427e-bf9b-e82d746032f5 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:10.778840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d79bc-cb29-427e-bf9b-e82d746032f5 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:10.785451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb5a34-adf2-457a-b97f-1fb914bf69d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:10.788688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb5a34-adf2-457a-b97f-1fb914bf69d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:10.788989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb5a34-adf2-457a-b97f-1fb914bf69d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:10.789272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb5a34-adf2-457a-b97f-1fb914bf69d5 admin admin] PATH_INFO: `/v3/projects/3a440a7af10149e195d604ac4f0e18b3/users/4c21184672c24f11a9c6bac1eaaf4cf5/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:10.810996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb5a34-adf2-457a-b97f-1fb914bf69d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a440a7af10149e195d604ac4f0e18b3, user_id=4c21184672c24f11a9c6bac1eaaf4cf5, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:10.814341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb5a34-adf2-457a-b97f-1fb914bf69d5 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:11.028290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 928/1869] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:10 2022] PUT /identity/v3/projects/3a440a7af10149e195d604ac4f0e18b3/users/4c21184672c24f11a9c6bac1eaaf4cf5/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:11.031078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb5a34-adf2-457a-b97f-1fb914bf69d5 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:11.043344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59553184ebc9434cafc7a4d92ff312c5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:11.045237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59553184ebc9434cafc7a4d92ff312c5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:11.053612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59553184ebc9434cafc7a4d92ff312c5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:11.074070 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59553184ebc9434cafc7a4d92ff312c5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:11.074070 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1caad9a4-e9f9-42a8-bac6-9b0acdfe1f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59553184ebc9434cafc7a4d92ff312c5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:11.121204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:11.157006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb5a34-adf2-457a-b97f-1fb914bf69d5 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:11.164830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261787a-02cc-4d99-8a65-6003b3a93800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:11.166355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261787a-02cc-4d99-8a65-6003b3a93800 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:11.166866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261787a-02cc-4d99-8a65-6003b3a93800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:11.167327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261787a-02cc-4d99-8a65-6003b3a93800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:11.168511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261787a-02cc-4d99-8a65-6003b3a93800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:11.173014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261787a-02cc-4d99-8a65-6003b3a93800 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:11.187904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 942/1870] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:10 2022] DELETE /identity/v3/users/59553184ebc9434cafc7a4d92ff312c5 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:11.192744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 929/1871] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:11.196207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5749fe-d787-44bd-b23d-b7f5059abaef None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:11.196591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5749fe-d787-44bd-b23d-b7f5059abaef None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:11.196881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5749fe-d787-44bd-b23d-b7f5059abaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:11.198146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261787a-02cc-4d99-8a65-6003b3a93800 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:11.200879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0261787a-02cc-4d99-8a65-6003b3a93800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:11.230477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-3d5749fe-d787-44bd-b23d-b7f5059abaef None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:11.231967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3d5749fe-d787-44bd-b23d-b7f5059abaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:11.264262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261787a-02cc-4d99-8a65-6003b3a93800 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:11.329368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 943/1872] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:11.330824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ffa8-06d5-435f-81f7-7d9b22d9b626 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:11.331115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ffa8-06d5-435f-81f7-7d9b22d9b626 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:11.331394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ffa8-06d5-435f-81f7-7d9b22d9b626 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:11.333023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 944/1873] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:09:11.341439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bd0a4-c2fe-4e21-9be6-fa8f2973d61c None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:11.341798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bd0a4-c2fe-4e21-9be6-fa8f2973d61c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:11.342146 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bd0a4-c2fe-4e21-9be6-fa8f2973d61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:11.410970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-7e8bd0a4-c2fe-4e21-9be6-fa8f2973d61c None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:11.410970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7e8bd0a4-c2fe-4e21-9be6-fa8f2973d61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:11.415118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f89a9f-4b1c-4d71-b635-d0209433b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:11.422523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f89a9f-4b1c-4d71-b635-d0209433b2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:11.422523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f89a9f-4b1c-4d71-b635-d0209433b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:11.422523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f89a9f-4b1c-4d71-b635-d0209433b2bb admin admin] PATH_INFO: `/v3/projects/3a440a7af10149e195d604ac4f0e18b3/users/4c21184672c24f11a9c6bac1eaaf4cf5/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:11.422523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f89a9f-4b1c-4d71-b635-d0209433b2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a440a7af10149e195d604ac4f0e18b3, user_id=4c21184672c24f11a9c6bac1eaaf4cf5, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:11.422523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f89a9f-4b1c-4d71-b635-d0209433b2bb admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:11.457788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 930/1874] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:11 2022] PUT /identity/v3/projects/3a440a7af10149e195d604ac4f0e18b3/users/4c21184672c24f11a9c6bac1eaaf4cf5/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:11.457788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f89a9f-4b1c-4d71-b635-d0209433b2bb admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:11.457788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c9f89a9f-4b1c-4d71-b635-d0209433b2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:11.565064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 945/1875] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:11.566786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114180ca-8f71-4e9c-b828-e177abde8e31 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:11.567148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114180ca-8f71-4e9c-b828-e177abde8e31 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:11.567497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114180ca-8f71-4e9c-b828-e177abde8e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:11.607842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f89a9f-4b1c-4d71-b635-d0209433b2bb admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:11.623130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae241e-1e5e-49ca-81d1-b3e852aa8b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:11.623784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae241e-1e5e-49ca-81d1-b3e852aa8b72 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:11.624064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae241e-1e5e-49ca-81d1-b3e852aa8b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:11.624339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae241e-1e5e-49ca-81d1-b3e852aa8b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:11.664568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-114180ca-8f71-4e9c-b828-e177abde8e31 None None] MFA Rules not processed for user `4c21184672c24f11a9c6bac1eaaf4cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:11.669349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-114180ca-8f71-4e9c-b828-e177abde8e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:11.764665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae241e-1e5e-49ca-81d1-b3e852aa8b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:11.766187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae241e-1e5e-49ca-81d1-b3e852aa8b72 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:11.779362 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 931/1876] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:11.780243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae241e-1e5e-49ca-81d1-b3e852aa8b72 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:11.781924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-16ae241e-1e5e-49ca-81d1-b3e852aa8b72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:11.827786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 946/1877] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:11.885573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114180ca-8f71-4e9c-b828-e177abde8e31 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:11.887630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-114180ca-8f71-4e9c-b828-e177abde8e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:11.892440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae241e-1e5e-49ca-81d1-b3e852aa8b72 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:11.899584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66c399-aa40-4a17-81f2-5836c360bc0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:11.900205 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66c399-aa40-4a17-81f2-5836c360bc0f service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:11.900486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66c399-aa40-4a17-81f2-5836c360bc0f service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:11.900758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66c399-aa40-4a17-81f2-5836c360bc0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:11.910361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66c399-aa40-4a17-81f2-5836c360bc0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:11.912705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66c399-aa40-4a17-81f2-5836c360bc0f service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:11.923514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 932/1878] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:11.970956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114180ca-8f71-4e9c-b828-e177abde8e31 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:11.970956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9769c5-0aca-4d4a-b105-15f269a86e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:11.970956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9769c5-0aca-4d4a-b105-15f269a86e90 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:11.970956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9769c5-0aca-4d4a-b105-15f269a86e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:11.971288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9769c5-0aca-4d4a-b105-15f269a86e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:11.973521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9769c5-0aca-4d4a-b105-15f269a86e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:11.981102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9769c5-0aca-4d4a-b105-15f269a86e90 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:11.986532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 947/1879] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:12.074488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66c399-aa40-4a17-81f2-5836c360bc0f service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:12.081096 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66c399-aa40-4a17-81f2-5836c360bc0f service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:12.085906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3123af-1eee-4475-b78d-6f9ad1a60d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:12.086682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3123af-1eee-4475-b78d-6f9ad1a60d34 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:12.087061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3123af-1eee-4475-b78d-6f9ad1a60d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:12.087428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3123af-1eee-4475-b78d-6f9ad1a60d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:12.089334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6a3123af-1eee-4475-b78d-6f9ad1a60d34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:12.161045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3123af-1eee-4475-b78d-6f9ad1a60d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:12.163005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3123af-1eee-4475-b78d-6f9ad1a60d34 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:12.174117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 933/1880] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:12.334533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9769c5-0aca-4d4a-b105-15f269a86e90 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:12.334533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ba9769c5-0aca-4d4a-b105-15f269a86e90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:12.347703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9769c5-0aca-4d4a-b105-15f269a86e90 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:12.352676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:12.353444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:12.353729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:12.354026 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] PATH_INFO: `/v3/projects/ce9d3708e9044f77936036676ec167df` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:12.355267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9d3708e9044f77936036676ec167df)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:12.357308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:12.525702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9d3708e9044f77936036676ec167df', 'request_id': 'req-584dfbee-cdf7-4d70-8ee8-91cf79a48510'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:12.629030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9d3708e9044f77936036676ec167df', 'request_id': 'req-584dfbee-cdf7-4d70-8ee8-91cf79a48510'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:12.636230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9d3708e9044f77936036676ec167df', 'request_id': 'req-584dfbee-cdf7-4d70-8ee8-91cf79a48510'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:12.648217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] The token cache is being invalidate because project ce9d3708e9044f77936036676ec167df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:12.648508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:12.649152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:12.650685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 948/1881] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:12 2022] DELETE /identity/v3/projects/ce9d3708e9044f77936036676ec167df => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:12.654677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3123af-1eee-4475-b78d-6f9ad1a60d34 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:12.666149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3123af-1eee-4475-b78d-6f9ad1a60d34 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:12.724698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:12.725391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:12.725839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:12.726287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] PATH_INFO: `/v3/users/0f79e9387a3f4f5fbac8c9b6bbcdbb9c` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:12.727670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f79e9387a3f4f5fbac8c9b6bbcdbb9c)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:12.729787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:12.997557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f79e9387a3f4f5fbac8c9b6bbcdbb9c'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:13.006203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f79e9387a3f4f5fbac8c9b6bbcdbb9c'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:13.024627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f79e9387a3f4f5fbac8c9b6bbcdbb9c'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:13.463898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f79e9387a3f4f5fbac8c9b6bbcdbb9c'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:13.464302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f79e9387a3f4f5fbac8c9b6bbcdbb9c'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:13.466051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:13.474367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 934/1882] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:12 2022] DELETE /identity/v3/users/0f79e9387a3f4f5fbac8c9b6bbcdbb9c => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:14.032995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:14.034565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:14.047526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dfbee-cdf7-4d70-8ee8-91cf79a48510 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:14.162926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:14.163654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:14.164001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:14.164392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] PATH_INFO: `/v3/projects/44d65397bc79457ab1ed419ceb99e0a9` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:14.165665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d65397bc79457ab1ed419ceb99e0a9)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:14.167719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:15.443227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d65397bc79457ab1ed419ceb99e0a9', 'request_id': 'req-303bbb79-d4d7-47b7-913c-7b5b959faba2'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:15.488563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:15.490981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:15.570407 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc2642-7443-473c-9dd7-a360c38a84cf admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:15.624069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079d31-0f1f-410a-8b41-2f5c1df20f29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:15.625091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079d31-0f1f-410a-8b41-2f5c1df20f29 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:15.625328 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079d31-0f1f-410a-8b41-2f5c1df20f29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:15.625601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079d31-0f1f-410a-8b41-2f5c1df20f29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:15.625878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d65397bc79457ab1ed419ceb99e0a9', 'request_id': 'req-303bbb79-d4d7-47b7-913c-7b5b959faba2'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:15.627531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-47079d31-0f1f-410a-8b41-2f5c1df20f29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:15.636375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d65397bc79457ab1ed419ceb99e0a9', 'request_id': 'req-303bbb79-d4d7-47b7-913c-7b5b959faba2'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:15.652855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] The token cache is being invalidate because project 44d65397bc79457ab1ed419ceb99e0a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:15.653153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:15.653832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-303bbb79-d4d7-47b7-913c-7b5b959faba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:15.655404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 949/1883] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:14 2022] DELETE /identity/v3/projects/44d65397bc79457ab1ed419ceb99e0a9 => generated 0 bytes in 1623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:15.660329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881cff-4874-4775-b8b4-1222f4b04d15 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:15.660625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881cff-4874-4775-b8b4-1222f4b04d15 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:15.661108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881cff-4874-4775-b8b4-1222f4b04d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:15.682045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c9881cff-4874-4775-b8b4-1222f4b04d15 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:15.683631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c9881cff-4874-4775-b8b4-1222f4b04d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:15.701329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079d31-0f1f-410a-8b41-2f5c1df20f29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:15.702973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079d31-0f1f-410a-8b41-2f5c1df20f29 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:15.715560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 935/1884] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:15.757439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 950/1885] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:15.766391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262887e-9deb-474b-a50c-426950280563 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:15.766678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262887e-9deb-474b-a50c-426950280563 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:15.766955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262887e-9deb-474b-a50c-426950280563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:15.787268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-4262887e-9deb-474b-a50c-426950280563 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:15.791513 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4262887e-9deb-474b-a50c-426950280563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:15.796627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 936/1886] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:15.801020 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881cff-4874-4775-b8b4-1222f4b04d15 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:15.811196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881cff-4874-4775-b8b4-1222f4b04d15 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:15.816137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d156ef-23d1-49ef-afda-1c0115b8a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:15.825811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d156ef-23d1-49ef-afda-1c0115b8a469 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:15.825811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d156ef-23d1-49ef-afda-1c0115b8a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:15.825811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d156ef-23d1-49ef-afda-1c0115b8a469 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:15.825811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d156ef-23d1-49ef-afda-1c0115b8a469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:15.825811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d156ef-23d1-49ef-afda-1c0115b8a469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:15.825811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d156ef-23d1-49ef-afda-1c0115b8a469 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:15.838285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 951/1887] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:09:15.839516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262887e-9deb-474b-a50c-426950280563 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:15.843633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:15.850424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262887e-9deb-474b-a50c-426950280563 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:15.859636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99106a11-2b39-481a-aa5f-03d8d4b69ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:15.860386 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106a11-2b39-481a-aa5f-03d8d4b69ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:15.860784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106a11-2b39-481a-aa5f-03d8d4b69ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:15.861122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99106a11-2b39-481a-aa5f-03d8d4b69ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:15.861839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99106a11-2b39-481a-aa5f-03d8d4b69ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:15.863857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99106a11-2b39-481a-aa5f-03d8d4b69ee4 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:16.083390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 937/1888] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:15 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:16.084818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d156ef-23d1-49ef-afda-1c0115b8a469 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:16.095438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d156ef-23d1-49ef-afda-1c0115b8a469 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:16.160678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:16.212180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582cec4-6035-4748-b443-9dced15a5418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:16.215596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582cec4-6035-4748-b443-9dced15a5418 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:16.215596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582cec4-6035-4748-b443-9dced15a5418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:16.215596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582cec4-6035-4748-b443-9dced15a5418 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:16.215596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582cec4-6035-4748-b443-9dced15a5418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:16.216154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582cec4-6035-4748-b443-9dced15a5418 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:16.356030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 952/1889] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:16 2022] POST /identity/v3/users => generated 291 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:16.361804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99106a11-2b39-481a-aa5f-03d8d4b69ee4 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:16.371968 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99106a11-2b39-481a-aa5f-03d8d4b69ee4 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:16.379593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f5fe8-d105-4188-b30b-f5e1a064c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:16.379593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f5fe8-d105-4188-b30b-f5e1a064c2fe admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:16.379593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f5fe8-d105-4188-b30b-f5e1a064c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:16.379593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f5fe8-d105-4188-b30b-f5e1a064c2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:16.380029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f5fe8-d105-4188-b30b-f5e1a064c2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:16.380705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f5fe8-d105-4188-b30b-f5e1a064c2fe admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:16.391714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 938/1890] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:16.395484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582cec4-6035-4748-b443-9dced15a5418 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:16.408080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582cec4-6035-4748-b443-9dced15a5418 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:16.413557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bb91a-cfce-4bb2-a4b6-4c44c4d9cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:16.416425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bb91a-cfce-4bb2-a4b6-4c44c4d9cfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:16.416425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bb91a-cfce-4bb2-a4b6-4c44c4d9cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:16.416425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bb91a-cfce-4bb2-a4b6-4c44c4d9cfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:16.416425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bb91a-cfce-4bb2-a4b6-4c44c4d9cfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:16.417178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bb91a-cfce-4bb2-a4b6-4c44c4d9cfd6 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:16.429039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 953/1891] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:16.433220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f5fe8-d105-4188-b30b-f5e1a064c2fe admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:16.443812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f5fe8-d105-4188-b30b-f5e1a064c2fe admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:16.449028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4edcb-35ae-49fc-aeba-c10f6ebb2c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:16.449790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4edcb-35ae-49fc-aeba-c10f6ebb2c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:16.450065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4edcb-35ae-49fc-aeba-c10f6ebb2c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:16.454992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4edcb-35ae-49fc-aeba-c10f6ebb2c1c admin admin] PATH_INFO: `/v3/projects/4f57a9d78e59404e8b60049197d41267/users/b00fe3eec71f4b93a160a26a2d45061b/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:16.466070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4edcb-35ae-49fc-aeba-c10f6ebb2c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f57a9d78e59404e8b60049197d41267, user_id=b00fe3eec71f4b93a160a26a2d45061b, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:16.468930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4edcb-35ae-49fc-aeba-c10f6ebb2c1c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:16.561344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 939/1892] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:16 2022] PUT /identity/v3/projects/4f57a9d78e59404e8b60049197d41267/users/b00fe3eec71f4b93a160a26a2d45061b/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:16.572309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2646e-024f-4baf-951d-a573e1d97cd1 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:16.573159 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2646e-024f-4baf-951d-a573e1d97cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:16.573630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2646e-024f-4baf-951d-a573e1d97cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:16.635030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-52d2646e-024f-4baf-951d-a573e1d97cd1 None None] MFA Rules not processed for user `b00fe3eec71f4b93a160a26a2d45061b`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:16.636583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-52d2646e-024f-4baf-951d-a573e1d97cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:16.707949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 954/1893] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:16.712922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4edcb-35ae-49fc-aeba-c10f6ebb2c1c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:16.780970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2646e-024f-4baf-951d-a573e1d97cd1 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:16.782496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-52d2646e-024f-4baf-951d-a573e1d97cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:16.799853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4edcb-35ae-49fc-aeba-c10f6ebb2c1c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:16.804785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ccc7-5362-4659-856e-e678b83554a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:16.805401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ccc7-5362-4659-856e-e678b83554a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:16.805682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ccc7-5362-4659-856e-e678b83554a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:16.805957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ccc7-5362-4659-856e-e678b83554a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:16.806643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ccc7-5362-4659-856e-e678b83554a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:16.810826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ccc7-5362-4659-856e-e678b83554a9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:16.842311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2646e-024f-4baf-951d-a573e1d97cd1 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:16.846054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac04e48-e85f-4baf-8f76-6c2d6b8abf84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:16.846755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04e48-e85f-4baf-8f76-6c2d6b8abf84 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:16.846975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04e48-e85f-4baf-8f76-6c2d6b8abf84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:16.847240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac04e48-e85f-4baf-8f76-6c2d6b8abf84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:16.849781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fac04e48-e85f-4baf-8f76-6c2d6b8abf84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:16.917424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac04e48-e85f-4baf-8f76-6c2d6b8abf84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:16.919777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac04e48-e85f-4baf-8f76-6c2d6b8abf84 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:16.922094 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 940/1894] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:16 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:16.925996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ccc7-5362-4659-856e-e678b83554a9 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:16.929475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 955/1895] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:16.990505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ccc7-5362-4659-856e-e678b83554a9 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:16.995195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c826c-7c8b-445f-a12b-0a44169f8bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:16.995803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c826c-7c8b-445f-a12b-0a44169f8bca admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:16.996088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c826c-7c8b-445f-a12b-0a44169f8bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:16.996365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c826c-7c8b-445f-a12b-0a44169f8bca admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:16.997006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c826c-7c8b-445f-a12b-0a44169f8bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:16.998969 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c826c-7c8b-445f-a12b-0a44169f8bca admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:17.115003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 941/1896] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:16 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:17.119264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac04e48-e85f-4baf-8f76-6c2d6b8abf84 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:17.131018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac04e48-e85f-4baf-8f76-6c2d6b8abf84 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:17.135646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9f60-4341-4afb-8e3e-ff52edbbde39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:17.136308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9f60-4341-4afb-8e3e-ff52edbbde39 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:17.136591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9f60-4341-4afb-8e3e-ff52edbbde39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:17.136868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9f60-4341-4afb-8e3e-ff52edbbde39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:17.137515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c9f60-4341-4afb-8e3e-ff52edbbde39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:17.139134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c9f60-4341-4afb-8e3e-ff52edbbde39 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:17.150106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 956/1897] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:17.154547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c826c-7c8b-445f-a12b-0a44169f8bca admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:17.164778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c826c-7c8b-445f-a12b-0a44169f8bca admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:17.169731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e84e0-6479-4f29-96c4-627166244fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:17.180703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e84e0-6479-4f29-96c4-627166244fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:17.180703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e84e0-6479-4f29-96c4-627166244fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:17.180703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e84e0-6479-4f29-96c4-627166244fe6 admin admin] PATH_INFO: `/v3/projects/b2de3d7f92ab429c986ccc6d98404e37/users/d86b37be8b104fdba37c1302c78b3c9b/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:17.186048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e84e0-6479-4f29-96c4-627166244fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2de3d7f92ab429c986ccc6d98404e37, user_id=d86b37be8b104fdba37c1302c78b3c9b, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:17.188776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e84e0-6479-4f29-96c4-627166244fe6 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:17.343916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 942/1898] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:17 2022] PUT /identity/v3/projects/b2de3d7f92ab429c986ccc6d98404e37/users/d86b37be8b104fdba37c1302c78b3c9b/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:17.347987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9f60-4341-4afb-8e3e-ff52edbbde39 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:17.359043 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9f60-4341-4afb-8e3e-ff52edbbde39 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:17.462291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d6187-e4ac-4dcd-803e-3dcb46a00af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:17.462931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d6187-e4ac-4dcd-803e-3dcb46a00af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:17.463213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d6187-e4ac-4dcd-803e-3dcb46a00af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:17.463480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d6187-e4ac-4dcd-803e-3dcb46a00af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:17.464133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d6187-e4ac-4dcd-803e-3dcb46a00af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:17.465980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d6187-e4ac-4dcd-803e-3dcb46a00af1 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:17.480720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 957/1899] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:17.481464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e84e0-6479-4f29-96c4-627166244fe6 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:17.492800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e84e0-6479-4f29-96c4-627166244fe6 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:17.498226 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1e655-86d8-406a-ad4d-06935c4793cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:17.498616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1e655-86d8-406a-ad4d-06935c4793cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:17.498866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1e655-86d8-406a-ad4d-06935c4793cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:17.499136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1e655-86d8-406a-ad4d-06935c4793cb admin admin] PATH_INFO: `/v3/projects/b2de3d7f92ab429c986ccc6d98404e37/users/d86b37be8b104fdba37c1302c78b3c9b/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:17.501018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1e655-86d8-406a-ad4d-06935c4793cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2de3d7f92ab429c986ccc6d98404e37, user_id=d86b37be8b104fdba37c1302c78b3c9b, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:17.503752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1e655-86d8-406a-ad4d-06935c4793cb admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:17.514631 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 943/1900] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:17 2022] PUT /identity/v3/projects/b2de3d7f92ab429c986ccc6d98404e37/users/d86b37be8b104fdba37c1302c78b3c9b/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:17.525370 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5ea4b-3804-4bce-b2d0-4403a7319278 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:17.525835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5ea4b-3804-4bce-b2d0-4403a7319278 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:17.526141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5ea4b-3804-4bce-b2d0-4403a7319278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:17.557086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e8f5ea4b-3804-4bce-b2d0-4403a7319278 None None] MFA Rules not processed for user `d86b37be8b104fdba37c1302c78b3c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:17.558382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e8f5ea4b-3804-4bce-b2d0-4403a7319278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:17.634024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 958/1901] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:17.951111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1e655-86d8-406a-ad4d-06935c4793cb admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:17.952798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-78e1e655-86d8-406a-ad4d-06935c4793cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:18.012316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1e655-86d8-406a-ad4d-06935c4793cb admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:18.015821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eed435-a392-491e-b7eb-350fbb934d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:18.016419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eed435-a392-491e-b7eb-350fbb934d24 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:18.016694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eed435-a392-491e-b7eb-350fbb934d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:18.016980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eed435-a392-491e-b7eb-350fbb934d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:18.027003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eed435-a392-491e-b7eb-350fbb934d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:18.028594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eed435-a392-491e-b7eb-350fbb934d24 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:18.038671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 944/1902] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:19.160363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5ea4b-3804-4bce-b2d0-4403a7319278 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:19.171943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5ea4b-3804-4bce-b2d0-4403a7319278 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:19.177572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7f409-0d2c-4497-a9cb-14b893bd608d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:19.179768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7f409-0d2c-4497-a9cb-14b893bd608d service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:19.180055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7f409-0d2c-4497-a9cb-14b893bd608d service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:19.180336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7f409-0d2c-4497-a9cb-14b893bd608d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:19.241607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7f409-0d2c-4497-a9cb-14b893bd608d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:19.243161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7f409-0d2c-4497-a9cb-14b893bd608d service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:19.252929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 959/1903] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:19.769334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:20.108246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eed435-a392-491e-b7eb-350fbb934d24 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:20.172309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eed435-a392-491e-b7eb-350fbb934d24 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:20.178732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:20.179376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:20.179663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:20.179963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] PATH_INFO: `/v3/users/b00fe3eec71f4b93a160a26a2d45061b` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:20.183343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00fe3eec71f4b93a160a26a2d45061b)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:20.185943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:20.290152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7f409-0d2c-4497-a9cb-14b893bd608d service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:20.291718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-08c7f409-0d2c-4497-a9cb-14b893bd608d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:20.306400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7f409-0d2c-4497-a9cb-14b893bd608d service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:20.311363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:20.311997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:20.312276 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:20.312735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] PATH_INFO: `/v3/users/f0da2ad74a3b4f6e8863643756f18514` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:20.313911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0da2ad74a3b4f6e8863643756f18514)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:20.315886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:20.439397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00fe3eec71f4b93a160a26a2d45061b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:20.449524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00fe3eec71f4b93a160a26a2d45061b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:20.464764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00fe3eec71f4b93a160a26a2d45061b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:20.598720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00fe3eec71f4b93a160a26a2d45061b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:20.600477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a0538859-262e-4762-a7af-a9311265e9c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00fe3eec71f4b93a160a26a2d45061b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:20.610118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 945/1904] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:20 2022] DELETE /identity/v3/users/b00fe3eec71f4b93a160a26a2d45061b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:20.616326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0da2ad74a3b4f6e8863643756f18514'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:20.616326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0da2ad74a3b4f6e8863643756f18514'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:20.626961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0da2ad74a3b4f6e8863643756f18514'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:20.628049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb824af-b17c-4768-a1b3-51254e910ac9 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:20.628503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb824af-b17c-4768-a1b3-51254e910ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:20.628812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb824af-b17c-4768-a1b3-51254e910ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:20.641680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0da2ad74a3b4f6e8863643756f18514'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:20.644811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-20a1c06b-7399-43f7-a1f8-bdd64eb143d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0da2ad74a3b4f6e8863643756f18514'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:20.649619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-acb824af-b17c-4768-a1b3-51254e910ac9 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:20.650976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-acb824af-b17c-4768-a1b3-51254e910ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:20.719080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 946/1905] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:20.728805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb824af-b17c-4768-a1b3-51254e910ac9 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:20.730267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-acb824af-b17c-4768-a1b3-51254e910ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:20.772933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 960/1906] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:20 2022] DELETE /identity/v3/users/f0da2ad74a3b4f6e8863643756f18514 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:20.778740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507621d-6363-4981-ad7b-63e26b5601c4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:20.779016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507621d-6363-4981-ad7b-63e26b5601c4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:20.779559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507621d-6363-4981-ad7b-63e26b5601c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:20.807950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-3507621d-6363-4981-ad7b-63e26b5601c4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:20.809309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3507621d-6363-4981-ad7b-63e26b5601c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:20.834002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb824af-b17c-4768-a1b3-51254e910ac9 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:20.905826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbad2d7-67f7-4dfd-a7fd-709f6e015e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:20.907038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbad2d7-67f7-4dfd-a7fd-709f6e015e23 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:20.907038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbad2d7-67f7-4dfd-a7fd-709f6e015e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:20.907265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbad2d7-67f7-4dfd-a7fd-709f6e015e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:20.993171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 961/1907] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:21.008081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507621d-6363-4981-ad7b-63e26b5601c4 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:21.024475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507621d-6363-4981-ad7b-63e26b5601c4 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:21.028520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbad2d7-67f7-4dfd-a7fd-709f6e015e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:21.030100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbad2d7-67f7-4dfd-a7fd-709f6e015e23 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:21.047415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb02c4-bb9f-46e5-9e45-d74d80681380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:21.049549 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 947/1908] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:21.050936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb02c4-bb9f-46e5-9e45-d74d80681380 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:21.051299 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb02c4-bb9f-46e5-9e45-d74d80681380 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:21.051654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb02c4-bb9f-46e5-9e45-d74d80681380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:21.070986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb02c4-bb9f-46e5-9e45-d74d80681380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:21.072623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb02c4-bb9f-46e5-9e45-d74d80681380 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:21.085030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 962/1909] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:21.805089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbad2d7-67f7-4dfd-a7fd-709f6e015e23 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:21.806658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb02c4-bb9f-46e5-9e45-d74d80681380 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:21.810347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-94fb02c4-bb9f-46e5-9e45-d74d80681380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:21.811329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-3cbad2d7-67f7-4dfd-a7fd-709f6e015e23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:21.852790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb02c4-bb9f-46e5-9e45-d74d80681380 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:21.855110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbad2d7-67f7-4dfd-a7fd-709f6e015e23 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:21.859418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:21.860497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:21.860972 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:21.861454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] PATH_INFO: `/v3/projects/21875d9429f7496f9d6c6424c2994837` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:21.862842 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21875d9429f7496f9d6c6424c2994837)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:21.865762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:21.871878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:21.872523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:21.872727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:21.873003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] PATH_INFO: `/v3/projects/4f57a9d78e59404e8b60049197d41267` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:21.877098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f57a9d78e59404e8b60049197d41267)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:21.882340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:21.964292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:22.042171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21875d9429f7496f9d6c6424c2994837', 'request_id': 'req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.042630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f57a9d78e59404e8b60049197d41267', 'request_id': 'req-74b73153-34d4-40c0-b89f-81f306bd7852'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.048724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f57a9d78e59404e8b60049197d41267', 'request_id': 'req-74b73153-34d4-40c0-b89f-81f306bd7852'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.054802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f57a9d78e59404e8b60049197d41267', 'request_id': 'req-74b73153-34d4-40c0-b89f-81f306bd7852'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.126953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21875d9429f7496f9d6c6424c2994837', 'request_id': 'req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.140025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21875d9429f7496f9d6c6424c2994837', 'request_id': 'req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.152795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] The token cache is being invalidate because project 21875d9429f7496f9d6c6424c2994837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:22.153151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.154067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.157273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 963/1910] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:21 2022] DELETE /identity/v3/projects/21875d9429f7496f9d6c6424c2994837 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:22.164194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:22.164194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:22.220738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] The token cache is being invalidate because project 4f57a9d78e59404e8b60049197d41267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:22.221196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.232104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.232104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 948/1911] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:21 2022] DELETE /identity/v3/projects/4f57a9d78e59404e8b60049197d41267 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:22.232104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:22.232104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:22.250239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf1fbd-c09d-43ad-a2f4-8c57f3911922 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:22.314124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b73153-34d4-40c0-b89f-81f306bd7852 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:22.322081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:22.322286 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:22.322851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:22.322971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:22.323126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:22.323218 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:22.323394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] PATH_INFO: `/v3/users/4c21184672c24f11a9c6bac1eaaf4cf5` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:22.323496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] PATH_INFO: `/v3/users/bba50044cd2e411c853d73310df3a98b` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:22.324529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c21184672c24f11a9c6bac1eaaf4cf5)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:22.324672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba50044cd2e411c853d73310df3a98b)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:22.326490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:22.326628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:22.560382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba50044cd2e411c853d73310df3a98b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.561289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba50044cd2e411c853d73310df3a98b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.570861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba50044cd2e411c853d73310df3a98b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.583735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba50044cd2e411c853d73310df3a98b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.584607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba50044cd2e411c853d73310df3a98b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.611405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c21184672c24f11a9c6bac1eaaf4cf5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.635206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c21184672c24f11a9c6bac1eaaf4cf5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.653726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c21184672c24f11a9c6bac1eaaf4cf5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.664658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 964/1912] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:22 2022] DELETE /identity/v3/users/bba50044cd2e411c853d73310df3a98b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:22.665574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:22.666941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:22.733759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65afa04-dd7d-4ffc-b0ec-adac6f273aaa admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:22.738931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:22.740113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:22.740541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:22.740814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] PATH_INFO: `/v3/users/d86b37be8b104fdba37c1302c78b3c9b` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:22.743069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86b37be8b104fdba37c1302c78b3c9b)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:22.745164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:22.814301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c21184672c24f11a9c6bac1eaaf4cf5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.815212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61152ce4-dfd2-4688-b344-496e71fc3764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c21184672c24f11a9c6bac1eaaf4cf5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:22.823516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 949/1913] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:22 2022] DELETE /identity/v3/users/4c21184672c24f11a9c6bac1eaaf4cf5 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:22.824776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbd764-44d5-4076-9c39-3aecfdfde887 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:22.825058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbd764-44d5-4076-9c39-3aecfdfde887 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:22.825817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbd764-44d5-4076-9c39-3aecfdfde887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:22.849049 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-eebbd764-44d5-4076-9c39-3aecfdfde887 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:22.850995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-eebbd764-44d5-4076-9c39-3aecfdfde887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:22.924596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 950/1914] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:22.936862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbd764-44d5-4076-9c39-3aecfdfde887 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:22.939305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-eebbd764-44d5-4076-9c39-3aecfdfde887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:23.016985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbd764-44d5-4076-9c39-3aecfdfde887 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:23.023788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22246ac-ed2f-4f46-9bc4-9f9dbffa9be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:23.025655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22246ac-ed2f-4f46-9bc4-9f9dbffa9be0 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:23.026302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22246ac-ed2f-4f46-9bc4-9f9dbffa9be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:23.026901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86b37be8b104fdba37c1302c78b3c9b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:23.027461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22246ac-ed2f-4f46-9bc4-9f9dbffa9be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:23.027802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86b37be8b104fdba37c1302c78b3c9b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:23.030122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c22246ac-ed2f-4f46-9bc4-9f9dbffa9be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:23.046470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86b37be8b104fdba37c1302c78b3c9b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:23.059333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22246ac-ed2f-4f46-9bc4-9f9dbffa9be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:23.061727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22246ac-ed2f-4f46-9bc4-9f9dbffa9be0 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:23.078523 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86b37be8b104fdba37c1302c78b3c9b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:23.080387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86b37be8b104fdba37c1302c78b3c9b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:23.082164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 951/1915] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:23.180858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 965/1916] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:22 2022] DELETE /identity/v3/users/d86b37be8b104fdba37c1302c78b3c9b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:23.322082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:23.708848 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22246ac-ed2f-4f46-9bc4-9f9dbffa9be0 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:23.709996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c22246ac-ed2f-4f46-9bc4-9f9dbffa9be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:23.723107 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22246ac-ed2f-4f46-9bc4-9f9dbffa9be0 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:23.753280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:23.755888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:23.794202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:23.794873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:23.795152 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:23.795426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] PATH_INFO: `/v3/projects/59ebe1bccad5484ab1454308f9579cdd` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:23.796559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ebe1bccad5484ab1454308f9579cdd)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:23.801421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:23.852647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f3ad3-86dc-4655-8f71-cc5bacbbf5e5 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:23.858052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:23.859135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:23.859568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:23.859991 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] PATH_INFO: `/v3/projects/b2de3d7f92ab429c986ccc6d98404e37` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:23.861485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2de3d7f92ab429c986ccc6d98404e37)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:23.863639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:23.907815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ebe1bccad5484ab1454308f9579cdd', 'request_id': 'req-65c573e4-abfa-4f0c-a879-4eee26f54843'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:23.914602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ebe1bccad5484ab1454308f9579cdd', 'request_id': 'req-65c573e4-abfa-4f0c-a879-4eee26f54843'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:23.923168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ebe1bccad5484ab1454308f9579cdd', 'request_id': 'req-65c573e4-abfa-4f0c-a879-4eee26f54843'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:23.970418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2de3d7f92ab429c986ccc6d98404e37', 'request_id': 'req-6e131ae0-f3c9-457d-887a-a1c355df998e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.025433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] The token cache is being invalidate because project 59ebe1bccad5484ab1454308f9579cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:24.025773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.027546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.030716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 952/1917] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:23 2022] DELETE /identity/v3/projects/59ebe1bccad5484ab1454308f9579cdd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:24.030716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:24.032195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:24.080597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2de3d7f92ab429c986ccc6d98404e37', 'request_id': 'req-6e131ae0-f3c9-457d-887a-a1c355df998e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.090544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2de3d7f92ab429c986ccc6d98404e37', 'request_id': 'req-6e131ae0-f3c9-457d-887a-a1c355df998e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.105476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c573e4-abfa-4f0c-a879-4eee26f54843 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:24.108216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] The token cache is being invalidate because project b2de3d7f92ab429c986ccc6d98404e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:24.108519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.109169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.111018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 966/1918] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:23 2022] DELETE /identity/v3/projects/b2de3d7f92ab429c986ccc6d98404e37 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:24.117107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:24.118599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:24.171985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:24.172745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:24.173298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:24.173441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] PATH_INFO: `/v3/projects/3a440a7af10149e195d604ac4f0e18b3` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:24.174758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a440a7af10149e195d604ac4f0e18b3)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:24.177840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:24.206246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e131ae0-f3c9-457d-887a-a1c355df998e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:24.211998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:24.212686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:24.212963 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:24.213239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] PATH_INFO: `/v3/users/3cf4e69040934a068d7542ddbc02e993` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:24.215692 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf4e69040934a068d7542ddbc02e993)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:24.216539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:24.294755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a440a7af10149e195d604ac4f0e18b3', 'request_id': 'req-1b4483dc-da77-43cc-9265-a4d1513ed6f6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.301116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a440a7af10149e195d604ac4f0e18b3', 'request_id': 'req-1b4483dc-da77-43cc-9265-a4d1513ed6f6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.307439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a440a7af10149e195d604ac4f0e18b3', 'request_id': 'req-1b4483dc-da77-43cc-9265-a4d1513ed6f6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.421414 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] The token cache is being invalidate because project 3a440a7af10149e195d604ac4f0e18b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:24.421846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.423050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1b4483dc-da77-43cc-9265-a4d1513ed6f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.424841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 953/1919] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:24 2022] DELETE /identity/v3/projects/3a440a7af10149e195d604ac4f0e18b3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:24.426315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30720d-5322-428c-a2d6-5e177d29b622 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:24.426744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30720d-5322-428c-a2d6-5e177d29b622 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:24.429146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30720d-5322-428c-a2d6-5e177d29b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:24.453324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-4b30720d-5322-428c-a2d6-5e177d29b622 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:24.454804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4b30720d-5322-428c-a2d6-5e177d29b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:24.490734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf4e69040934a068d7542ddbc02e993'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.491448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf4e69040934a068d7542ddbc02e993'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.502848 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf4e69040934a068d7542ddbc02e993'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.518118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf4e69040934a068d7542ddbc02e993'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.518902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf4e69040934a068d7542ddbc02e993'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:24.528495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 954/1920] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:24.529796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f30b4-71d6-4f14-a67e-9dc7cbe7e616 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:24.530274 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f30b4-71d6-4f14-a67e-9dc7cbe7e616 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:24.530598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f30b4-71d6-4f14-a67e-9dc7cbe7e616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:24.554541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-e97f30b4-71d6-4f14-a67e-9dc7cbe7e616 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:24.555985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e97f30b4-71d6-4f14-a67e-9dc7cbe7e616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:24.565671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 955/1921] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:24.572259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b00fe-0f00-4d06-a860-2154a2bd7fbe None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:24.572798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b00fe-0f00-4d06-a860-2154a2bd7fbe None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:24.573621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b00fe-0f00-4d06-a860-2154a2bd7fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:24.593774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-e01b00fe-0f00-4d06-a860-2154a2bd7fbe None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:24.595165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e01b00fe-0f00-4d06-a860-2154a2bd7fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:24.605413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 956/1922] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:24.607011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043814ed-12d7-42b6-8de0-0b40625a87d3 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:24.607322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043814ed-12d7-42b6-8de0-0b40625a87d3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:24.607594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043814ed-12d7-42b6-8de0-0b40625a87d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:24.633467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 967/1923] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:24 2022] DELETE /identity/v3/users/3cf4e69040934a068d7542ddbc02e993 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:24.637667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:24.647934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-043814ed-12d7-42b6-8de0-0b40625a87d3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:24.650712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-043814ed-12d7-42b6-8de0-0b40625a87d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:24.713728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02647474-16c6-4760-a72f-647471a49a7d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:24.722548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4c796-457a-4c60-a103-10fb413ae9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:24.723473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4c796-457a-4c60-a103-10fb413ae9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:24.724291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4c796-457a-4c60-a103-10fb413ae9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:24.724678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4c796-457a-4c60-a103-10fb413ae9b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:24.725590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4c796-457a-4c60-a103-10fb413ae9b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:24.725903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4c796-457a-4c60-a103-10fb413ae9b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:24.728391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4c796-457a-4c60-a103-10fb413ae9b0 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:24.756529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 957/1924] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:24.760594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 968/1925] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:24.760730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043814ed-12d7-42b6-8de0-0b40625a87d3 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:24.762683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4c796-457a-4c60-a103-10fb413ae9b0 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:24.777587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043814ed-12d7-42b6-8de0-0b40625a87d3 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:24.780957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4c796-457a-4c60-a103-10fb413ae9b0 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:24.788757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74172e54-5682-4daf-8e2e-1d906f8896db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:24.789566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172e54-5682-4daf-8e2e-1d906f8896db admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:24.789677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172e54-5682-4daf-8e2e-1d906f8896db admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:24.790778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172e54-5682-4daf-8e2e-1d906f8896db admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:24.794635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74172e54-5682-4daf-8e2e-1d906f8896db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:24.794635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74172e54-5682-4daf-8e2e-1d906f8896db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:24.794635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74172e54-5682-4daf-8e2e-1d906f8896db admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:24.795547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa45ac-3987-4653-a4e2-cb969ddaf841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:24.796179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa45ac-3987-4653-a4e2-cb969ddaf841 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:24.796461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa45ac-3987-4653-a4e2-cb969ddaf841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:24.796735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa45ac-3987-4653-a4e2-cb969ddaf841 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:24.797451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa45ac-3987-4653-a4e2-cb969ddaf841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:24.799330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa45ac-3987-4653-a4e2-cb969ddaf841 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:24.815916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 958/1926] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:24.819241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74172e54-5682-4daf-8e2e-1d906f8896db admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:24.837768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74172e54-5682-4daf-8e2e-1d906f8896db admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:24.843515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab900e4-0050-4101-bbdf-343ffb986c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:24.844397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab900e4-0050-4101-bbdf-343ffb986c16 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:24.844691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab900e4-0050-4101-bbdf-343ffb986c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:24.845020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab900e4-0050-4101-bbdf-343ffb986c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:24.845671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab900e4-0050-4101-bbdf-343ffb986c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:24.847654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab900e4-0050-4101-bbdf-343ffb986c16 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:24.919725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 969/1927] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:24 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:24.923806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa45ac-3987-4653-a4e2-cb969ddaf841 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:24.941712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:24.951843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 959/1928] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:24 2022] POST /identity/v3/projects => generated 397 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:24.959735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab900e4-0050-4101-bbdf-343ffb986c16 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:25.060773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab900e4-0050-4101-bbdf-343ffb986c16 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:25.066161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8368532-1461-405b-868f-274c0562368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:25.068276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8368532-1461-405b-868f-274c0562368f admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.068762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8368532-1461-405b-868f-274c0562368f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.069087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8368532-1461-405b-868f-274c0562368f admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.069874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8368532-1461-405b-868f-274c0562368f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:25.072089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8368532-1461-405b-868f-274c0562368f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:25.140309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa45ac-3987-4653-a4e2-cb969ddaf841 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:25.153454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bf9f3-7295-4f62-bb04-2e7f277fb206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:25.157306 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bf9f3-7295-4f62-bb04-2e7f277fb206 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.158202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bf9f3-7295-4f62-bb04-2e7f277fb206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.159531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bf9f3-7295-4f62-bb04-2e7f277fb206 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.160764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bf9f3-7295-4f62-bb04-2e7f277fb206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:25.163665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bf9f3-7295-4f62-bb04-2e7f277fb206 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:25.280478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 960/1929] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:24 2022] POST /identity/v3/users => generated 299 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:25.281812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8368532-1461-405b-868f-274c0562368f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:25.282347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 970/1930] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:24 2022] POST /identity/v3/users => generated 286 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:25.283746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bf9f3-7295-4f62-bb04-2e7f277fb206 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:25.293771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8368532-1461-405b-868f-274c0562368f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:25.298463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bf9f3-7295-4f62-bb04-2e7f277fb206 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:25.302308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45ce6b-c408-440f-9bcc-044b346c2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:25.303124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ce6b-c408-440f-9bcc-044b346c2d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.303895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ce6b-c408-440f-9bcc-044b346c2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.305067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c3c4-9dde-4750-b4da-2f079d5be891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:25.305343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ce6b-c408-440f-9bcc-044b346c2d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.306086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c3c4-9dde-4750-b4da-2f079d5be891 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.306507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c3c4-9dde-4750-b4da-2f079d5be891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.306998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c3c4-9dde-4750-b4da-2f079d5be891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.307794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45ce6b-c408-440f-9bcc-044b346c2d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:25.307911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454c3c4-9dde-4750-b4da-2f079d5be891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:25.309675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45ce6b-c408-440f-9bcc-044b346c2d89 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:25.309832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454c3c4-9dde-4750-b4da-2f079d5be891 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:25.341350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 971/1931] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:25.347898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 961/1932] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:25.348204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c3c4-9dde-4750-b4da-2f079d5be891 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:25.351217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45ce6b-c408-440f-9bcc-044b346c2d89 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:25.372676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c3c4-9dde-4750-b4da-2f079d5be891 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:25.375366 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529073d-3939-41d3-837c-1058dec25b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:25.376229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529073d-3939-41d3-837c-1058dec25b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.376632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529073d-3939-41d3-837c-1058dec25b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.377007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529073d-3939-41d3-837c-1058dec25b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.378169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529073d-3939-41d3-837c-1058dec25b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:25.389844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45ce6b-c408-440f-9bcc-044b346c2d89 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:25.392198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529073d-3939-41d3-837c-1058dec25b0a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:25.410601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6909-b8a0-4dd2-aeeb-316d09871bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:25.411326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6909-b8a0-4dd2-aeeb-316d09871bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.411585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6909-b8a0-4dd2-aeeb-316d09871bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.411861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb6909-b8a0-4dd2-aeeb-316d09871bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.418662 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb6909-b8a0-4dd2-aeeb-316d09871bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:25.421530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 972/1933] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:25.425032 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb6909-b8a0-4dd2-aeeb-316d09871bd6 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:25.431472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529073d-3939-41d3-837c-1058dec25b0a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:25.470641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 962/1934] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:25.471605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6909-b8a0-4dd2-aeeb-316d09871bd6 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:25.471960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529073d-3939-41d3-837c-1058dec25b0a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:25.484206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb6909-b8a0-4dd2-aeeb-316d09871bd6 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:25.485526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56753bfc-c497-47c3-8655-436894bb9243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:25.486246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56753bfc-c497-47c3-8655-436894bb9243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.486520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56753bfc-c497-47c3-8655-436894bb9243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.486847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56753bfc-c497-47c3-8655-436894bb9243 admin admin] PATH_INFO: `/v3/projects/c54bcbdfc6984322ae2d1651db7bd0bf/users/94c4c3888e494473bd31161ef7f8b5da/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.489651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c35b-a22b-46f6-a756-f526ece309c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:25.490566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c35b-a22b-46f6-a756-f526ece309c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.490751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c35b-a22b-46f6-a756-f526ece309c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.490978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c35b-a22b-46f6-a756-f526ece309c0 admin admin] PATH_INFO: `/v3/projects/75d47524b57046fb8313b4a010ea02ea/users/de89290fa99b4420be0675df394945d3/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.510032 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2c35b-a22b-46f6-a756-f526ece309c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d47524b57046fb8313b4a010ea02ea, user_id=de89290fa99b4420be0675df394945d3, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:25.513164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2c35b-a22b-46f6-a756-f526ece309c0 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:25.530265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56753bfc-c497-47c3-8655-436894bb9243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54bcbdfc6984322ae2d1651db7bd0bf, user_id=94c4c3888e494473bd31161ef7f8b5da, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:25.533984 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56753bfc-c497-47c3-8655-436894bb9243 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:25.752437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 963/1935] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:25 2022] PUT /identity/v3/projects/75d47524b57046fb8313b4a010ea02ea/users/de89290fa99b4420be0675df394945d3/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:25.758454 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c35b-a22b-46f6-a756-f526ece309c0 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:25.758869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 973/1936] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:25 2022] PUT /identity/v3/projects/c54bcbdfc6984322ae2d1651db7bd0bf/users/94c4c3888e494473bd31161ef7f8b5da/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:25.759389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-17b2c35b-a22b-46f6-a756-f526ece309c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:25.764254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bd162-77c2-4828-8c21-a3c7423b04ba None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.764960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bd162-77c2-4828-8c21-a3c7423b04ba None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.765467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bd162-77c2-4828-8c21-a3c7423b04ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.799056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c08bd162-77c2-4828-8c21-a3c7423b04ba None None] MFA Rules not processed for user `de89290fa99b4420be0675df394945d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:25.800319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c08bd162-77c2-4828-8c21-a3c7423b04ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:25.845659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c35b-a22b-46f6-a756-f526ece309c0 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:25.878377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 974/1937] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:25.883115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d34574-6c7e-408c-bfe4-e1d45a776b63 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.883409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d34574-6c7e-408c-bfe4-e1d45a776b63 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.883693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d34574-6c7e-408c-bfe4-e1d45a776b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.912139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:25.912782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:25.913058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:25.913334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] PATH_INFO: `/v3/projects/5686ddcfc19d480f8a881460770f3d3b` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:25.914531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5686ddcfc19d480f8a881460770f3d3b)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:25.916428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:25.919117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-97d34574-6c7e-408c-bfe4-e1d45a776b63 None None] MFA Rules not processed for user `94c4c3888e494473bd31161ef7f8b5da`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:25.921198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-97d34574-6c7e-408c-bfe4-e1d45a776b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:25.928434 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:26.008623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 975/1938] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:26.009807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d34574-6c7e-408c-bfe4-e1d45a776b63 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:26.024461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d34574-6c7e-408c-bfe4-e1d45a776b63 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:26.029214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04369b3b-7585-4cc3-9af0-195c6419c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:26.029879 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369b3b-7585-4cc3-9af0-195c6419c09e admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:26.030164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369b3b-7585-4cc3-9af0-195c6419c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:26.030626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369b3b-7585-4cc3-9af0-195c6419c09e admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:26.031275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04369b3b-7585-4cc3-9af0-195c6419c09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:26.033196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04369b3b-7585-4cc3-9af0-195c6419c09e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:26.109268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5686ddcfc19d480f8a881460770f3d3b', 'request_id': 'req-f7278c14-dd7d-43eb-89fc-d76b3793db38'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.117367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5686ddcfc19d480f8a881460770f3d3b', 'request_id': 'req-f7278c14-dd7d-43eb-89fc-d76b3793db38'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.123583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5686ddcfc19d480f8a881460770f3d3b', 'request_id': 'req-f7278c14-dd7d-43eb-89fc-d76b3793db38'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.194513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 976/1939] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:26 2022] POST /identity/v3/projects => generated 401 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:26.194513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04369b3b-7585-4cc3-9af0-195c6419c09e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:26.194513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-04369b3b-7585-4cc3-9af0-195c6419c09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:26.213543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] The token cache is being invalidate because project 5686ddcfc19d480f8a881460770f3d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:26.213837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.216919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.218808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 964/1940] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:25 2022] DELETE /identity/v3/projects/5686ddcfc19d480f8a881460770f3d3b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:26.220270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:26.222242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:26.269127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04369b3b-7585-4cc3-9af0-195c6419c09e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:26.273918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5d574-0b9f-41ab-99f3-2c206621a65c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:26.274634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5d574-0b9f-41ab-99f3-2c206621a65c service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:26.275011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5d574-0b9f-41ab-99f3-2c206621a65c service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:26.275750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5d574-0b9f-41ab-99f3-2c206621a65c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:26.278338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-04b5d574-0b9f-41ab-99f3-2c206621a65c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:26.300937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7278c14-dd7d-43eb-89fc-d76b3793db38 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:26.362998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5d574-0b9f-41ab-99f3-2c206621a65c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:26.365327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fc06b-e3e1-4fac-8922-d46fd024d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:26.365580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5d574-0b9f-41ab-99f3-2c206621a65c service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:26.365983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fc06b-e3e1-4fac-8922-d46fd024d44c admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:26.366638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fc06b-e3e1-4fac-8922-d46fd024d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:26.366638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fc06b-e3e1-4fac-8922-d46fd024d44c admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:26.367419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fc06b-e3e1-4fac-8922-d46fd024d44c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:26.369524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fc06b-e3e1-4fac-8922-d46fd024d44c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:26.377172 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 977/1941] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:26.378011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5d574-0b9f-41ab-99f3-2c206621a65c service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:26.379563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-04b5d574-0b9f-41ab-99f3-2c206621a65c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:26.395922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5d574-0b9f-41ab-99f3-2c206621a65c service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:26.400529 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:26.401175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:26.401462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:26.401740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] PATH_INFO: `/v3/users/45e6d38b332245aa92faf569ae3ebb55` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:26.402944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e6d38b332245aa92faf569ae3ebb55)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:26.404917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:26.518084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 965/1942] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:26 2022] POST /identity/v3/users => generated 307 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:26.518084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fc06b-e3e1-4fac-8922-d46fd024d44c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:26.519546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e77fc06b-e3e1-4fac-8922-d46fd024d44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:26.531376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fc06b-e3e1-4fac-8922-d46fd024d44c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:26.536057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:26.537075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:26.537374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:26.537633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] PATH_INFO: `/v3/users/94c4c3888e494473bd31161ef7f8b5da` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:26.538811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c4c3888e494473bd31161ef7f8b5da)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:26.540718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:26.714170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e6d38b332245aa92faf569ae3ebb55'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.714901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e6d38b332245aa92faf569ae3ebb55'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.721985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e6d38b332245aa92faf569ae3ebb55'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.734716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e6d38b332245aa92faf569ae3ebb55'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.736029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e6d38b332245aa92faf569ae3ebb55'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.832659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c4c3888e494473bd31161ef7f8b5da'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.839764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c4c3888e494473bd31161ef7f8b5da'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.853061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c4c3888e494473bd31161ef7f8b5da'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.893797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 978/1943] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:26 2022] DELETE /identity/v3/users/45e6d38b332245aa92faf569ae3ebb55 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:26.894901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:26.896252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:26.962815 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7e3fd-ab9d-472e-9799-47a1e72716ee admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:26.967731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4af03-dd44-4e2b-a354-0af453ccee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:26.968348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4af03-dd44-4e2b-a354-0af453ccee45 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:26.968736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4af03-dd44-4e2b-a354-0af453ccee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:26.969011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4af03-dd44-4e2b-a354-0af453ccee45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:26.969654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4af03-dd44-4e2b-a354-0af453ccee45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:26.971260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4af03-dd44-4e2b-a354-0af453ccee45 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:26.982080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 979/1944] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:26.986522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4af03-dd44-4e2b-a354-0af453ccee45 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:26.991832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c4c3888e494473bd31161ef7f8b5da'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.992468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-883f497d-edbf-4ea8-86df-0d4dcfbe3c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c4c3888e494473bd31161ef7f8b5da'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:26.997721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4af03-dd44-4e2b-a354-0af453ccee45 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:26.998902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 966/1945] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:26 2022] DELETE /identity/v3/users/94c4c3888e494473bd31161ef7f8b5da => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:27.009719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a65f-0a5d-4e17-9fe1-b2883510c0c2 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:27.010118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a65f-0a5d-4e17-9fe1-b2883510c0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:27.010502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a65f-0a5d-4e17-9fe1-b2883510c0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:27.029425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-91c5a65f-0a5d-4e17-9fe1-b2883510c0c2 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:27.030682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-91c5a65f-0a5d-4e17-9fe1-b2883510c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:27.061787 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684ce88-581a-48d5-a3ff-b9c673392c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:27.062909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ce88-581a-48d5-a3ff-b9c673392c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:27.063178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ce88-581a-48d5-a3ff-b9c673392c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:27.063516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684ce88-581a-48d5-a3ff-b9c673392c7a admin admin] PATH_INFO: `/v3/projects/9cd635a17fa84ee3b97c88ca1822ec82/users/4ca6f2ebaf9645b9838ff66a3d19cdde/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:27.084713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684ce88-581a-48d5-a3ff-b9c673392c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd635a17fa84ee3b97c88ca1822ec82, user_id=4ca6f2ebaf9645b9838ff66a3d19cdde, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:27.087692 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684ce88-581a-48d5-a3ff-b9c673392c7a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:27.095411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 967/1946] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:27.105359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a65f-0a5d-4e17-9fe1-b2883510c0c2 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:27.106768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-91c5a65f-0a5d-4e17-9fe1-b2883510c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:27.163535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a65f-0a5d-4e17-9fe1-b2883510c0c2 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:27.168279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fcc28-1230-4ff5-843b-ea9d2516aa41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:27.168898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcc28-1230-4ff5-843b-ea9d2516aa41 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:27.169574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcc28-1230-4ff5-843b-ea9d2516aa41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:27.169878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcc28-1230-4ff5-843b-ea9d2516aa41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:27.177396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 980/1947] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:26 2022] PUT /identity/v3/projects/9cd635a17fa84ee3b97c88ca1822ec82/users/4ca6f2ebaf9645b9838ff66a3d19cdde/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:27.178693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684ce88-581a-48d5-a3ff-b9c673392c7a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:27.180648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1684ce88-581a-48d5-a3ff-b9c673392c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:27.198793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fcc28-1230-4ff5-843b-ea9d2516aa41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:27.200286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fcc28-1230-4ff5-843b-ea9d2516aa41 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:27.216255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 968/1948] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:27.265862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:27.286191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684ce88-581a-48d5-a3ff-b9c673392c7a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:27.291605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea775f47-4e92-4c6e-b51c-12ab6af4a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:27.292239 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea775f47-4e92-4c6e-b51c-12ab6af4a241 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:27.292526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea775f47-4e92-4c6e-b51c-12ab6af4a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:27.292797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea775f47-4e92-4c6e-b51c-12ab6af4a241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:27.293596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea775f47-4e92-4c6e-b51c-12ab6af4a241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:27.295350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea775f47-4e92-4c6e-b51c-12ab6af4a241 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:27.315610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 981/1949] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:27.319052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fcc28-1230-4ff5-843b-ea9d2516aa41 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:27.331760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fcc28-1230-4ff5-843b-ea9d2516aa41 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:27.337662 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd6f99-d441-4321-a727-9c5a91360bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:27.338512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd6f99-d441-4321-a727-9c5a91360bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:27.338710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd6f99-d441-4321-a727-9c5a91360bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:27.338990 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd6f99-d441-4321-a727-9c5a91360bc8 admin admin] PATH_INFO: `/v3/projects/9cd635a17fa84ee3b97c88ca1822ec82/users/4ca6f2ebaf9645b9838ff66a3d19cdde/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:27.341586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd6f99-d441-4321-a727-9c5a91360bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd635a17fa84ee3b97c88ca1822ec82, user_id=4ca6f2ebaf9645b9838ff66a3d19cdde, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:27.344327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd6f99-d441-4321-a727-9c5a91360bc8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:27.362514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 969/1950] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:27 2022] PUT /identity/v3/projects/9cd635a17fa84ee3b97c88ca1822ec82/users/4ca6f2ebaf9645b9838ff66a3d19cdde/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:27.367559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e00d3-66ac-4e6f-ba2d-9bc5df114c71 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:27.367858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e00d3-66ac-4e6f-ba2d-9bc5df114c71 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:27.368143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e00d3-66ac-4e6f-ba2d-9bc5df114c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:27.407831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-0a7e00d3-66ac-4e6f-ba2d-9bc5df114c71 None None] MFA Rules not processed for user `4ca6f2ebaf9645b9838ff66a3d19cdde`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:27.410535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0a7e00d3-66ac-4e6f-ba2d-9bc5df114c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:27.513165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 982/1951] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:27 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:27.525196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd6f99-d441-4321-a727-9c5a91360bc8 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:27.526987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6afd6f99-d441-4321-a727-9c5a91360bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:27.561336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e00d3-66ac-4e6f-ba2d-9bc5df114c71 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:27.562853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0a7e00d3-66ac-4e6f-ba2d-9bc5df114c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:27.609420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd6f99-d441-4321-a727-9c5a91360bc8 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:27.613981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7693057-0429-43da-b773-e2a0803e1172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:27.621544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7693057-0429-43da-b773-e2a0803e1172 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:27.621903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7693057-0429-43da-b773-e2a0803e1172 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:27.622300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7693057-0429-43da-b773-e2a0803e1172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:27.638499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7693057-0429-43da-b773-e2a0803e1172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:27.640410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7693057-0429-43da-b773-e2a0803e1172 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:27.670767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e00d3-66ac-4e6f-ba2d-9bc5df114c71 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:27.675737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:27.675988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 970/1952] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:27.681163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:27.681163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:27.681163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] PATH_INFO: `/v3/projects/09e1a63ec4474a21b6cfa5f0cfd9757c` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:27.681163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e1a63ec4474a21b6cfa5f0cfd9757c)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:27.681163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:27.854792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e1a63ec4474a21b6cfa5f0cfd9757c', 'request_id': 'req-88c6284a-2940-4a0a-81de-01adaa32194d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:27.898534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7693057-0429-43da-b773-e2a0803e1172 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:27.900081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b7693057-0429-43da-b773-e2a0803e1172 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:27.913618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7693057-0429-43da-b773-e2a0803e1172 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:27.952035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e1a63ec4474a21b6cfa5f0cfd9757c', 'request_id': 'req-88c6284a-2940-4a0a-81de-01adaa32194d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:27.961694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e1a63ec4474a21b6cfa5f0cfd9757c', 'request_id': 'req-88c6284a-2940-4a0a-81de-01adaa32194d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:27.978610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] The token cache is being invalidate because project 09e1a63ec4474a21b6cfa5f0cfd9757c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:27.979194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:27.980113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:27.981962 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 983/1953] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:27 2022] DELETE /identity/v3/projects/09e1a63ec4474a21b6cfa5f0cfd9757c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:27.986479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:27.986479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:27.986479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:27.986479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] PATH_INFO: `/v3/projects/c54bcbdfc6984322ae2d1651db7bd0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:27.986831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54bcbdfc6984322ae2d1651db7bd0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:27.987866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:27.989065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:27.990636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:28.059721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6284a-2940-4a0a-81de-01adaa32194d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.063536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204e537-827b-4e89-b95f-eb4981460f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.064174 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204e537-827b-4e89-b95f-eb4981460f3a service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.064453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204e537-827b-4e89-b95f-eb4981460f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.064726 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204e537-827b-4e89-b95f-eb4981460f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.066532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5204e537-827b-4e89-b95f-eb4981460f3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:28.129359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204e537-827b-4e89-b95f-eb4981460f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.131055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204e537-827b-4e89-b95f-eb4981460f3a service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.137877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54bcbdfc6984322ae2d1651db7bd0bf', 'request_id': 'req-3d25dad8-6aab-471a-b60d-8c3c61b9b819'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:28.142450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 984/1954] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:28.143940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e804a0-6829-42f3-abc8-99d73d37d721 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.144223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e804a0-6829-42f3-abc8-99d73d37d721 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.144499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e804a0-6829-42f3-abc8-99d73d37d721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.144650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54bcbdfc6984322ae2d1651db7bd0bf', 'request_id': 'req-3d25dad8-6aab-471a-b60d-8c3c61b9b819'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:28.154908 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54bcbdfc6984322ae2d1651db7bd0bf', 'request_id': 'req-3d25dad8-6aab-471a-b60d-8c3c61b9b819'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:28.172435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-42e804a0-6829-42f3-abc8-99d73d37d721 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:28.173652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-42e804a0-6829-42f3-abc8-99d73d37d721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:28.234837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 985/1955] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:28.243597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbf318-f2c1-4935-becc-f9311b47304e None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.243891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbf318-f2c1-4935-becc-f9311b47304e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.244171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbf318-f2c1-4935-becc-f9311b47304e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.257417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] The token cache is being invalidate because project c54bcbdfc6984322ae2d1651db7bd0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:28.257905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:28.265959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3d25dad8-6aab-471a-b60d-8c3c61b9b819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:28.265959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 971/1956] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:27 2022] DELETE /identity/v3/projects/c54bcbdfc6984322ae2d1651db7bd0bf => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:28.266157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-1dfbf318-f2c1-4935-becc-f9311b47304e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:28.267260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1dfbf318-f2c1-4935-becc-f9311b47304e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:28.267446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806bf41-6494-480a-86f2-03b4d3559858 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.267734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806bf41-6494-480a-86f2-03b4d3559858 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.268007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806bf41-6494-480a-86f2-03b4d3559858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.279714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 986/1957] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:28.280752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbf318-f2c1-4935-becc-f9311b47304e None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.291211 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-f806bf41-6494-480a-86f2-03b4d3559858 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:28.292487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f806bf41-6494-480a-86f2-03b4d3559858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:28.292733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbf318-f2c1-4935-becc-f9311b47304e None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.297372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc3c54-73b6-4398-bf82-07308d61e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.298015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc3c54-73b6-4398-bf82-07308d61e31e admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.298340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc3c54-73b6-4398-bf82-07308d61e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.298616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc3c54-73b6-4398-bf82-07308d61e31e admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.299260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc3c54-73b6-4398-bf82-07308d61e31e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:28.299563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc3c54-73b6-4398-bf82-07308d61e31e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.301350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 972/1958] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:28.301457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc3c54-73b6-4398-bf82-07308d61e31e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.309241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d2ad-346b-4583-b10f-40212b867cf6 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.309741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d2ad-346b-4583-b10f-40212b867cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.310066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d2ad-346b-4583-b10f-40212b867cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.313989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 987/1959] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:28.318816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc3c54-73b6-4398-bf82-07308d61e31e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.328930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc3c54-73b6-4398-bf82-07308d61e31e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.331542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2463d2ad-346b-4583-b10f-40212b867cf6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:28.332805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2463d2ad-346b-4583-b10f-40212b867cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:28.333736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e68f-73be-428e-9fb0-c750af4cf795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.334358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e68f-73be-428e-9fb0-c750af4cf795 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.334638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e68f-73be-428e-9fb0-c750af4cf795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.334906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e68f-73be-428e-9fb0-c750af4cf795 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.335543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6e68f-73be-428e-9fb0-c750af4cf795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.337533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6e68f-73be-428e-9fb0-c750af4cf795 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.341270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 973/1960] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:28.345307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463d2ad-346b-4583-b10f-40212b867cf6 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.350415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:28.355002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463d2ad-346b-4583-b10f-40212b867cf6 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.359800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1705b-c23f-48e4-8bc1-c78292ccee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.360408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1705b-c23f-48e4-8bc1-c78292ccee93 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.360719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1705b-c23f-48e4-8bc1-c78292ccee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.360988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1705b-c23f-48e4-8bc1-c78292ccee93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.361691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1705b-c23f-48e4-8bc1-c78292ccee93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:28.362020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1705b-c23f-48e4-8bc1-c78292ccee93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.363662 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1705b-c23f-48e4-8bc1-c78292ccee93 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.375607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 974/1961] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:09:28.380451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1705b-c23f-48e4-8bc1-c78292ccee93 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.390274 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1705b-c23f-48e4-8bc1-c78292ccee93 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.395055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb29c51-c9ad-4d44-ae12-d1065a573afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.396210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb29c51-c9ad-4d44-ae12-d1065a573afe admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.396638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb29c51-c9ad-4d44-ae12-d1065a573afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.397141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb29c51-c9ad-4d44-ae12-d1065a573afe admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.397773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb29c51-c9ad-4d44-ae12-d1065a573afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.399678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb29c51-c9ad-4d44-ae12-d1065a573afe admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.448349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 988/1962] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:28 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:28.452442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e68f-73be-428e-9fb0-c750af4cf795 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.516606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6e68f-73be-428e-9fb0-c750af4cf795 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.521926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae017d9a-0c7b-429a-8820-ea28bfb33f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.522561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017d9a-0c7b-429a-8820-ea28bfb33f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.522840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017d9a-0c7b-429a-8820-ea28bfb33f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.523111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae017d9a-0c7b-429a-8820-ea28bfb33f4a admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.523799 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae017d9a-0c7b-429a-8820-ea28bfb33f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.525769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae017d9a-0c7b-429a-8820-ea28bfb33f4a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.546259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 975/1963] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:28 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:28.549327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb29c51-c9ad-4d44-ae12-d1065a573afe admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.613950 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb29c51-c9ad-4d44-ae12-d1065a573afe admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.619253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4da62-3f62-49d8-b8d3-465a643766b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.619950 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4da62-3f62-49d8-b8d3-465a643766b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.620309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4da62-3f62-49d8-b8d3-465a643766b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.620595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4da62-3f62-49d8-b8d3-465a643766b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.621724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4da62-3f62-49d8-b8d3-465a643766b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.623763 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4da62-3f62-49d8-b8d3-465a643766b7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.659979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:28.666118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 989/1964] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:28 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:28.673755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae017d9a-0c7b-429a-8820-ea28bfb33f4a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.684202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae017d9a-0c7b-429a-8820-ea28bfb33f4a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.689172 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c7493-42cb-4477-b291-defaa2aa7e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.689780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c7493-42cb-4477-b291-defaa2aa7e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.690068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c7493-42cb-4477-b291-defaa2aa7e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.690382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c7493-42cb-4477-b291-defaa2aa7e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.691027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c7493-42cb-4477-b291-defaa2aa7e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.693115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c7493-42cb-4477-b291-defaa2aa7e4f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.705785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 990/1965] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:28.716134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c7493-42cb-4477-b291-defaa2aa7e4f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.726563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c7493-42cb-4477-b291-defaa2aa7e4f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.731544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304993-4129-41ee-86ee-ae65e29fa1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.732162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304993-4129-41ee-86ee-ae65e29fa1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.732445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304993-4129-41ee-86ee-ae65e29fa1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.732719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304993-4129-41ee-86ee-ae65e29fa1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.733361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3304993-4129-41ee-86ee-ae65e29fa1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.735003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3304993-4129-41ee-86ee-ae65e29fa1a8 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.750543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 991/1966] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:28.752696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 976/1967] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:28 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:28.754768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304993-4129-41ee-86ee-ae65e29fa1a8 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.759236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4da62-3f62-49d8-b8d3-465a643766b7 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.765659 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304993-4129-41ee-86ee-ae65e29fa1a8 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.767620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4da62-3f62-49d8-b8d3-465a643766b7 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.772333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014e38-c07d-4c70-accc-c2f595e9df00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.773028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014e38-c07d-4c70-accc-c2f595e9df00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.773309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014e38-c07d-4c70-accc-c2f595e9df00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.773665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014e38-c07d-4c70-accc-c2f595e9df00 admin admin] PATH_INFO: `/v3/projects/48ee11f42a5a423ca47c531afb3df09f/users/9b7af9ef978b4ce5ba7bd37fb61f8b9f/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.774201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ede2d-287e-4065-ad9c-354c52534ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.774851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ede2d-287e-4065-ad9c-354c52534ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.775135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ede2d-287e-4065-ad9c-354c52534ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.775410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ede2d-287e-4065-ad9c-354c52534ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.776272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ede2d-287e-4065-ad9c-354c52534ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.778030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ede2d-287e-4065-ad9c-354c52534ae7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.789936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 977/1968] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:28.793051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014e38-c07d-4c70-accc-c2f595e9df00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ee11f42a5a423ca47c531afb3df09f, user_id=9b7af9ef978b4ce5ba7bd37fb61f8b9f, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.793834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014e38-c07d-4c70-accc-c2f595e9df00 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.794093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ede2d-287e-4065-ad9c-354c52534ae7 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.804916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ede2d-287e-4065-ad9c-354c52534ae7 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.809632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ae9b4-9eee-42f3-b52d-e0d151d96ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.810262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ae9b4-9eee-42f3-b52d-e0d151d96ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.810793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ae9b4-9eee-42f3-b52d-e0d151d96ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.811080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ae9b4-9eee-42f3-b52d-e0d151d96ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.811725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ae9b4-9eee-42f3-b52d-e0d151d96ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.813378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ae9b4-9eee-42f3-b52d-e0d151d96ffe admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.826248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 978/1969] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:28.828876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ae9b4-9eee-42f3-b52d-e0d151d96ffe admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:28.839430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ae9b4-9eee-42f3-b52d-e0d151d96ffe admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:28.844315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecbb90-67a5-477f-889c-940598d511b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:28.844973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecbb90-67a5-477f-889c-940598d511b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.854422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecbb90-67a5-477f-889c-940598d511b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.854422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecbb90-67a5-477f-889c-940598d511b0 admin admin] PATH_INFO: `/v3/projects/83afd5f2e9e64841b1a4562ba7843b4c/users/6ee20d9d428f46d6b8488a37ef2be42b/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.861316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecbb90-67a5-477f-889c-940598d511b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83afd5f2e9e64841b1a4562ba7843b4c, user_id=6ee20d9d428f46d6b8488a37ef2be42b, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:28.864014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecbb90-67a5-477f-889c-940598d511b0 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:28.949316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 992/1970] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:28 2022] PUT /identity/v3/projects/48ee11f42a5a423ca47c531afb3df09f/users/9b7af9ef978b4ce5ba7bd37fb61f8b9f/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:28.961415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f646bdb-52b8-47bb-9875-40aed9a8b3d9 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.961681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f646bdb-52b8-47bb-9875-40aed9a8b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.961962 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f646bdb-52b8-47bb-9875-40aed9a8b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.968798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 979/1971] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:28 2022] PUT /identity/v3/projects/83afd5f2e9e64841b1a4562ba7843b4c/users/6ee20d9d428f46d6b8488a37ef2be42b/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:28.980575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c908328-cc51-4d1b-8e42-0e67a0e0aae4 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:28.980978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c908328-cc51-4d1b-8e42-0e67a0e0aae4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:28.981265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c908328-cc51-4d1b-8e42-0e67a0e0aae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:28.991160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2f646bdb-52b8-47bb-9875-40aed9a8b3d9 None None] MFA Rules not processed for user `9b7af9ef978b4ce5ba7bd37fb61f8b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:28.992374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2f646bdb-52b8-47bb-9875-40aed9a8b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:29.011020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-3c908328-cc51-4d1b-8e42-0e67a0e0aae4 None None] MFA Rules not processed for user `6ee20d9d428f46d6b8488a37ef2be42b`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:29.012234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-3c908328-cc51-4d1b-8e42-0e67a0e0aae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:29.059973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 993/1972] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:29.064800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f646bdb-52b8-47bb-9875-40aed9a8b3d9 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.101378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 980/1973] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:29.103265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c908328-cc51-4d1b-8e42-0e67a0e0aae4 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.134746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f646bdb-52b8-47bb-9875-40aed9a8b3d9 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.139625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046579e-f86b-4362-84da-7e781d19d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.140253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046579e-f86b-4362-84da-7e781d19d9cf admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.140663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046579e-f86b-4362-84da-7e781d19d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.140957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046579e-f86b-4362-84da-7e781d19d9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.141601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046579e-f86b-4362-84da-7e781d19d9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.143567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046579e-f86b-4362-84da-7e781d19d9cf admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.170560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c908328-cc51-4d1b-8e42-0e67a0e0aae4 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.175389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c852fdd-a034-41d7-bb44-0f3a772a2ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.176069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c852fdd-a034-41d7-bb44-0f3a772a2ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.180590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c852fdd-a034-41d7-bb44-0f3a772a2ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.180590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c852fdd-a034-41d7-bb44-0f3a772a2ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.180590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c852fdd-a034-41d7-bb44-0f3a772a2ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.180590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c852fdd-a034-41d7-bb44-0f3a772a2ca9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.248613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 994/1974] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:29 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:29.257425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046579e-f86b-4362-84da-7e781d19d9cf admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.295936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 981/1975] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:29 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:29.299743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c852fdd-a034-41d7-bb44-0f3a772a2ca9 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.339934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046579e-f86b-4362-84da-7e781d19d9cf admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.385148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c852fdd-a034-41d7-bb44-0f3a772a2ca9 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.390713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0d5c8-6dad-4f63-9364-097ec19f0301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.391300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0d5c8-6dad-4f63-9364-097ec19f0301 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.391705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0d5c8-6dad-4f63-9364-097ec19f0301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.392045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0d5c8-6dad-4f63-9364-097ec19f0301 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.393135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0d5c8-6dad-4f63-9364-097ec19f0301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.394980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0d5c8-6dad-4f63-9364-097ec19f0301 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.416059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678da8bd-6031-4562-b6c2-58c9ad4b3d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.416729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678da8bd-6031-4562-b6c2-58c9ad4b3d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.417013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678da8bd-6031-4562-b6c2-58c9ad4b3d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.417285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678da8bd-6031-4562-b6c2-58c9ad4b3d2f admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.417923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678da8bd-6031-4562-b6c2-58c9ad4b3d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.419953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678da8bd-6031-4562-b6c2-58c9ad4b3d2f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.589411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 982/1976] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:29 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:29.590758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0d5c8-6dad-4f63-9364-097ec19f0301 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.601233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0d5c8-6dad-4f63-9364-097ec19f0301 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.605979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cca6f1-4523-4e1d-8310-e480bdb822ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.606622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cca6f1-4523-4e1d-8310-e480bdb822ec admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.606899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cca6f1-4523-4e1d-8310-e480bdb822ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.607214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cca6f1-4523-4e1d-8310-e480bdb822ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.607946 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cca6f1-4523-4e1d-8310-e480bdb822ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.609564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cca6f1-4523-4e1d-8310-e480bdb822ec admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.630948 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 995/1977] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:29 2022] POST /identity/v3/users => generated 299 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:29.631087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 983/1978] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:29.633500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678da8bd-6031-4562-b6c2-58c9ad4b3d2f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.635200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cca6f1-4523-4e1d-8310-e480bdb822ec admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.645300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cca6f1-4523-4e1d-8310-e480bdb822ec admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.645822 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678da8bd-6031-4562-b6c2-58c9ad4b3d2f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.650703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2952-692b-436c-9946-e6293cb80bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.650887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f10762-6e99-46b0-a6a1-30511983cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.651330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2952-692b-436c-9946-e6293cb80bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.651616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2952-692b-436c-9946-e6293cb80bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.651726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10762-6e99-46b0-a6a1-30511983cbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.652046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc2952-692b-436c-9946-e6293cb80bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.652140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10762-6e99-46b0-a6a1-30511983cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.652381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10762-6e99-46b0-a6a1-30511983cbe5 admin admin] PATH_INFO: `/v3/projects/3ed3f04ae4e34251bd0020aa01f20ec7/users/4fd6622300e544c0ae084e201f65568e/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.652707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc2952-692b-436c-9946-e6293cb80bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.654394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc2952-692b-436c-9946-e6293cb80bf0 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.666535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 996/1979] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:29.668931 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f10762-6e99-46b0-a6a1-30511983cbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed3f04ae4e34251bd0020aa01f20ec7, user_id=4fd6622300e544c0ae084e201f65568e, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.682244 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f10762-6e99-46b0-a6a1-30511983cbe5 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.685413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2952-692b-436c-9946-e6293cb80bf0 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.695868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc2952-692b-436c-9946-e6293cb80bf0 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.700545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357affbf-aab8-4f33-853f-682d5b7d7da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.701209 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357affbf-aab8-4f33-853f-682d5b7d7da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.701615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357affbf-aab8-4f33-853f-682d5b7d7da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.701893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357affbf-aab8-4f33-853f-682d5b7d7da4 admin admin] PATH_INFO: `/v3/projects/d9db0e1165d849ccb262f03fe1de882f/users/9273e05a3a3f437892b61c6d2275f919/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.717499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357affbf-aab8-4f33-853f-682d5b7d7da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9db0e1165d849ccb262f03fe1de882f, user_id=9273e05a3a3f437892b61c6d2275f919, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.720225 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357affbf-aab8-4f33-853f-682d5b7d7da4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.787457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 984/1980] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:29 2022] PUT /identity/v3/projects/3ed3f04ae4e34251bd0020aa01f20ec7/users/4fd6622300e544c0ae084e201f65568e/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:29.791651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f10762-6e99-46b0-a6a1-30511983cbe5 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.824012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 997/1981] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:29 2022] PUT /identity/v3/projects/d9db0e1165d849ccb262f03fe1de882f/users/9273e05a3a3f437892b61c6d2275f919/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:29.828967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357affbf-aab8-4f33-853f-682d5b7d7da4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.858802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f10762-6e99-46b0-a6a1-30511983cbe5 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.902597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357affbf-aab8-4f33-853f-682d5b7d7da4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.909040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee13d49-31f7-499e-a3c9-158947d5ab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.909777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee13d49-31f7-499e-a3c9-158947d5ab74 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.910154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee13d49-31f7-499e-a3c9-158947d5ab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.910472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee13d49-31f7-499e-a3c9-158947d5ab74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.911748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee13d49-31f7-499e-a3c9-158947d5ab74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.914403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee13d49-31f7-499e-a3c9-158947d5ab74 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.926404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 998/1982] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:29.931153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee13d49-31f7-499e-a3c9-158947d5ab74 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.941979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee13d49-31f7-499e-a3c9-158947d5ab74 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.943692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af917d-68fa-43cf-9b9f-7a9d42755468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.944730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af917d-68fa-43cf-9b9f-7a9d42755468 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.945020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af917d-68fa-43cf-9b9f-7a9d42755468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.946045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af917d-68fa-43cf-9b9f-7a9d42755468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.946749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af917d-68fa-43cf-9b9f-7a9d42755468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.947265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35336560-e105-4f55-a08a-1d5a41b112cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:29.947943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35336560-e105-4f55-a08a-1d5a41b112cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.948228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35336560-e105-4f55-a08a-1d5a41b112cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.948462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af917d-68fa-43cf-9b9f-7a9d42755468 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.948572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35336560-e105-4f55-a08a-1d5a41b112cf admin admin] PATH_INFO: `/v3/projects/d9db0e1165d849ccb262f03fe1de882f/users/9273e05a3a3f437892b61c6d2275f919/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:29.950529 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35336560-e105-4f55-a08a-1d5a41b112cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9db0e1165d849ccb262f03fe1de882f, user_id=9273e05a3a3f437892b61c6d2275f919, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:29.953310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35336560-e105-4f55-a08a-1d5a41b112cf admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:29.961724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 985/1983] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:29.966247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af917d-68fa-43cf-9b9f-7a9d42755468 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:29.974305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 999/1984] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:29 2022] PUT /identity/v3/projects/d9db0e1165d849ccb262f03fe1de882f/users/9273e05a3a3f437892b61c6d2275f919/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:29.980524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af917d-68fa-43cf-9b9f-7a9d42755468 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:29.980716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32718662-856e-44df-bf7a-6618b0ee265e None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:29.981041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32718662-856e-44df-bf7a-6618b0ee265e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:29.981390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32718662-856e-44df-bf7a-6618b0ee265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:30.011886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-32718662-856e-44df-bf7a-6618b0ee265e None None] MFA Rules not processed for user `9273e05a3a3f437892b61c6d2275f919`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:30.013125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-32718662-856e-44df-bf7a-6618b0ee265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:30.049576 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44d7d0-181c-4c50-9107-06e1f07f25d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:30.050311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44d7d0-181c-4c50-9107-06e1f07f25d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:30.050591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44d7d0-181c-4c50-9107-06e1f07f25d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:30.051014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44d7d0-181c-4c50-9107-06e1f07f25d0 admin admin] PATH_INFO: `/v3/projects/3ed3f04ae4e34251bd0020aa01f20ec7/users/4fd6622300e544c0ae084e201f65568e/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:30.053396 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44d7d0-181c-4c50-9107-06e1f07f25d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed3f04ae4e34251bd0020aa01f20ec7, user_id=4fd6622300e544c0ae084e201f65568e, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:30.056082 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44d7d0-181c-4c50-9107-06e1f07f25d0 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:30.068002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 986/1985] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:29 2022] PUT /identity/v3/projects/3ed3f04ae4e34251bd0020aa01f20ec7/users/4fd6622300e544c0ae084e201f65568e/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:30.078105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf112d-50c3-4359-bd34-5795d5861765 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:30.078430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf112d-50c3-4359-bd34-5795d5861765 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:30.078956 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf112d-50c3-4359-bd34-5795d5861765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:30.130424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1000/1986] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:30.143074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32718662-856e-44df-bf7a-6618b0ee265e None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:30.144902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-32718662-856e-44df-bf7a-6618b0ee265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:30.145295 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-02cf112d-50c3-4359-bd34-5795d5861765 None None] MFA Rules not processed for user `4fd6622300e544c0ae084e201f65568e`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:30.146872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-02cf112d-50c3-4359-bd34-5795d5861765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:30.234073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32718662-856e-44df-bf7a-6618b0ee265e None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:30.272760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 987/1987] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:30.308887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf112d-50c3-4359-bd34-5795d5861765 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:30.311320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-02cf112d-50c3-4359-bd34-5795d5861765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:30.325158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f433d-cd87-401b-9af1-1a0812b7e9b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:30.325915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f433d-cd87-401b-9af1-1a0812b7e9b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:30.326488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f433d-cd87-401b-9af1-1a0812b7e9b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:30.328101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f433d-cd87-401b-9af1-1a0812b7e9b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:30.330516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf112d-50c3-4359-bd34-5795d5861765 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:30.340932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed7f3c-ea97-45a1-9289-af742d35b644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:30.343404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed7f3c-ea97-45a1-9289-af742d35b644 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:30.344528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed7f3c-ea97-45a1-9289-af742d35b644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:30.345584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed7f3c-ea97-45a1-9289-af742d35b644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:30.408436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f433d-cd87-401b-9af1-1a0812b7e9b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:30.409774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed7f3c-ea97-45a1-9289-af742d35b644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:30.409889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f433d-cd87-401b-9af1-1a0812b7e9b5 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:30.412071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed7f3c-ea97-45a1-9289-af742d35b644 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:30.421081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1001/1988] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:30.422375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 988/1989] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:30.796979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:31.083082 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:32.071623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:32.741485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f433d-cd87-401b-9af1-1a0812b7e9b5 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:32.742916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-654f433d-cd87-401b-9af1-1a0812b7e9b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:32.811974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f433d-cd87-401b-9af1-1a0812b7e9b5 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:32.816954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:32.818331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:32.818783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:32.819194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] PATH_INFO: `/v3/users/0939e2eb8df04dfa8f0d9f3789e8b6e7` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:32.820402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0939e2eb8df04dfa8f0d9f3789e8b6e7)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:32.823846 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:32.832783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed7f3c-ea97-45a1-9289-af742d35b644 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:32.844265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed7f3c-ea97-45a1-9289-af742d35b644 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:32.849455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:32.850084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:32.850401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:32.852347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] PATH_INFO: `/v3/users/9b7af9ef978b4ce5ba7bd37fb61f8b9f` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:32.852347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7af9ef978b4ce5ba7bd37fb61f8b9f)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:32.853694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:33.026862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0939e2eb8df04dfa8f0d9f3789e8b6e7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:33.027551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0939e2eb8df04dfa8f0d9f3789e8b6e7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:33.034751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0939e2eb8df04dfa8f0d9f3789e8b6e7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:33.047798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0939e2eb8df04dfa8f0d9f3789e8b6e7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:33.048485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d00f4e91-11fe-4945-9810-5431053110fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0939e2eb8df04dfa8f0d9f3789e8b6e7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:33.133698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7af9ef978b4ce5ba7bd37fb61f8b9f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:33.140633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7af9ef978b4ce5ba7bd37fb61f8b9f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:33.152854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7af9ef978b4ce5ba7bd37fb61f8b9f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:33.191242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1002/1990] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:32 2022] DELETE /identity/v3/users/0939e2eb8df04dfa8f0d9f3789e8b6e7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:33.195864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0782c-cb0c-4b75-8c68-f042c8c06be7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:33.196148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0782c-cb0c-4b75-8c68-f042c8c06be7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:33.196421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0782c-cb0c-4b75-8c68-f042c8c06be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:33.215947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d8d0782c-cb0c-4b75-8c68-f042c8c06be7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:33.217184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d8d0782c-cb0c-4b75-8c68-f042c8c06be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:33.274325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7af9ef978b4ce5ba7bd37fb61f8b9f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:33.274946 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7af9ef978b4ce5ba7bd37fb61f8b9f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:33.283454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1003/1991] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:33.283790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 989/1992] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:32 2022] DELETE /identity/v3/users/9b7af9ef978b4ce5ba7bd37fb61f8b9f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:33.289135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3963-6772-4e31-954b-01f0ccadface None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:33.289522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3963-6772-4e31-954b-01f0ccadface None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:33.289919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea3963-6772-4e31-954b-01f0ccadface None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:33.293414 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:33.295379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:33.311587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f9ea3963-6772-4e31-954b-01f0ccadface None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:33.312779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f9ea3963-6772-4e31-954b-01f0ccadface None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:33.360283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7695e2-1e9f-4232-86e4-8bbbb1d20883 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:33.363369 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:33.365317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b2ce5-490b-438f-80cc-2650e146ebae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:33.366851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b2ce5-490b-438f-80cc-2650e146ebae service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:33.366851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b2ce5-490b-438f-80cc-2650e146ebae service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:33.366851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b2ce5-490b-438f-80cc-2650e146ebae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:33.368944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d97b2ce5-490b-438f-80cc-2650e146ebae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:33.381623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1004/1993] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:33.391307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea3963-6772-4e31-954b-01f0ccadface None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:33.409411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea3963-6772-4e31-954b-01f0ccadface None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:33.415696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54d98-046f-43fb-b11e-d2d93fd8f4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:33.416341 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54d98-046f-43fb-b11e-d2d93fd8f4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:33.416621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54d98-046f-43fb-b11e-d2d93fd8f4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:33.416893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54d98-046f-43fb-b11e-d2d93fd8f4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:33.426445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b54d98-046f-43fb-b11e-d2d93fd8f4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:33.427854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b54d98-046f-43fb-b11e-d2d93fd8f4c7 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:33.444755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b2ce5-490b-438f-80cc-2650e146ebae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:33.445182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b2ce5-490b-438f-80cc-2650e146ebae service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:33.453202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1005/1994] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:33.456350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 990/1995] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:34.151615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54d98-046f-43fb-b11e-d2d93fd8f4c7 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:34.151615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-49b54d98-046f-43fb-b11e-d2d93fd8f4c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:34.166647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54d98-046f-43fb-b11e-d2d93fd8f4c7 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:34.173795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:34.174691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:34.175689 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:34.176309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] PATH_INFO: `/v3/projects/48ee11f42a5a423ca47c531afb3df09f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:34.178143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ee11f42a5a423ca47c531afb3df09f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:34.182680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:34.200541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b2ce5-490b-438f-80cc-2650e146ebae service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:34.202037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d97b2ce5-490b-438f-80cc-2650e146ebae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:34.232166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b2ce5-490b-438f-80cc-2650e146ebae service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:34.235247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:34.235882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:34.236599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:34.236884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] PATH_INFO: `/v3/projects/daf5735dded8421289825afeab35746e` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:34.238067 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf5735dded8421289825afeab35746e)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:34.241386 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:34.380706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ee11f42a5a423ca47c531afb3df09f', 'request_id': 'req-6c623502-8b02-4774-bd93-cd7015efdd75'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.416684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf5735dded8421289825afeab35746e', 'request_id': 'req-61bdb220-409a-48ac-a0ad-3045d85a0492'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.423231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf5735dded8421289825afeab35746e', 'request_id': 'req-61bdb220-409a-48ac-a0ad-3045d85a0492'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.432100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf5735dded8421289825afeab35746e', 'request_id': 'req-61bdb220-409a-48ac-a0ad-3045d85a0492'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.457988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ee11f42a5a423ca47c531afb3df09f', 'request_id': 'req-6c623502-8b02-4774-bd93-cd7015efdd75'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.465639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ee11f42a5a423ca47c531afb3df09f', 'request_id': 'req-6c623502-8b02-4774-bd93-cd7015efdd75'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.477306 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] The token cache is being invalidate because project 48ee11f42a5a423ca47c531afb3df09f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:34.477599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.478532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.480031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1006/1996] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:34 2022] DELETE /identity/v3/projects/48ee11f42a5a423ca47c531afb3df09f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:34.484299 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:34.485891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:34.569350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623502-8b02-4774-bd93-cd7015efdd75 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:34.579167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] The token cache is being invalidate because project daf5735dded8421289825afeab35746e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:34.579451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.580068 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.581647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 991/1997] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:34 2022] DELETE /identity/v3/projects/daf5735dded8421289825afeab35746e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:34.585792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:34.587694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:34.631072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:34.631717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:34.631995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:34.632264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] PATH_INFO: `/v3/users/9273e05a3a3f437892b61c6d2275f919` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:34.633429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9273e05a3a3f437892b61c6d2275f919)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:34.635389 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:34.657355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdb220-409a-48ac-a0ad-3045d85a0492 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:34.663031 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:34.663744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:34.664025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:34.664352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] PATH_INFO: `/v3/users/ef6a61bdb1484ed382db298f82f7cc49` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:34.665483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6a61bdb1484ed382db298f82f7cc49)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:34.667581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:34.862272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:34.913776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9273e05a3a3f437892b61c6d2275f919'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.915397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9273e05a3a3f437892b61c6d2275f919'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.924939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9273e05a3a3f437892b61c6d2275f919'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.940191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9273e05a3a3f437892b61c6d2275f919'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:34.942792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9273e05a3a3f437892b61c6d2275f919'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.038988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6a61bdb1484ed382db298f82f7cc49'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.046295 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6a61bdb1484ed382db298f82f7cc49'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.066859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1007/1998] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:34 2022] DELETE /identity/v3/users/9273e05a3a3f437892b61c6d2275f919 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:35.078484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6a61bdb1484ed382db298f82f7cc49'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.089913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:35.093316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:35.168944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cce31e-f372-445b-8627-9b6a8021ef34 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:35.173803 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:35.174489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:35.174774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:35.175053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] PATH_INFO: `/v3/users/6ee20d9d428f46d6b8488a37ef2be42b` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:35.176337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee20d9d428f46d6b8488a37ef2be42b)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:35.178666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:35.186026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6a61bdb1484ed382db298f82f7cc49'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.186989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6a61bdb1484ed382db298f82f7cc49'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.195282 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 992/1999] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:34 2022] DELETE /identity/v3/users/ef6a61bdb1484ed382db298f82f7cc49 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:35.246904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:35.248361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:35.314149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b966549-606b-41ba-abd8-2a450c5145e6 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:35.318814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:35.319442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:35.319724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:35.319992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] PATH_INFO: `/v3/users/de89290fa99b4420be0675df394945d3` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:35.321111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de89290fa99b4420be0675df394945d3)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:35.323043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:35.543572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee20d9d428f46d6b8488a37ef2be42b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.544313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee20d9d428f46d6b8488a37ef2be42b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.552602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee20d9d428f46d6b8488a37ef2be42b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.577019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee20d9d428f46d6b8488a37ef2be42b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.577763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2c6e3706-b758-4a1e-9ecc-ef87b2be5aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee20d9d428f46d6b8488a37ef2be42b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.625528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de89290fa99b4420be0675df394945d3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.633517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de89290fa99b4420be0675df394945d3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.650345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de89290fa99b4420be0675df394945d3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.695203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:35.747236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1008/2000] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:35 2022] DELETE /identity/v3/users/6ee20d9d428f46d6b8488a37ef2be42b => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:35.752336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c657c5-e86a-476c-ab0f-9e14b6d11680 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:35.752336 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c657c5-e86a-476c-ab0f-9e14b6d11680 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:35.752507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c657c5-e86a-476c-ab0f-9e14b6d11680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:35.775296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-15c657c5-e86a-476c-ab0f-9e14b6d11680 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:35.776602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-15c657c5-e86a-476c-ab0f-9e14b6d11680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:35.820134 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de89290fa99b4420be0675df394945d3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.820692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de89290fa99b4420be0675df394945d3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:35.829164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 993/2001] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:35 2022] DELETE /identity/v3/users/de89290fa99b4420be0675df394945d3 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:35.833613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:35.839839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:35.863560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1009/2002] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:35.868987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c657c5-e86a-476c-ab0f-9e14b6d11680 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:35.870992 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-15c657c5-e86a-476c-ab0f-9e14b6d11680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:35.887253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c657c5-e86a-476c-ab0f-9e14b6d11680 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:35.916725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0f7f1-f950-4598-895b-9eae1c7cce4b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:35.922555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:35.923264 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:35.923542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:35.924904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] PATH_INFO: `/v3/projects/0f6b9b19610441b7895eab39fc66f453` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:35.925006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6b9b19610441b7895eab39fc66f453)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:35.927097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:35.959985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:35.960774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:35.961053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:35.961330 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] PATH_INFO: `/v3/projects/d9db0e1165d849ccb262f03fe1de882f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:35.962504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9db0e1165d849ccb262f03fe1de882f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:35.964454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:36.095869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6b9b19610441b7895eab39fc66f453', 'request_id': 'req-451a3692-ff56-4bca-90a2-a5ffa57b02b6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:36.103178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6b9b19610441b7895eab39fc66f453', 'request_id': 'req-451a3692-ff56-4bca-90a2-a5ffa57b02b6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:36.121047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6b9b19610441b7895eab39fc66f453', 'request_id': 'req-451a3692-ff56-4bca-90a2-a5ffa57b02b6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:36.138649 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9db0e1165d849ccb262f03fe1de882f', 'request_id': 'req-1576eafa-d1da-45ac-bea5-bcdb50682852'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:36.268508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] The token cache is being invalidate because project 0f6b9b19610441b7895eab39fc66f453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:36.269071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:36.269438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-451a3692-ff56-4bca-90a2-a5ffa57b02b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:36.271696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 994/2003] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:35 2022] DELETE /identity/v3/projects/0f6b9b19610441b7895eab39fc66f453 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:36.272682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d589-a6ee-4a90-83a1-da23a7ba9e28 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.273138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d589-a6ee-4a90-83a1-da23a7ba9e28 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.273426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d589-a6ee-4a90-83a1-da23a7ba9e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.292767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-fdd2d589-a6ee-4a90-83a1-da23a7ba9e28 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:36.293982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-fdd2d589-a6ee-4a90-83a1-da23a7ba9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:36.356949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 995/2004] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:36.359134 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2d589-a6ee-4a90-83a1-da23a7ba9e28 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:36.363270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-fdd2d589-a6ee-4a90-83a1-da23a7ba9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:36.382981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9db0e1165d849ccb262f03fe1de882f', 'request_id': 'req-1576eafa-d1da-45ac-bea5-bcdb50682852'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:36.390641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9db0e1165d849ccb262f03fe1de882f', 'request_id': 'req-1576eafa-d1da-45ac-bea5-bcdb50682852'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:36.403342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] The token cache is being invalidate because project d9db0e1165d849ccb262f03fe1de882f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:36.403688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:36.404796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1576eafa-d1da-45ac-bea5-bcdb50682852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:36.406017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1010/2005] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:35 2022] DELETE /identity/v3/projects/d9db0e1165d849ccb262f03fe1de882f => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:36.412841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31a57d-43c3-4653-badc-6771244c0c3d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.413130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31a57d-43c3-4653-badc-6771244c0c3d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.413410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31a57d-43c3-4653-badc-6771244c0c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.429014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2d589-a6ee-4a90-83a1-da23a7ba9e28 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:36.433877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d53a8-42c5-4ee2-bda1-fc73e6133b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:36.434763 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d53a8-42c5-4ee2-bda1-fc73e6133b4b service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.435115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d53a8-42c5-4ee2-bda1-fc73e6133b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.435474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d53a8-42c5-4ee2-bda1-fc73e6133b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.437446 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9e31a57d-43c3-4653-badc-6771244c0c3d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:36.437869 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a64d53a8-42c5-4ee2-bda1-fc73e6133b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:36.438788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9e31a57d-43c3-4653-badc-6771244c0c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:36.457413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1011/2006] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:36.457413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31a57d-43c3-4653-badc-6771244c0c3d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:36.457758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d53a8-42c5-4ee2-bda1-fc73e6133b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:36.461484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d53a8-42c5-4ee2-bda1-fc73e6133b4b service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:36.461746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9e31a57d-43c3-4653-badc-6771244c0c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:36.470746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 996/2007] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:36.472025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a61c4-a2b4-4572-b833-8329003cb7a4 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.472442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a61c4-a2b4-4572-b833-8329003cb7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.472902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a61c4-a2b4-4572-b833-8329003cb7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.475575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31a57d-43c3-4653-badc-6771244c0c3d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:36.480136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1d848-8a58-4dbf-b240-26a5453a7a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:36.480978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1d848-8a58-4dbf-b240-26a5453a7a1f service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.481400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1d848-8a58-4dbf-b240-26a5453a7a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.481809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1d848-8a58-4dbf-b240-26a5453a7a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.484187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ebf1d848-8a58-4dbf-b240-26a5453a7a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:36.498023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-d83a61c4-a2b4-4572-b833-8329003cb7a4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:36.501546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d83a61c4-a2b4-4572-b833-8329003cb7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:36.502512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1d848-8a58-4dbf-b240-26a5453a7a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:36.509381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1d848-8a58-4dbf-b240-26a5453a7a1f service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:36.511425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 997/2008] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:36.513036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e366f-f383-4492-b53d-4256b3b5d2d5 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.513534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e366f-f383-4492-b53d-4256b3b5d2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.514034 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e366f-f383-4492-b53d-4256b3b5d2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.537476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-e70e366f-f383-4492-b53d-4256b3b5d2d5 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:36.538926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e70e366f-f383-4492-b53d-4256b3b5d2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:36.547433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1012/2009] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:36.547433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185eef0-4c10-49d6-b72f-aabf60c1fd9c None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.547433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185eef0-4c10-49d6-b72f-aabf60c1fd9c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.547433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185eef0-4c10-49d6-b72f-aabf60c1fd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.548541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 998/2010] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:36.553278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e366f-f383-4492-b53d-4256b3b5d2d5 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:36.570261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e366f-f383-4492-b53d-4256b3b5d2d5 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:36.574481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c11fe-c5ed-479c-98ed-78867096ee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:36.575206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c11fe-c5ed-479c-98ed-78867096ee10 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.575564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c11fe-c5ed-479c-98ed-78867096ee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.576202 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c11fe-c5ed-479c-98ed-78867096ee10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.577021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c11fe-c5ed-479c-98ed-78867096ee10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:36.577344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c11fe-c5ed-479c-98ed-78867096ee10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:36.578075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6185eef0-4c10-49d6-b72f-aabf60c1fd9c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:36.579126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c11fe-c5ed-479c-98ed-78867096ee10 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:36.579643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6185eef0-4c10-49d6-b72f-aabf60c1fd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:36.604888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 999/2011] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:36.605275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1013/2012] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:36.606145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c11fe-c5ed-479c-98ed-78867096ee10 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:36.608213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185eef0-4c10-49d6-b72f-aabf60c1fd9c None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:36.617391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c11fe-c5ed-479c-98ed-78867096ee10 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:36.622581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ee4a5-b4fb-4697-bab9-1a837e69fbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:36.628007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ee4a5-b4fb-4697-bab9-1a837e69fbdf admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.628007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ee4a5-b4fb-4697-bab9-1a837e69fbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.628007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ee4a5-b4fb-4697-bab9-1a837e69fbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.628007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ee4a5-b4fb-4697-bab9-1a837e69fbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:36.628007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ee4a5-b4fb-4697-bab9-1a837e69fbdf admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:36.628927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185eef0-4c10-49d6-b72f-aabf60c1fd9c None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:36.635672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bfc96-2f42-4140-9603-93835e142d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:36.636788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bfc96-2f42-4140-9603-93835e142d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.636788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bfc96-2f42-4140-9603-93835e142d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.637222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bfc96-2f42-4140-9603-93835e142d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.639179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bfc96-2f42-4140-9603-93835e142d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:36.639623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bfc96-2f42-4140-9603-93835e142d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:36.641498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bfc96-2f42-4140-9603-93835e142d23 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:36.657837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1014/2013] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:36.662884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bfc96-2f42-4140-9603-93835e142d23 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:36.674580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bfc96-2f42-4140-9603-93835e142d23 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:36.681575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb14654-d1d6-4abb-82f2-616de120b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:36.682980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb14654-d1d6-4abb-82f2-616de120b680 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.683130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb14654-d1d6-4abb-82f2-616de120b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.683324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb14654-d1d6-4abb-82f2-616de120b680 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.684003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb14654-d1d6-4abb-82f2-616de120b680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:36.686190 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb14654-d1d6-4abb-82f2-616de120b680 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:36.785102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1000/2014] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:36 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:36.789958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ee4a5-b4fb-4697-bab9-1a837e69fbdf admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:36.833901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1015/2015] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:36 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:36.837975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb14654-d1d6-4abb-82f2-616de120b680 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:36.912295 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ee4a5-b4fb-4697-bab9-1a837e69fbdf admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:36.920111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05bd03-5a4e-49a3-9749-256ecfe17350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:36.921359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05bd03-5a4e-49a3-9749-256ecfe17350 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.921755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05bd03-5a4e-49a3-9749-256ecfe17350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.922276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05bd03-5a4e-49a3-9749-256ecfe17350 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.923021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05bd03-5a4e-49a3-9749-256ecfe17350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:36.923200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb14654-d1d6-4abb-82f2-616de120b680 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:36.925381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05bd03-5a4e-49a3-9749-256ecfe17350 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:36.929791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480850b8-0d2f-4dac-86aa-b6abd014ebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:36.931012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480850b8-0d2f-4dac-86aa-b6abd014ebac admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:36.931363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480850b8-0d2f-4dac-86aa-b6abd014ebac admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:36.931640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480850b8-0d2f-4dac-86aa-b6abd014ebac admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:36.932286 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480850b8-0d2f-4dac-86aa-b6abd014ebac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:36.935110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480850b8-0d2f-4dac-86aa-b6abd014ebac admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:37.064958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1001/2016] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:36 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:37.065360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1016/2017] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:36 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:37.069314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05bd03-5a4e-49a3-9749-256ecfe17350 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:37.070886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480850b8-0d2f-4dac-86aa-b6abd014ebac admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:37.077085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:37.080914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05bd03-5a4e-49a3-9749-256ecfe17350 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:37.082095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480850b8-0d2f-4dac-86aa-b6abd014ebac admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:37.086788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d3e04-1d70-4fe4-aadb-b593c914233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:37.087394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d3e04-1d70-4fe4-aadb-b593c914233b admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.087679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d3e04-1d70-4fe4-aadb-b593c914233b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.087792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bba917-a949-402b-b20f-4d861c82f2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:37.087954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d3e04-1d70-4fe4-aadb-b593c914233b admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.088369 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bba917-a949-402b-b20f-4d861c82f2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.088670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bba917-a949-402b-b20f-4d861c82f2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.088774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d3e04-1d70-4fe4-aadb-b593c914233b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:37.088916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bba917-a949-402b-b20f-4d861c82f2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.089595 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bba917-a949-402b-b20f-4d861c82f2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:37.090409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d3e04-1d70-4fe4-aadb-b593c914233b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:37.091261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bba917-a949-402b-b20f-4d861c82f2b1 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:37.101615 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1002/2018] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:37.103252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1017/2019] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:37.105406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d3e04-1d70-4fe4-aadb-b593c914233b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:37.107204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bba917-a949-402b-b20f-4d861c82f2b1 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:37.115817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d3e04-1d70-4fe4-aadb-b593c914233b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:37.117224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bba917-a949-402b-b20f-4d861c82f2b1 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:37.120744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f0a72-7170-4425-9003-a58aaeb435b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:37.121383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0a72-7170-4425-9003-a58aaeb435b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.121665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0a72-7170-4425-9003-a58aaeb435b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.121813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9adee-c109-4730-a34d-19c1adbe7c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:37.122063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f0a72-7170-4425-9003-a58aaeb435b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.122441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9adee-c109-4730-a34d-19c1adbe7c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.122724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9adee-c109-4730-a34d-19c1adbe7c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.122834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f0a72-7170-4425-9003-a58aaeb435b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:37.123001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9adee-c109-4730-a34d-19c1adbe7c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.123666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9adee-c109-4730-a34d-19c1adbe7c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:37.124423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f0a72-7170-4425-9003-a58aaeb435b9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:37.125242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9adee-c109-4730-a34d-19c1adbe7c28 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:37.139703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1018/2020] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:37.139860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1003/2021] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:37.144305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9adee-c109-4730-a34d-19c1adbe7c28 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:37.144419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f0a72-7170-4425-9003-a58aaeb435b9 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:37.152840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f0a72-7170-4425-9003-a58aaeb435b9 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:37.152990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9adee-c109-4730-a34d-19c1adbe7c28 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:37.157975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d90068-b31b-462d-8fbc-00641b29fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:37.158702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2448c22-2d07-4824-87da-abf9de356b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:37.158978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d90068-b31b-462d-8fbc-00641b29fecd admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.159385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d90068-b31b-462d-8fbc-00641b29fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.159506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2448c22-2d07-4824-87da-abf9de356b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.159746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2448c22-2d07-4824-87da-abf9de356b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.159969 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d90068-b31b-462d-8fbc-00641b29fecd admin admin] PATH_INFO: `/v3/projects/41273918f6344e749ee8152d641baeeb/users/a2675915d2f24a7cb5f78194bac88ccc/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.160060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2448c22-2d07-4824-87da-abf9de356b7e admin admin] PATH_INFO: `/v3/projects/9cf3ec1ff225421cb254790b63969763/users/c9c07b62794144d5ad5f4f054303adb8/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.181567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d90068-b31b-462d-8fbc-00641b29fecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=41273918f6344e749ee8152d641baeeb, user_id=a2675915d2f24a7cb5f78194bac88ccc, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:37.184796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d90068-b31b-462d-8fbc-00641b29fecd admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:37.186503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2448c22-2d07-4824-87da-abf9de356b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf3ec1ff225421cb254790b63969763, user_id=c9c07b62794144d5ad5f4f054303adb8, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:37.194103 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2448c22-2d07-4824-87da-abf9de356b7e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:37.318610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1019/2022] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:37 2022] PUT /identity/v3/projects/9cf3ec1ff225421cb254790b63969763/users/c9c07b62794144d5ad5f4f054303adb8/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:37.331387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1004/2023] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:37 2022] PUT /identity/v3/projects/41273918f6344e749ee8152d641baeeb/users/a2675915d2f24a7cb5f78194bac88ccc/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:37.332613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d90068-b31b-462d-8fbc-00641b29fecd admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:37.333112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2448c22-2d07-4824-87da-abf9de356b7e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:37.336336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-53d90068-b31b-462d-8fbc-00641b29fecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:37.337171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a2448c22-2d07-4824-87da-abf9de356b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:37.419316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2448c22-2d07-4824-87da-abf9de356b7e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:37.428494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:37.429363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.429803 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.430374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] PATH_INFO: `/v3/projects/83afd5f2e9e64841b1a4562ba7843b4c` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.430863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d90068-b31b-462d-8fbc-00641b29fecd admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:37.432332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83afd5f2e9e64841b1a4562ba7843b4c)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:37.434667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:37.437148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:37.437840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.438124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.438430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] PATH_INFO: `/v3/projects/75d47524b57046fb8313b4a010ea02ea` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.439570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d47524b57046fb8313b4a010ea02ea)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:37.441574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:37.622883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83afd5f2e9e64841b1a4562ba7843b4c', 'request_id': 'req-733e11d2-0a19-4e8a-9745-c964f537cee3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:37.655285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d47524b57046fb8313b4a010ea02ea', 'request_id': 'req-847545b9-4824-4fa7-9414-384835b871b7'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:37.662519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d47524b57046fb8313b4a010ea02ea', 'request_id': 'req-847545b9-4824-4fa7-9414-384835b871b7'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:37.670276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d47524b57046fb8313b4a010ea02ea', 'request_id': 'req-847545b9-4824-4fa7-9414-384835b871b7'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:37.699859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83afd5f2e9e64841b1a4562ba7843b4c', 'request_id': 'req-733e11d2-0a19-4e8a-9745-c964f537cee3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:37.708573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83afd5f2e9e64841b1a4562ba7843b4c', 'request_id': 'req-733e11d2-0a19-4e8a-9745-c964f537cee3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:37.719238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] The token cache is being invalidate because project 83afd5f2e9e64841b1a4562ba7843b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:37.719562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:37.720241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-733e11d2-0a19-4e8a-9745-c964f537cee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:37.721841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1020/2024] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:37 2022] DELETE /identity/v3/projects/83afd5f2e9e64841b1a4562ba7843b4c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:37.723117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae386b-9b77-4144-80e5-18068aef94c9 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.723402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae386b-9b77-4144-80e5-18068aef94c9 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.724277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae386b-9b77-4144-80e5-18068aef94c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.752990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-5bae386b-9b77-4144-80e5-18068aef94c9 None None] MFA Rules not processed for user `c9c07b62794144d5ad5f4f054303adb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:37.754240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5bae386b-9b77-4144-80e5-18068aef94c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:37.785576 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] The token cache is being invalidate because project 75d47524b57046fb8313b4a010ea02ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:37.785870 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:37.787538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-847545b9-4824-4fa7-9414-384835b871b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:37.789095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1005/2025] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:37 2022] DELETE /identity/v3/projects/75d47524b57046fb8313b4a010ea02ea => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:37.790370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e102-6d5e-4c40-bb50-01b311602d96 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.790653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e102-6d5e-4c40-bb50-01b311602d96 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.790929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e102-6d5e-4c40-bb50-01b311602d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.821146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-55f0e102-6d5e-4c40-bb50-01b311602d96 None None] MFA Rules not processed for user `a2675915d2f24a7cb5f78194bac88ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:37.822412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-55f0e102-6d5e-4c40-bb50-01b311602d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:37.832675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1021/2026] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:37.834254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae386b-9b77-4144-80e5-18068aef94c9 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:37.835571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5bae386b-9b77-4144-80e5-18068aef94c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:37.915308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae386b-9b77-4144-80e5-18068aef94c9 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:37.922090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:37.922970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.923468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.924243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] PATH_INFO: `/v3/users/407556624c6b43a894325a0696c84a54` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.926080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=407556624c6b43a894325a0696c84a54)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:37.929098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1006/2027] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:37.930088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:37.930239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e102-6d5e-4c40-bb50-01b311602d96 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:37.931865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-55f0e102-6d5e-4c40-bb50-01b311602d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:37.948029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e102-6d5e-4c40-bb50-01b311602d96 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:37.953324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:37.953977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:37.954302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:37.954584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] PATH_INFO: `/v3/users/4fd6622300e544c0ae084e201f65568e` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:37.955752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd6622300e544c0ae084e201f65568e)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:37.957785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:38.092632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:38.178422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407556624c6b43a894325a0696c84a54'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.179158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407556624c6b43a894325a0696c84a54'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.186863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407556624c6b43a894325a0696c84a54'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.200642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407556624c6b43a894325a0696c84a54'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.201371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407556624c6b43a894325a0696c84a54'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.253910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd6622300e544c0ae084e201f65568e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.261875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd6622300e544c0ae084e201f65568e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.279043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd6622300e544c0ae084e201f65568e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.285359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1022/2028] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:37 2022] DELETE /identity/v3/users/407556624c6b43a894325a0696c84a54 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:38.285359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:38.287989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:38.357726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd6622300e544c0ae084e201f65568e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.359864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd6622300e544c0ae084e201f65568e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.371262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6f65b-7026-4558-a469-9156acf74761 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:38.384415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:38.385332 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:38.385601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:38.386017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:38.386165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] PATH_INFO: `/v3/users/4ca6f2ebaf9645b9838ff66a3d19cdde` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:38.387447 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca6f2ebaf9645b9838ff66a3d19cdde)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:38.389182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1007/2029] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:37 2022] DELETE /identity/v3/users/4fd6622300e544c0ae084e201f65568e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:38.389497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:38.389907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:38.391420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:38.469346 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aaedb-e095-4f23-bd1e-decbe4bcd0e3 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:38.473109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ae08-1222-4f62-b010-6d0a8d0c0ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:38.473977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ae08-1222-4f62-b010-6d0a8d0c0ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:38.474331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ae08-1222-4f62-b010-6d0a8d0c0ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:38.474811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ae08-1222-4f62-b010-6d0a8d0c0ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:38.476589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7527ae08-1222-4f62-b010-6d0a8d0c0ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:38.548636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ae08-1222-4f62-b010-6d0a8d0c0ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:38.551037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ae08-1222-4f62-b010-6d0a8d0c0ac4 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:38.561918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1008/2030] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:38.562962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ae08-1222-4f62-b010-6d0a8d0c0ac4 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:38.564455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7527ae08-1222-4f62-b010-6d0a8d0c0ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:38.675851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ae08-1222-4f62-b010-6d0a8d0c0ac4 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:38.681265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f715a-544c-4082-8c1d-438cc93f5ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:38.682008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f715a-544c-4082-8c1d-438cc93f5ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:38.682365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f715a-544c-4082-8c1d-438cc93f5ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:38.682642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f715a-544c-4082-8c1d-438cc93f5ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:38.684182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f715a-544c-4082-8c1d-438cc93f5ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:38.686481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f715a-544c-4082-8c1d-438cc93f5ad8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:38.752653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca6f2ebaf9645b9838ff66a3d19cdde'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.753895 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca6f2ebaf9645b9838ff66a3d19cdde'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.769365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca6f2ebaf9645b9838ff66a3d19cdde'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.803155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca6f2ebaf9645b9838ff66a3d19cdde'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.808133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca6f2ebaf9645b9838ff66a3d19cdde'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:38.838524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1009/2031] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:38 2022] POST /identity/v3/projects => generated 365 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:38.839878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c7ca6-6e97-48df-b7ba-bccba81be16e None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:38.840679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c7ca6-6e97-48df-b7ba-bccba81be16e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:38.841126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c7ca6-6e97-48df-b7ba-bccba81be16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:38.899076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-9b4c7ca6-6e97-48df-b7ba-bccba81be16e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:38.901729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9b4c7ca6-6e97-48df-b7ba-bccba81be16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:38.903544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1023/2032] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:38 2022] DELETE /identity/v3/users/4ca6f2ebaf9645b9838ff66a3d19cdde => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:38.904715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:38.906481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:38.999715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02485e0-f32f-4a67-8271-0f5f04c4dc82 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:39.004430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:39.005731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:39.006045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:39.006347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] PATH_INFO: `/v3/users/c9c07b62794144d5ad5f4f054303adb8` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:39.007500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c07b62794144d5ad5f4f054303adb8)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:39.009427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:39.013263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1010/2033] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:39.013263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c7ca6-6e97-48df-b7ba-bccba81be16e None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:39.014820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9b4c7ca6-6e97-48df-b7ba-bccba81be16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:39.027335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c7ca6-6e97-48df-b7ba-bccba81be16e None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:39.032117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e026c-6e6a-4917-98ba-76c6de06d76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:39.034707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e026c-6e6a-4917-98ba-76c6de06d76d admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:39.034707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e026c-6e6a-4917-98ba-76c6de06d76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:39.034707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e026c-6e6a-4917-98ba-76c6de06d76d admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:39.034707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e026c-6e6a-4917-98ba-76c6de06d76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:39.035868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e026c-6e6a-4917-98ba-76c6de06d76d admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:39.187599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1011/2034] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:39 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:39.188694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e026c-6e6a-4917-98ba-76c6de06d76d admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:39.191061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-397e026c-6e6a-4917-98ba-76c6de06d76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:39.234397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c07b62794144d5ad5f4f054303adb8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:39.235067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c07b62794144d5ad5f4f054303adb8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:39.248126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c07b62794144d5ad5f4f054303adb8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:39.267051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c07b62794144d5ad5f4f054303adb8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:39.268021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c07b62794144d5ad5f4f054303adb8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:39.268365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e026c-6e6a-4917-98ba-76c6de06d76d admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:39.273312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf87112-c5e1-45dc-8628-aa0ae2d1c355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:39.273953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf87112-c5e1-45dc-8628-aa0ae2d1c355 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:39.274269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf87112-c5e1-45dc-8628-aa0ae2d1c355 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:39.274542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf87112-c5e1-45dc-8628-aa0ae2d1c355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:39.276426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7bf87112-c5e1-45dc-8628-aa0ae2d1c355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:39.292152 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf87112-c5e1-45dc-8628-aa0ae2d1c355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:39.293589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf87112-c5e1-45dc-8628-aa0ae2d1c355 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:39.305072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1012/2035] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:39.305938 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf87112-c5e1-45dc-8628-aa0ae2d1c355 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:39.307394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7bf87112-c5e1-45dc-8628-aa0ae2d1c355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:39.320240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf87112-c5e1-45dc-8628-aa0ae2d1c355 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:39.325943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:39.326423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:39.326707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:39.327036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] PATH_INFO: `/v3/projects/3ed3f04ae4e34251bd0020aa01f20ec7` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:39.328164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed3f04ae4e34251bd0020aa01f20ec7)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:39.330133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:39.386028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1024/2036] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:38 2022] DELETE /identity/v3/users/c9c07b62794144d5ad5f4f054303adb8 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:39.390421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:39.392928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:39.473277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed3f04ae4e34251bd0020aa01f20ec7', 'request_id': 'req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:39.482922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed3f04ae4e34251bd0020aa01f20ec7', 'request_id': 'req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:39.484038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bf874-0df1-40f7-a3dc-fc11ea4bca7f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:39.496574 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed3f04ae4e34251bd0020aa01f20ec7', 'request_id': 'req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:39.592627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81be229-23b9-4a0e-ba3b-98a69d8a4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:39.593557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81be229-23b9-4a0e-ba3b-98a69d8a4ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:39.594022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81be229-23b9-4a0e-ba3b-98a69d8a4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:39.594503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81be229-23b9-4a0e-ba3b-98a69d8a4ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:39.595433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81be229-23b9-4a0e-ba3b-98a69d8a4ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:39.597247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81be229-23b9-4a0e-ba3b-98a69d8a4ec4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:39.612794 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1025/2037] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:39.614549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea84b7-712a-4fef-9003-064d72313679 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:39.615316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea84b7-712a-4fef-9003-064d72313679 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:39.615845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea84b7-712a-4fef-9003-064d72313679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:39.642615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-0cea84b7-712a-4fef-9003-064d72313679 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:39.644599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0cea84b7-712a-4fef-9003-064d72313679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:39.657365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1026/2038] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:39.658543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea84b7-712a-4fef-9003-064d72313679 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:39.673063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea84b7-712a-4fef-9003-064d72313679 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:39.678569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36e9d-2967-49da-85cc-fe4be1926d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:39.679533 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36e9d-2967-49da-85cc-fe4be1926d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:39.680051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36e9d-2967-49da-85cc-fe4be1926d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:39.680565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36e9d-2967-49da-85cc-fe4be1926d09 admin admin] PATH_INFO: `/v3/projects/c95760a660774883aac37945a9c222e3/users/a3ca2d63916e4995917e116327773695/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:39.691865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] The token cache is being invalidate because project 3ed3f04ae4e34251bd0020aa01f20ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:39.693720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:39.696303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:39.698043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1013/2039] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:39 2022] DELETE /identity/v3/projects/3ed3f04ae4e34251bd0020aa01f20ec7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:39.701599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:39.707199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:39.729630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f36e9d-2967-49da-85cc-fe4be1926d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95760a660774883aac37945a9c222e3, user_id=a3ca2d63916e4995917e116327773695, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:39.733793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f36e9d-2967-49da-85cc-fe4be1926d09 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:39.824837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2df70d-409d-4ef4-95f2-c7ce582a0a90 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:39.828850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384ce08-6cbf-487b-aa1b-c51564f5f7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:39.829477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384ce08-6cbf-487b-aa1b-c51564f5f7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:39.829752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384ce08-6cbf-487b-aa1b-c51564f5f7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:39.830027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384ce08-6cbf-487b-aa1b-c51564f5f7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:39.837625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9384ce08-6cbf-487b-aa1b-c51564f5f7f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:39.846092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384ce08-6cbf-487b-aa1b-c51564f5f7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:39.847688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384ce08-6cbf-487b-aa1b-c51564f5f7f7 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:39.860842 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1014/2040] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:39.861921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f851de-656a-4e7a-899d-5492622ab784 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:39.862230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f851de-656a-4e7a-899d-5492622ab784 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:39.862542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f851de-656a-4e7a-899d-5492622ab784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:39.868929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1027/2041] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:39 2022] PUT /identity/v3/projects/c95760a660774883aac37945a9c222e3/users/a3ca2d63916e4995917e116327773695/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:39.871030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36e9d-2967-49da-85cc-fe4be1926d09 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:39.873663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c0f36e9d-2967-49da-85cc-fe4be1926d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:39.893161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c5f851de-656a-4e7a-899d-5492622ab784 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:39.894512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c5f851de-656a-4e7a-899d-5492622ab784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:39.998356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1015/2042] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:40.001917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f851de-656a-4e7a-899d-5492622ab784 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:40.006568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c5f851de-656a-4e7a-899d-5492622ab784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:40.015536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36e9d-2967-49da-85cc-fe4be1926d09 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:40.028601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f851de-656a-4e7a-899d-5492622ab784 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:40.029744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:40.031658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:40.032127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:40.032710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] PATH_INFO: `/v3/projects/9cd635a17fa84ee3b97c88ca1822ec82` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:40.034654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd635a17fa84ee3b97c88ca1822ec82)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:40.034951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab438e2-b5bf-4646-804c-790841a61287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:40.035771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab438e2-b5bf-4646-804c-790841a61287 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:40.036525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab438e2-b5bf-4646-804c-790841a61287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:40.036936 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab438e2-b5bf-4646-804c-790841a61287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:40.037844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab438e2-b5bf-4646-804c-790841a61287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:40.039069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:40.039629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab438e2-b5bf-4646-804c-790841a61287 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:40.055564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1016/2043] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:40.057301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f379a-8a99-4961-a25a-ff9db42adc80 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:40.057733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f379a-8a99-4961-a25a-ff9db42adc80 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:40.058113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f379a-8a99-4961-a25a-ff9db42adc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:40.082478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b74f379a-8a99-4961-a25a-ff9db42adc80 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:40.084312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b74f379a-8a99-4961-a25a-ff9db42adc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:40.098529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1017/2044] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:40.098529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f379a-8a99-4961-a25a-ff9db42adc80 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:40.120993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f379a-8a99-4961-a25a-ff9db42adc80 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:40.127978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde2ad4-925b-4c4c-a301-bd214f15a878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:40.129259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde2ad4-925b-4c4c-a301-bd214f15a878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:40.129814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde2ad4-925b-4c4c-a301-bd214f15a878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:40.130448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde2ad4-925b-4c4c-a301-bd214f15a878 admin admin] PATH_INFO: `/v3/projects/c95760a660774883aac37945a9c222e3/users/a3ca2d63916e4995917e116327773695/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:40.133203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde2ad4-925b-4c4c-a301-bd214f15a878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95760a660774883aac37945a9c222e3, user_id=a3ca2d63916e4995917e116327773695, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:40.136186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde2ad4-925b-4c4c-a301-bd214f15a878 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:40.154657 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1018/2045] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:40 2022] PUT /identity/v3/projects/c95760a660774883aac37945a9c222e3/users/a3ca2d63916e4995917e116327773695/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:40.155969 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde2ad4-925b-4c4c-a301-bd214f15a878 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:40.219809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd635a17fa84ee3b97c88ca1822ec82', 'request_id': 'req-fc574832-493b-47f0-9dfd-9d188c530882'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:40.223054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:40.253427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde2ad4-925b-4c4c-a301-bd214f15a878 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:40.334494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51817adf-db60-4733-a101-0894b40c1171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:40.335124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817adf-db60-4733-a101-0894b40c1171 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:40.335408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817adf-db60-4733-a101-0894b40c1171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:40.335682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817adf-db60-4733-a101-0894b40c1171 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:40.336483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51817adf-db60-4733-a101-0894b40c1171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:40.336933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51817adf-db60-4733-a101-0894b40c1171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:40.338888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51817adf-db60-4733-a101-0894b40c1171 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:40.339795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd635a17fa84ee3b97c88ca1822ec82', 'request_id': 'req-fc574832-493b-47f0-9dfd-9d188c530882'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:40.351308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd635a17fa84ee3b97c88ca1822ec82', 'request_id': 'req-fc574832-493b-47f0-9dfd-9d188c530882'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:40.354708 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1019/2046] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:40.358039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39650abd-6aa5-4fa0-8ddd-b9aac89214e5 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:40.358039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39650abd-6aa5-4fa0-8ddd-b9aac89214e5 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:40.358039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39650abd-6aa5-4fa0-8ddd-b9aac89214e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:40.381485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] The token cache is being invalidate because project 9cd635a17fa84ee3b97c88ca1822ec82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:40.382487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:40.383294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:40.384985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1028/2047] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:39 2022] DELETE /identity/v3/projects/9cd635a17fa84ee3b97c88ca1822ec82 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:40.385948 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:40.387679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:40.390749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-39650abd-6aa5-4fa0-8ddd-b9aac89214e5 None None] MFA Rules not processed for user `a3ca2d63916e4995917e116327773695`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:40.391940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-39650abd-6aa5-4fa0-8ddd-b9aac89214e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:40.401246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc574832-493b-47f0-9dfd-9d188c530882 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:40.405972 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:40.406929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:40.407420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:40.407691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] PATH_INFO: `/v3/projects/920a62885f3b4526a4c51c02b1ab75e5` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:40.409049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920a62885f3b4526a4c51c02b1ab75e5)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:40.411804 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:40.463916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1020/2048] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:40.465121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39650abd-6aa5-4fa0-8ddd-b9aac89214e5 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:40.469193 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-39650abd-6aa5-4fa0-8ddd-b9aac89214e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:40.496469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39650abd-6aa5-4fa0-8ddd-b9aac89214e5 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:40.502188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aec398-dcb3-41e2-acdb-14013f6c772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:40.503599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aec398-dcb3-41e2-acdb-14013f6c772f admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:40.504063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aec398-dcb3-41e2-acdb-14013f6c772f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:40.504426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aec398-dcb3-41e2-acdb-14013f6c772f admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:40.506274 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aec398-dcb3-41e2-acdb-14013f6c772f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:40.508724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aec398-dcb3-41e2-acdb-14013f6c772f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:40.864421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920a62885f3b4526a4c51c02b1ab75e5', 'request_id': 'req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.247445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1021/2049] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:40 2022] POST /identity/v3/projects => generated 375 bytes in 782 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:41.248344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84a198-8af9-4f80-b409-c7fa3cf30f70 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:41.248728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84a198-8af9-4f80-b409-c7fa3cf30f70 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:41.249248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84a198-8af9-4f80-b409-c7fa3cf30f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:41.272526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920a62885f3b4526a4c51c02b1ab75e5', 'request_id': 'req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.277912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-8b84a198-8af9-4f80-b409-c7fa3cf30f70 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:41.280914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8b84a198-8af9-4f80-b409-c7fa3cf30f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:41.282056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920a62885f3b4526a4c51c02b1ab75e5', 'request_id': 'req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.296740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] The token cache is being invalidate because project 920a62885f3b4526a4c51c02b1ab75e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:41.297583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.298375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.300752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1029/2050] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:40 2022] DELETE /identity/v3/projects/920a62885f3b4526a4c51c02b1ab75e5 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:41.301375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:41.305177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:41.350613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1022/2051] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:41.355357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84a198-8af9-4f80-b409-c7fa3cf30f70 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:41.355357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8b84a198-8af9-4f80-b409-c7fa3cf30f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:41.360676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:41.366101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84a198-8af9-4f80-b409-c7fa3cf30f70 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:41.375781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:41.376428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:41.376878 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:41.377157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] PATH_INFO: `/v3/projects/9cf3ec1ff225421cb254790b63969763` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:41.378339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf3ec1ff225421cb254790b63969763)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:41.379131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98f0a0-8170-47de-84a5-3e629a9a6aa7 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:41.381234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:41.435628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3e727-5bc2-44df-b7e2-ddfe8af7cbad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:41.436503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3e727-5bc2-44df-b7e2-ddfe8af7cbad service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:41.436784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3e727-5bc2-44df-b7e2-ddfe8af7cbad service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:41.437053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3e727-5bc2-44df-b7e2-ddfe8af7cbad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:41.438900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-cce3e727-5bc2-44df-b7e2-ddfe8af7cbad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:41.501857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3e727-5bc2-44df-b7e2-ddfe8af7cbad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:41.503316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3e727-5bc2-44df-b7e2-ddfe8af7cbad service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:41.513860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1030/2052] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:41.519648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3e727-5bc2-44df-b7e2-ddfe8af7cbad service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:41.519648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-cce3e727-5bc2-44df-b7e2-ddfe8af7cbad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:41.529199 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3e727-5bc2-44df-b7e2-ddfe8af7cbad service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:41.533945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:41.534638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:41.534922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:41.535203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] PATH_INFO: `/v3/users/8f24308cb04a4229b770e58d6e7a832f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:41.536753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f24308cb04a4229b770e58d6e7a832f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:41.538840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:41.557186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf3ec1ff225421cb254790b63969763', 'request_id': 'req-42edc71a-abde-4d48-a01e-598462bd1d02'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.563565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf3ec1ff225421cb254790b63969763', 'request_id': 'req-42edc71a-abde-4d48-a01e-598462bd1d02'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.569638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf3ec1ff225421cb254790b63969763', 'request_id': 'req-42edc71a-abde-4d48-a01e-598462bd1d02'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.710072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] The token cache is being invalidate because project 9cf3ec1ff225421cb254790b63969763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:41.710183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.710896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.712414 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1023/2053] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:41 2022] DELETE /identity/v3/projects/9cf3ec1ff225421cb254790b63969763 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:41.713269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:41.714602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:41.790942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edc71a-abde-4d48-a01e-598462bd1d02 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:41.792497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679339-0952-4133-8949-d93f44480f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:41.793144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679339-0952-4133-8949-d93f44480f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:41.793418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679339-0952-4133-8949-d93f44480f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:41.793691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679339-0952-4133-8949-d93f44480f17 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:41.794361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679339-0952-4133-8949-d93f44480f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:41.796263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679339-0952-4133-8949-d93f44480f17 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:41.798449 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f24308cb04a4229b770e58d6e7a832f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.799172 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f24308cb04a4229b770e58d6e7a832f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.807575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f24308cb04a4229b770e58d6e7a832f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.820805 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f24308cb04a4229b770e58d6e7a832f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.821525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f24308cb04a4229b770e58d6e7a832f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:41.952011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1031/2054] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:41 2022] DELETE /identity/v3/users/8f24308cb04a4229b770e58d6e7a832f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:41.956979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:41.956979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:41.957168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1024/2055] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:41 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:41.957168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5ecc-6785-44c9-a45c-3be192a3be5e None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:41.957168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5ecc-6785-44c9-a45c-3be192a3be5e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:41.957168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f5ecc-6785-44c9-a45c-3be192a3be5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:41.980269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ed1f5ecc-6785-44c9-a45c-3be192a3be5e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:41.981508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ed1f5ecc-6785-44c9-a45c-3be192a3be5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:42.027766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404e5ca-7eeb-46fc-a9e5-0dd3dacd08ed admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:42.032619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:42.033351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.033705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.033918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] PATH_INFO: `/v3/users/d8afd707958045668b48674181c4214e` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.035139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8afd707958045668b48674181c4214e)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:42.037458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:42.050406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1025/2056] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:42.053488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c33e2c-c4c0-4a63-887d-932363706647 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.055403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c33e2c-c4c0-4a63-887d-932363706647 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.055403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c33e2c-c4c0-4a63-887d-932363706647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.075781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-35c33e2c-c4c0-4a63-887d-932363706647 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:42.077073 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-35c33e2c-c4c0-4a63-887d-932363706647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:42.092425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1026/2057] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:42.092425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c33e2c-c4c0-4a63-887d-932363706647 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:42.092425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-35c33e2c-c4c0-4a63-887d-932363706647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:42.103691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c33e2c-c4c0-4a63-887d-932363706647 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:42.117530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0a4a3-4f69-453d-986c-35651b311d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:42.117530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0a4a3-4f69-453d-986c-35651b311d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.117530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0a4a3-4f69-453d-986c-35651b311d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.117530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0a4a3-4f69-453d-986c-35651b311d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.117956 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0a4a3-4f69-453d-986c-35651b311d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:42.117956 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0a4a3-4f69-453d-986c-35651b311d99 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:42.128469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1027/2058] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:42.130138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0a4a3-4f69-453d-986c-35651b311d99 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:42.141196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0a4a3-4f69-453d-986c-35651b311d99 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:42.146806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7fc81-94be-4b22-9ba9-08279d4f50a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:42.147411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7fc81-94be-4b22-9ba9-08279d4f50a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.147694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7fc81-94be-4b22-9ba9-08279d4f50a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.147975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7fc81-94be-4b22-9ba9-08279d4f50a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.148628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7fc81-94be-4b22-9ba9-08279d4f50a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:42.148935 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7fc81-94be-4b22-9ba9-08279d4f50a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:42.150572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7fc81-94be-4b22-9ba9-08279d4f50a8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:42.163198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1028/2059] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:42.164391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437014f-5a87-407e-a13e-c1327de350be None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.164675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437014f-5a87-407e-a13e-c1327de350be None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.164951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437014f-5a87-407e-a13e-c1327de350be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.183841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2437014f-5a87-407e-a13e-c1327de350be None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:42.187065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2437014f-5a87-407e-a13e-c1327de350be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:42.198541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1029/2060] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:42.200069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437014f-5a87-407e-a13e-c1327de350be None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:42.213676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437014f-5a87-407e-a13e-c1327de350be None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:42.218476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f8d5-cb73-40cc-9ea9-708ab00fe52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:42.219064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f8d5-cb73-40cc-9ea9-708ab00fe52b admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.219383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f8d5-cb73-40cc-9ea9-708ab00fe52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.219638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f8d5-cb73-40cc-9ea9-708ab00fe52b admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.220301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18f8d5-cb73-40cc-9ea9-708ab00fe52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:42.221935 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18f8d5-cb73-40cc-9ea9-708ab00fe52b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:42.232208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1030/2061] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:42.232961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f8d5-cb73-40cc-9ea9-708ab00fe52b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:42.243041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f8d5-cb73-40cc-9ea9-708ab00fe52b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:42.247573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d88373-49cf-44e0-86de-5fdf9d7b4824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:42.248126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d88373-49cf-44e0-86de-5fdf9d7b4824 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.248404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d88373-49cf-44e0-86de-5fdf9d7b4824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.248675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d88373-49cf-44e0-86de-5fdf9d7b4824 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.249276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d88373-49cf-44e0-86de-5fdf9d7b4824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:42.251156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d88373-49cf-44e0-86de-5fdf9d7b4824 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:42.416672 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1031/2062] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:42 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:42.417781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d88373-49cf-44e0-86de-5fdf9d7b4824 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:42.504358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d88373-49cf-44e0-86de-5fdf9d7b4824 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:42.510281 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4415a-5862-4c52-a4d8-e547a8f7fc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:42.511133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4415a-5862-4c52-a4d8-e547a8f7fc1b admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.511393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4415a-5862-4c52-a4d8-e547a8f7fc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.511666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4415a-5862-4c52-a4d8-e547a8f7fc1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.512336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4415a-5862-4c52-a4d8-e547a8f7fc1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:42.512641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4415a-5862-4c52-a4d8-e547a8f7fc1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:42.514304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8afd707958045668b48674181c4214e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:42.514807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4415a-5862-4c52-a4d8-e547a8f7fc1b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:42.515313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8afd707958045668b48674181c4214e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:42.524005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8afd707958045668b48674181c4214e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:42.527592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1032/2063] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:42.530063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4415a-5862-4c52-a4d8-e547a8f7fc1b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:42.530303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0fc4415a-5862-4c52-a4d8-e547a8f7fc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:42.543059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8afd707958045668b48674181c4214e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:42.544021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8afd707958045668b48674181c4214e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:42.544297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4415a-5862-4c52-a4d8-e547a8f7fc1b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:42.550186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29bce1-4656-48fe-b6f1-14c76202cb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:42.550910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29bce1-4656-48fe-b6f1-14c76202cb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.551187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29bce1-4656-48fe-b6f1-14c76202cb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.551991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29bce1-4656-48fe-b6f1-14c76202cb04 admin admin] PATH_INFO: `/v3/projects/492b18ed532541f3a89fb28be23037dc/users/8ce78be649864366be87392ea99c6c5d/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.571043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29bce1-4656-48fe-b6f1-14c76202cb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492b18ed532541f3a89fb28be23037dc, user_id=8ce78be649864366be87392ea99c6c5d, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:42.573916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29bce1-4656-48fe-b6f1-14c76202cb04 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:42.654626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1032/2064] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:41 2022] DELETE /identity/v3/users/d8afd707958045668b48674181c4214e => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:42.655660 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:42.657181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:42.681505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1033/2065] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:42 2022] PUT /identity/v3/projects/492b18ed532541f3a89fb28be23037dc/users/8ce78be649864366be87392ea99c6c5d/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:42.682516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29bce1-4656-48fe-b6f1-14c76202cb04 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:42.684393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6f29bce1-4656-48fe-b6f1-14c76202cb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:42.751450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4b531-9029-4c5e-a839-3be2df7094a3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:42.770983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29bce1-4656-48fe-b6f1-14c76202cb04 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:42.777554 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb006-5f2f-4127-960c-0e0df6e631ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:42.778475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb006-5f2f-4127-960c-0e0df6e631ca admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.778945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb006-5f2f-4127-960c-0e0df6e631ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.779349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb006-5f2f-4127-960c-0e0df6e631ca admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.780149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb006-5f2f-4127-960c-0e0df6e631ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:42.782192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb006-5f2f-4127-960c-0e0df6e631ca admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:42.827254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:42.828007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.828352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.828702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] PATH_INFO: `/v3/projects/20461a50392347dea913bc8048a6b7e1` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.829975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20461a50392347dea913bc8048a6b7e1)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:42.832123 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:42.904141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1034/2066] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:42 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:42.904141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb006-5f2f-4127-960c-0e0df6e631ca admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:42.904141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8d9cb006-5f2f-4127-960c-0e0df6e631ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:42.918542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb006-5f2f-4127-960c-0e0df6e631ca admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:42.923951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e485f6-4490-427c-9649-4c950f9a4fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:42.924573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e485f6-4490-427c-9649-4c950f9a4fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:42.924884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e485f6-4490-427c-9649-4c950f9a4fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:42.925121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e485f6-4490-427c-9649-4c950f9a4fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:42.925756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e485f6-4490-427c-9649-4c950f9a4fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:42.927721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e485f6-4490-427c-9649-4c950f9a4fbd admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:42.990931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20461a50392347dea913bc8048a6b7e1', 'request_id': 'req-552a196c-ea01-4566-a164-110a326330a3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.076163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1035/2067] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:42 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:43.076163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e485f6-4490-427c-9649-4c950f9a4fbd admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.076163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-94e485f6-4490-427c-9649-4c950f9a4fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.092792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20461a50392347dea913bc8048a6b7e1', 'request_id': 'req-552a196c-ea01-4566-a164-110a326330a3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.099288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20461a50392347dea913bc8048a6b7e1', 'request_id': 'req-552a196c-ea01-4566-a164-110a326330a3'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.109857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] The token cache is being invalidate because project 20461a50392347dea913bc8048a6b7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:43.112618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.112618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-552a196c-ea01-4566-a164-110a326330a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.112618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1033/2068] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:42 2022] DELETE /identity/v3/projects/20461a50392347dea913bc8048a6b7e1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:43.114900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062902d-f20c-48e6-8c3b-2d32c854c516 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.114900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062902d-f20c-48e6-8c3b-2d32c854c516 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.114900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062902d-f20c-48e6-8c3b-2d32c854c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.143010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-a062902d-f20c-48e6-8c3b-2d32c854c516 None None] MFA Rules not processed for user `8ce78be649864366be87392ea99c6c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:43.144222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a062902d-f20c-48e6-8c3b-2d32c854c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.145009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e485f6-4490-427c-9649-4c950f9a4fbd admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.150633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.151271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.151555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.151832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] PATH_INFO: `/v3/users/a2675915d2f24a7cb5f78194bac88ccc` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.153025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2675915d2f24a7cb5f78194bac88ccc)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:43.155006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:43.215542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1034/2069] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:43.216406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062902d-f20c-48e6-8c3b-2d32c854c516 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.217699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a062902d-f20c-48e6-8c3b-2d32c854c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.232002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062902d-f20c-48e6-8c3b-2d32c854c516 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.236634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e259a3-0591-404b-89f3-9e5c7d61a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.237228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e259a3-0591-404b-89f3-9e5c7d61a6dd admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.242322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e259a3-0591-404b-89f3-9e5c7d61a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.242322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e259a3-0591-404b-89f3-9e5c7d61a6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.242322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e259a3-0591-404b-89f3-9e5c7d61a6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:43.242322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e259a3-0591-404b-89f3-9e5c7d61a6dd admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:43.251162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1035/2070] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:43.251920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e259a3-0591-404b-89f3-9e5c7d61a6dd admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.253635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a7e259a3-0591-404b-89f3-9e5c7d61a6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.266854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e259a3-0591-404b-89f3-9e5c7d61a6dd admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.271801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8f783-b213-45a6-a7a5-ba72ac3d233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.272386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8f783-b213-45a6-a7a5-ba72ac3d233b admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.272669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8f783-b213-45a6-a7a5-ba72ac3d233b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.272944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8f783-b213-45a6-a7a5-ba72ac3d233b admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.273562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8f783-b213-45a6-a7a5-ba72ac3d233b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:43.275615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8f783-b213-45a6-a7a5-ba72ac3d233b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:43.328682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:43.377632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1036/2071] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:43 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:43.378944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e3c2-cf3b-4548-94ef-717f8ea8ce56 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.379234 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e3c2-cf3b-4548-94ef-717f8ea8ce56 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.379510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e3c2-cf3b-4548-94ef-717f8ea8ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.401061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-a2e4e3c2-cf3b-4548-94ef-717f8ea8ce56 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:43.402300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a2e4e3c2-cf3b-4548-94ef-717f8ea8ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.410669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1037/2072] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:43.419937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e3c2-cf3b-4548-94ef-717f8ea8ce56 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.419937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a2e4e3c2-cf3b-4548-94ef-717f8ea8ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.425337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e3c2-cf3b-4548-94ef-717f8ea8ce56 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.425986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2675915d2f24a7cb5f78194bac88ccc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.431082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.431735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.432017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.432292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] PATH_INFO: `/v3/projects/c5d1f382d55446058681c103f325980c` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.433450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d1f382d55446058681c103f325980c)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:43.433764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2675915d2f24a7cb5f78194bac88ccc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.435401 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:43.446379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2675915d2f24a7cb5f78194bac88ccc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.548611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2675915d2f24a7cb5f78194bac88ccc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.549244 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2675915d2f24a7cb5f78194bac88ccc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.556329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1036/2073] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:43 2022] DELETE /identity/v3/users/a2675915d2f24a7cb5f78194bac88ccc => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:43.557135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.558499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.568092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d1f382d55446058681c103f325980c', 'request_id': 'req-1f97e4ea-9d6b-4726-8e67-1566e655c25f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.616520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a58681-158b-4222-8835-3abcaa02b5ad admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.621184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:43.622024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb02288-d13b-44be-af2e-1edafb5fa3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.622730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb02288-d13b-44be-af2e-1edafb5fa3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.623013 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb02288-d13b-44be-af2e-1edafb5fa3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.623280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb02288-d13b-44be-af2e-1edafb5fa3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.625065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0cb02288-d13b-44be-af2e-1edafb5fa3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.663182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d1f382d55446058681c103f325980c', 'request_id': 'req-1f97e4ea-9d6b-4726-8e67-1566e655c25f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.672172 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d1f382d55446058681c103f325980c', 'request_id': 'req-1f97e4ea-9d6b-4726-8e67-1566e655c25f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.681121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] The token cache is being invalidate because project c5d1f382d55446058681c103f325980c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:43.681484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.682243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:43.683397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb02288-d13b-44be-af2e-1edafb5fa3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:43.684085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1038/2074] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:43 2022] DELETE /identity/v3/projects/c5d1f382d55446058681c103f325980c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:43.684828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb02288-d13b-44be-af2e-1edafb5fa3b3 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:43.685010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.686785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.694835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1037/2075] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:43.695609 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb02288-d13b-44be-af2e-1edafb5fa3b3 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.696922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0cb02288-d13b-44be-af2e-1edafb5fa3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.767110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb02288-d13b-44be-af2e-1edafb5fa3b3 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.768714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97e4ea-9d6b-4726-8e67-1566e655c25f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.774725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63db32-d6f9-4b0a-860a-8a0e60542462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.774864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cfad6-4b93-432e-acfd-8247cd4dada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.775063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfad6-4b93-432e-acfd-8247cd4dada4 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.775229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63db32-d6f9-4b0a-860a-8a0e60542462 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.775330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfad6-4b93-432e-acfd-8247cd4dada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.775497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63db32-d6f9-4b0a-860a-8a0e60542462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.775600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfad6-4b93-432e-acfd-8247cd4dada4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.775874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63db32-d6f9-4b0a-860a-8a0e60542462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.776405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cfad6-4b93-432e-acfd-8247cd4dada4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:43.776649 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63db32-d6f9-4b0a-860a-8a0e60542462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:43.778110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cfad6-4b93-432e-acfd-8247cd4dada4 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:43.778508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63db32-d6f9-4b0a-860a-8a0e60542462 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:43.792951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1038/2076] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:43.793082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1039/2077] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:43.793082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d507ed2-1f18-4b60-961a-bbd812891cd9 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.793082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d507ed2-1f18-4b60-961a-bbd812891cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.793082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d507ed2-1f18-4b60-961a-bbd812891cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.794564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327189-d3c3-4893-a77f-95bce3b9e374 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.794922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327189-d3c3-4893-a77f-95bce3b9e374 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.795263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327189-d3c3-4893-a77f-95bce3b9e374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.816294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-0d507ed2-1f18-4b60-961a-bbd812891cd9 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:43.825628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-98327189-d3c3-4893-a77f-95bce3b9e374 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:43.825767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0d507ed2-1f18-4b60-961a-bbd812891cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.825860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-98327189-d3c3-4893-a77f-95bce3b9e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.826269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1039/2078] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:43.826376 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1040/2079] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:43.826938 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d507ed2-1f18-4b60-961a-bbd812891cd9 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.830908 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9230-8d0c-424e-a2a1-63815a01553d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.831613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9230-8d0c-424e-a2a1-63815a01553d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.831613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f9230-8d0c-424e-a2a1-63815a01553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.837314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0d507ed2-1f18-4b60-961a-bbd812891cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.850766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d507ed2-1f18-4b60-961a-bbd812891cd9 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.856054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c3feb-538a-4e8d-bb3c-2c82648416d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.860513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3feb-538a-4e8d-bb3c-2c82648416d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.860513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3feb-538a-4e8d-bb3c-2c82648416d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.860513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3feb-538a-4e8d-bb3c-2c82648416d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.860513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c3feb-538a-4e8d-bb3c-2c82648416d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:43.861241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-825f9230-8d0c-424e-a2a1-63815a01553d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:43.861444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c3feb-538a-4e8d-bb3c-2c82648416d4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:43.862779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-825f9230-8d0c-424e-a2a1-63815a01553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.875679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1041/2080] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:43.875679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c3feb-538a-4e8d-bb3c-2c82648416d4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.878364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1040/2081] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:43.881415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9230-8d0c-424e-a2a1-63815a01553d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.887989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c3feb-538a-4e8d-bb3c-2c82648416d4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.893499 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f9230-8d0c-424e-a2a1-63815a01553d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.899005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71851707-2abd-4960-9bfc-e5d9ccd0d4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.899729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71851707-2abd-4960-9bfc-e5d9ccd0d4be admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.899963 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab2462-6298-44d8-a113-ba046d60d2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.900197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71851707-2abd-4960-9bfc-e5d9ccd0d4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.900577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71851707-2abd-4960-9bfc-e5d9ccd0d4be admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.900712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2462-6298-44d8-a113-ba046d60d2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.900922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2462-6298-44d8-a113-ba046d60d2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.901213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2462-6298-44d8-a113-ba046d60d2f5 admin admin] PATH_INFO: `/v3/projects/2072268d884b4e1a99ac64dc80453193/users/4a7f41fb3eb649d8948d595000434759/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.901588 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71851707-2abd-4960-9bfc-e5d9ccd0d4be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:43.901982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71851707-2abd-4960-9bfc-e5d9ccd0d4be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:43.903705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71851707-2abd-4960-9bfc-e5d9ccd0d4be admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:43.919726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1041/2082] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:43.919726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71851707-2abd-4960-9bfc-e5d9ccd0d4be admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:43.921387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-71851707-2abd-4960-9bfc-e5d9ccd0d4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:43.924604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab2462-6298-44d8-a113-ba046d60d2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2072268d884b4e1a99ac64dc80453193, user_id=4a7f41fb3eb649d8948d595000434759, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:43.928429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab2462-6298-44d8-a113-ba046d60d2f5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:43.984537 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71851707-2abd-4960-9bfc-e5d9ccd0d4be admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:43.988443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8da661-ec17-4c10-8464-bfdb7c519291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:43.989154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da661-ec17-4c10-8464-bfdb7c519291 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:43.989497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da661-ec17-4c10-8464-bfdb7c519291 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:43.989837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da661-ec17-4c10-8464-bfdb7c519291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:43.999555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8da661-ec17-4c10-8464-bfdb7c519291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:44.000985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8da661-ec17-4c10-8464-bfdb7c519291 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:44.011140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1042/2083] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:44.012007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8da661-ec17-4c10-8464-bfdb7c519291 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.030546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8da661-ec17-4c10-8464-bfdb7c519291 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:44.030546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092d45d-9edb-44f5-88b4-d2daa477eccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:44.030546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092d45d-9edb-44f5-88b4-d2daa477eccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.030546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092d45d-9edb-44f5-88b4-d2daa477eccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.030906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092d45d-9edb-44f5-88b4-d2daa477eccb admin admin] PATH_INFO: `/v3/projects/cbf2afbd0d5d4b65a519bc93f7b8d669/users/238113c9ad014abc8b1026f06fda6d43/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.044529 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1042/2084] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:43 2022] PUT /identity/v3/projects/2072268d884b4e1a99ac64dc80453193/users/4a7f41fb3eb649d8948d595000434759/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:44.049312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6ac37-01d9-4ad6-b526-698fd75480b1 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.049312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6ac37-01d9-4ad6-b526-698fd75480b1 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.049312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6ac37-01d9-4ad6-b526-698fd75480b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.049596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092d45d-9edb-44f5-88b4-d2daa477eccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf2afbd0d5d4b65a519bc93f7b8d669, user_id=238113c9ad014abc8b1026f06fda6d43, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:44.052296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092d45d-9edb-44f5-88b4-d2daa477eccb admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:44.070419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-edc6ac37-01d9-4ad6-b526-698fd75480b1 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:44.072212 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-edc6ac37-01d9-4ad6-b526-698fd75480b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:44.132340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1043/2085] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:44.133350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6ac37-01d9-4ad6-b526-698fd75480b1 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.142305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6ac37-01d9-4ad6-b526-698fd75480b1 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:44.147233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11c58-c733-4fdf-b8ad-30bb4fb0f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:44.153687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11c58-c733-4fdf-b8ad-30bb4fb0f9bb admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.153687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11c58-c733-4fdf-b8ad-30bb4fb0f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.153687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11c58-c733-4fdf-b8ad-30bb4fb0f9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.153687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11c58-c733-4fdf-b8ad-30bb4fb0f9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:44.153687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11c58-c733-4fdf-b8ad-30bb4fb0f9bb admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:44.178861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1043/2086] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:44 2022] PUT /identity/v3/projects/cbf2afbd0d5d4b65a519bc93f7b8d669/users/238113c9ad014abc8b1026f06fda6d43/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:44.180217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc119d-1072-47ab-a924-8d8d96ad3b6f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.180505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc119d-1072-47ab-a924-8d8d96ad3b6f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.180781 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc119d-1072-47ab-a924-8d8d96ad3b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.200161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-97bc119d-1072-47ab-a924-8d8d96ad3b6f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:44.202739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-97bc119d-1072-47ab-a924-8d8d96ad3b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:44.266997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1044/2087] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:44.270539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc119d-1072-47ab-a924-8d8d96ad3b6f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.285348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1044/2088] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:44.285546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc119d-1072-47ab-a924-8d8d96ad3b6f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:44.285641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870b7aa-05e4-4234-accc-ba042d8d673f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.285641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870b7aa-05e4-4234-accc-ba042d8d673f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.285641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870b7aa-05e4-4234-accc-ba042d8d673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.320779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9870b7aa-05e4-4234-accc-ba042d8d673f None None] MFA Rules not processed for user `238113c9ad014abc8b1026f06fda6d43`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:44.322276 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9870b7aa-05e4-4234-accc-ba042d8d673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:44.362496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f41c9-a833-49d3-b698-d926ab1c5d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:44.363324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f41c9-a833-49d3-b698-d926ab1c5d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.363616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f41c9-a833-49d3-b698-d926ab1c5d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.364291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f41c9-a833-49d3-b698-d926ab1c5d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.364985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f41c9-a833-49d3-b698-d926ab1c5d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:44.365547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f41c9-a833-49d3-b698-d926ab1c5d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:44.367124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f41c9-a833-49d3-b698-d926ab1c5d84 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:44.383603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1045/2089] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:44.383603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f41c9-a833-49d3-b698-d926ab1c5d84 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.403158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1045/2090] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:44.403923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870b7aa-05e4-4234-accc-ba042d8d673f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.415115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870b7aa-05e4-4234-accc-ba042d8d673f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:44.419810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee4ee-7f5d-407d-a415-64c961ef672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:44.420418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee4ee-7f5d-407d-a415-64c961ef672b admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.420707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee4ee-7f5d-407d-a415-64c961ef672b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.420978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee4ee-7f5d-407d-a415-64c961ef672b admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.421610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ee4ee-7f5d-407d-a415-64c961ef672b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:44.423671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ee4ee-7f5d-407d-a415-64c961ef672b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:44.443989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f41c9-a833-49d3-b698-d926ab1c5d84 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:44.447729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0c07a-ab68-45f2-bdc9-31d062d5e11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:44.448328 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0c07a-ab68-45f2-bdc9-31d062d5e11c service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.448604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0c07a-ab68-45f2-bdc9-31d062d5e11c service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.448871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0c07a-ab68-45f2-bdc9-31d062d5e11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.459605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0c07a-ab68-45f2-bdc9-31d062d5e11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:44.463527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0c07a-ab68-45f2-bdc9-31d062d5e11c service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:44.471954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1046/2091] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:44.472841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0c07a-ab68-45f2-bdc9-31d062d5e11c service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.483422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0c07a-ab68-45f2-bdc9-31d062d5e11c service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:44.492058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5de9b-a98a-427c-851b-6a8b3b7a3049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:44.492808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5de9b-a98a-427c-851b-6a8b3b7a3049 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.493040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5de9b-a98a-427c-851b-6a8b3b7a3049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.493316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5de9b-a98a-427c-851b-6a8b3b7a3049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.493958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5de9b-a98a-427c-851b-6a8b3b7a3049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:44.499147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5de9b-a98a-427c-851b-6a8b3b7a3049 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:44.591984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1047/2092] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:44 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:44.592909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5de9b-a98a-427c-851b-6a8b3b7a3049 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.596465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c0d5de9b-a98a-427c-851b-6a8b3b7a3049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:44.609246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1046/2093] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:44 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:44.610167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee4ee-7f5d-407d-a415-64c961ef672b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.611865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-842ee4ee-7f5d-407d-a415-64c961ef672b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:44.634791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee4ee-7f5d-407d-a415-64c961ef672b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:44.695242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5de9b-a98a-427c-851b-6a8b3b7a3049 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:44.698966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d3cf7-c2a5-40c3-b31b-c4424e9cdf1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bdd5f0b3bc4c099c0d34b3b7c3f3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:44.699570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3cf7-c2a5-40c3-b31b-c4424e9cdf1b service glance] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.699851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3cf7-c2a5-40c3-b31b-c4424e9cdf1b service glance] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.700162 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3cf7-c2a5-40c3-b31b-c4424e9cdf1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.703506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:44.704095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.704379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.704653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] PATH_INFO: `/v3/projects/41273918f6344e749ee8152d641baeeb` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.705846 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=41273918f6344e749ee8152d641baeeb)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:44.708569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:44.761238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d3cf7-c2a5-40c3-b31b-c4424e9cdf1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:44.762872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d3cf7-c2a5-40c3-b31b-c4424e9cdf1b service glance] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:44.773108 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1048/2094] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:44.773996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d3cf7-c2a5-40c3-b31b-c4424e9cdf1b service glance] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.787636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d3cf7-c2a5-40c3-b31b-c4424e9cdf1b service glance] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:44.795248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2477e9f-016a-46d0-9a01-dfbe4f9a01f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:44.796482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2477e9f-016a-46d0-9a01-dfbe4f9a01f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:44.796791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2477e9f-016a-46d0-9a01-dfbe4f9a01f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:44.797136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2477e9f-016a-46d0-9a01-dfbe4f9a01f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:44.799185 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2477e9f-016a-46d0-9a01-dfbe4f9a01f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:44.803799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2477e9f-016a-46d0-9a01-dfbe4f9a01f8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:44.805953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:44.890404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41273918f6344e749ee8152d641baeeb', 'request_id': 'req-77a813c8-cc3b-439b-bce5-15904bfb68cc'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:44.946654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1049/2095] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:44 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:44.946654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2477e9f-016a-46d0-9a01-dfbe4f9a01f8 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.956997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2477e9f-016a-46d0-9a01-dfbe4f9a01f8 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:44.965866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41273918f6344e749ee8152d641baeeb', 'request_id': 'req-77a813c8-cc3b-439b-bce5-15904bfb68cc'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:44.979836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41273918f6344e749ee8152d641baeeb', 'request_id': 'req-77a813c8-cc3b-439b-bce5-15904bfb68cc'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:44.987919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] The token cache is being invalidate because project 41273918f6344e749ee8152d641baeeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:44.988209 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:44.988877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:44.991565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1047/2096] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:44 2022] DELETE /identity/v3/projects/41273918f6344e749ee8152d641baeeb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:44.992298 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:44.993619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:45.027857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e5df9-0324-4b24-9d5b-7ead92300d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:45.028475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5df9-0324-4b24-9d5b-7ead92300d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.028761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5df9-0324-4b24-9d5b-7ead92300d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.029038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5df9-0324-4b24-9d5b-7ead92300d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.029796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e5df9-0324-4b24-9d5b-7ead92300d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:45.031602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e5df9-0324-4b24-9d5b-7ead92300d58 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:45.045315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1050/2097] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:45.045315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e5df9-0324-4b24-9d5b-7ead92300d58 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:45.050248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4a8e5df9-0324-4b24-9d5b-7ead92300d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:45.062903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e5df9-0324-4b24-9d5b-7ead92300d58 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:45.076293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:45.077558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.082664 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.082664 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] PATH_INFO: `/v3/users/a3ca2d63916e4995917e116327773695` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.082664 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ca2d63916e4995917e116327773695)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:45.086989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:45.113920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a813c8-cc3b-439b-bce5-15904bfb68cc admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:45.123274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8cc3-79ad-4f8a-a242-957f6138664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:45.127635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8cc3-79ad-4f8a-a242-957f6138664c admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.127926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8cc3-79ad-4f8a-a242-957f6138664c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.128236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8cc3-79ad-4f8a-a242-957f6138664c admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.129209 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c8cc3-79ad-4f8a-a242-957f6138664c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:45.133623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c8cc3-79ad-4f8a-a242-957f6138664c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:45.152684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1048/2098] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:45.154483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8cc3-79ad-4f8a-a242-957f6138664c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:45.158657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-921c8cc3-79ad-4f8a-a242-957f6138664c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:45.176641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8cc3-79ad-4f8a-a242-957f6138664c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:45.184090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c2074-d111-4337-af72-b4f1adc3aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:45.185058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c2074-d111-4337-af72-b4f1adc3aca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.185195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c2074-d111-4337-af72-b4f1adc3aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.185392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c2074-d111-4337-af72-b4f1adc3aca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.186342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c2074-d111-4337-af72-b4f1adc3aca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:45.188502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c2074-d111-4337-af72-b4f1adc3aca8 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:45.205017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1049/2099] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:45.205750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c2074-d111-4337-af72-b4f1adc3aca8 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:45.221791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c2074-d111-4337-af72-b4f1adc3aca8 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:45.227980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93dc3b-e533-48b4-a131-972413e526eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:45.228789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93dc3b-e533-48b4-a131-972413e526eb admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.229066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93dc3b-e533-48b4-a131-972413e526eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.232950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93dc3b-e533-48b4-a131-972413e526eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.232950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93dc3b-e533-48b4-a131-972413e526eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:45.232950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93dc3b-e533-48b4-a131-972413e526eb admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:45.244912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1050/2100] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:45.245945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93dc3b-e533-48b4-a131-972413e526eb admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:45.258650 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93dc3b-e533-48b4-a131-972413e526eb admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:45.263985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081c77c-553f-480c-b225-80db51823135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:45.264738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081c77c-553f-480c-b225-80db51823135 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.264958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081c77c-553f-480c-b225-80db51823135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.265227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081c77c-553f-480c-b225-80db51823135 admin admin] PATH_INFO: `/v3/projects/46237dbccc4c47a89db3741f48cbc2d6/users/ce9f9e0af5364256a397988590c0be60/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.280473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081c77c-553f-480c-b225-80db51823135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46237dbccc4c47a89db3741f48cbc2d6, user_id=ce9f9e0af5364256a397988590c0be60, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:45.283260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081c77c-553f-480c-b225-80db51823135 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:45.434989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1051/2101] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:45 2022] PUT /identity/v3/projects/46237dbccc4c47a89db3741f48cbc2d6/users/ce9f9e0af5364256a397988590c0be60/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:45.444509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081c77c-553f-480c-b225-80db51823135 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:45.485266 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ca2d63916e4995917e116327773695'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:45.493906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ca2d63916e4995917e116327773695'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:45.506941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ca2d63916e4995917e116327773695'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:45.512930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081c77c-553f-480c-b225-80db51823135 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:45.517834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bbaf6-863a-4dcc-9881-b973a40c17ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:45.518274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bbaf6-863a-4dcc-9881-b973a40c17ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.518555 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bbaf6-863a-4dcc-9881-b973a40c17ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.518827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bbaf6-863a-4dcc-9881-b973a40c17ab admin admin] PATH_INFO: `/v3/projects/56cd152cf75447a390553631ed2c7844/users/030db27d39fa47768254409de5e9ae2d/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.536345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bbaf6-863a-4dcc-9881-b973a40c17ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cd152cf75447a390553631ed2c7844, user_id=030db27d39fa47768254409de5e9ae2d, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:45.540614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bbaf6-863a-4dcc-9881-b973a40c17ab admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:45.588932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:45.626541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ca2d63916e4995917e116327773695'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:45.626541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-b0c23e8e-7deb-4b93-9efc-0d7a1cb0653e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ca2d63916e4995917e116327773695'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:45.626716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1052/2102] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:45 2022] PUT /identity/v3/projects/56cd152cf75447a390553631ed2c7844/users/030db27d39fa47768254409de5e9ae2d/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:45.627712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d605e-e345-4dfb-93a1-ac3078c35b61 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.628005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d605e-e345-4dfb-93a1-ac3078c35b61 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.628281 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d605e-e345-4dfb-93a1-ac3078c35b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.642690 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1051/2103] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:45 2022] DELETE /identity/v3/users/a3ca2d63916e4995917e116327773695 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:45.648116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908325b2-4689-4c52-be2c-f6e554b2c234 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.648405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908325b2-4689-4c52-be2c-f6e554b2c234 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.648683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908325b2-4689-4c52-be2c-f6e554b2c234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.676256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-695d605e-e345-4dfb-93a1-ac3078c35b61 None None] MFA Rules not processed for user `ce9f9e0af5364256a397988590c0be60`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:45.679455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-695d605e-e345-4dfb-93a1-ac3078c35b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:45.720928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-908325b2-4689-4c52-be2c-f6e554b2c234 None None] MFA Rules not processed for user `030db27d39fa47768254409de5e9ae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:45.722787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-908325b2-4689-4c52-be2c-f6e554b2c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:45.777637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1053/2104] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:45.790071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d605e-e345-4dfb-93a1-ac3078c35b61 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:45.791524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-695d605e-e345-4dfb-93a1-ac3078c35b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:45.800365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1052/2105] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:45.805170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908325b2-4689-4c52-be2c-f6e554b2c234 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:45.806830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-908325b2-4689-4c52-be2c-f6e554b2c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:45.868959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d605e-e345-4dfb-93a1-ac3078c35b61 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:45.874290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908325b2-4689-4c52-be2c-f6e554b2c234 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:45.876358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c370f43-30df-404e-a405-b8cf6780a8bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:45.876989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c370f43-30df-404e-a405-b8cf6780a8bb service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.877323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c370f43-30df-404e-a405-b8cf6780a8bb service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.880840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c370f43-30df-404e-a405-b8cf6780a8bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.880961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c565595-6cf9-4752-b9eb-2b1708d1c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:45.880961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565595-6cf9-4752-b9eb-2b1708d1c8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:45.881145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565595-6cf9-4752-b9eb-2b1708d1c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:45.881284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565595-6cf9-4752-b9eb-2b1708d1c8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:45.881918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c565595-6cf9-4752-b9eb-2b1708d1c8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:45.883882 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c565595-6cf9-4752-b9eb-2b1708d1c8f9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:45.887581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c370f43-30df-404e-a405-b8cf6780a8bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:45.889226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c370f43-30df-404e-a405-b8cf6780a8bb service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:45.898947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1054/2106] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:46.007964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1053/2107] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:45 2022] POST /identity/v3/projects => generated 389 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:46.010746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c370f43-30df-404e-a405-b8cf6780a8bb service nova] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.035595 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c370f43-30df-404e-a405-b8cf6780a8bb service nova] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:46.146334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb842-de70-40a4-b16d-1266b8dd960a None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.146840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb842-de70-40a4-b16d-1266b8dd960a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.147121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb842-de70-40a4-b16d-1266b8dd960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.151505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1451e3-9b03-4a13-a362-82aca1033b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:46.152216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1451e3-9b03-4a13-a362-82aca1033b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.152566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1451e3-9b03-4a13-a362-82aca1033b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.152913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1451e3-9b03-4a13-a362-82aca1033b2b admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.153633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1451e3-9b03-4a13-a362-82aca1033b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:46.155677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1451e3-9b03-4a13-a362-82aca1033b2b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:46.178905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-028bb842-de70-40a4-b16d-1266b8dd960a None None] MFA Rules not processed for user `4a7f41fb3eb649d8948d595000434759`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:46.180130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-028bb842-de70-40a4-b16d-1266b8dd960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:46.258998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1055/2108] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:46 2022] POST /identity/v3/users => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:46.259955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1451e3-9b03-4a13-a362-82aca1033b2b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.262064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2d1451e3-9b03-4a13-a362-82aca1033b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:46.278145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1451e3-9b03-4a13-a362-82aca1033b2b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:46.280822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1054/2109] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:46.284350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:46.285156 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.285286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bb842-de70-40a4-b16d-1266b8dd960a None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.285958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.285958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] PATH_INFO: `/v3/projects/c95760a660774883aac37945a9c222e3` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.287532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95760a660774883aac37945a9c222e3)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:46.291182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:46.298154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bb842-de70-40a4-b16d-1266b8dd960a None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:46.306023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21534-4689-4ff2-8262-f92464b2c713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:46.307440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21534-4689-4ff2-8262-f92464b2c713 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.307975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21534-4689-4ff2-8262-f92464b2c713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.308402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b21534-4689-4ff2-8262-f92464b2c713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.309229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b21534-4689-4ff2-8262-f92464b2c713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:46.311189 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b21534-4689-4ff2-8262-f92464b2c713 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:46.322741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1055/2110] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:46.323578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21534-4689-4ff2-8262-f92464b2c713 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.327389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c4b21534-4689-4ff2-8262-f92464b2c713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:46.341769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b21534-4689-4ff2-8262-f92464b2c713 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:46.346815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed50251-4585-48ad-92d5-83170be0c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:46.347514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed50251-4585-48ad-92d5-83170be0c097 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.347863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed50251-4585-48ad-92d5-83170be0c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.348201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed50251-4585-48ad-92d5-83170be0c097 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.349511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed50251-4585-48ad-92d5-83170be0c097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:46.351639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed50251-4585-48ad-92d5-83170be0c097 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:46.481404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95760a660774883aac37945a9c222e3', 'request_id': 'req-cf49928b-432c-4f3e-a457-8040b750781f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:46.491510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1056/2111] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:46 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:46.491510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed50251-4585-48ad-92d5-83170be0c097 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.540177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95760a660774883aac37945a9c222e3', 'request_id': 'req-cf49928b-432c-4f3e-a457-8040b750781f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:46.548096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95760a660774883aac37945a9c222e3', 'request_id': 'req-cf49928b-432c-4f3e-a457-8040b750781f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:46.553471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed50251-4585-48ad-92d5-83170be0c097 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:46.558545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5210c98-b74d-45a9-b1fd-cf27e99ea382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:46.559243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5210c98-b74d-45a9-b1fd-cf27e99ea382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.559584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5210c98-b74d-45a9-b1fd-cf27e99ea382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.559870 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5210c98-b74d-45a9-b1fd-cf27e99ea382 admin admin] PATH_INFO: `/v3/projects/7df54bbd79d74079a4827568b3c1d614/users/4727bb541929418d9903485eb9299cb6/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.560084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] The token cache is being invalidate because project c95760a660774883aac37945a9c222e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:46.560374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:46.561346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:46.563027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1056/2112] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:46 2022] DELETE /identity/v3/projects/c95760a660774883aac37945a9c222e3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:46.564186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.565103 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:46.577704 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5210c98-b74d-45a9-b1fd-cf27e99ea382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df54bbd79d74079a4827568b3c1d614, user_id=4727bb541929418d9903485eb9299cb6, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:46.582629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5210c98-b74d-45a9-b1fd-cf27e99ea382 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:46.635413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49928b-432c-4f3e-a457-8040b750781f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:46.640134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47159b0e-fc2b-4028-bcee-03eb84c46db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:46.640748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159b0e-fc2b-4028-bcee-03eb84c46db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.641029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159b0e-fc2b-4028-bcee-03eb84c46db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.641300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159b0e-fc2b-4028-bcee-03eb84c46db5 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.641931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47159b0e-fc2b-4028-bcee-03eb84c46db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:46.643886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47159b0e-fc2b-4028-bcee-03eb84c46db5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:46.673750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1057/2113] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:46 2022] PUT /identity/v3/projects/7df54bbd79d74079a4827568b3c1d614/users/4727bb541929418d9903485eb9299cb6/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:46.675079 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d344bbb-29bf-49a7-9df5-f280bfd9fdce None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.675392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d344bbb-29bf-49a7-9df5-f280bfd9fdce None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.675667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d344bbb-29bf-49a7-9df5-f280bfd9fdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.695707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-4d344bbb-29bf-49a7-9df5-f280bfd9fdce None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:46.696914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4d344bbb-29bf-49a7-9df5-f280bfd9fdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:46.759781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1057/2114] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:46 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:46.760934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47159b0e-fc2b-4028-bcee-03eb84c46db5 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.761644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1058/2115] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:46.763861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d344bbb-29bf-49a7-9df5-f280bfd9fdce None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.774086 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-47159b0e-fc2b-4028-bcee-03eb84c46db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:46.775534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d344bbb-29bf-49a7-9df5-f280bfd9fdce None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:46.781218 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0aa9fa-f9e1-4ce6-b5f0-73482ad9ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:46.781975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0aa9fa-f9e1-4ce6-b5f0-73482ad9ca17 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.782774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0aa9fa-f9e1-4ce6-b5f0-73482ad9ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.783124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0aa9fa-f9e1-4ce6-b5f0-73482ad9ca17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.784149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0aa9fa-f9e1-4ce6-b5f0-73482ad9ca17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:46.786397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0aa9fa-f9e1-4ce6-b5f0-73482ad9ca17 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:46.799077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1059/2116] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:46.800572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc91b5-63a7-4199-90bd-ce10374d09ef None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.800955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc91b5-63a7-4199-90bd-ce10374d09ef None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.801333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc91b5-63a7-4199-90bd-ce10374d09ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.814297 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47159b0e-fc2b-4028-bcee-03eb84c46db5 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:46.820994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c057d-9b7b-48f6-8348-de8234cabefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:46.821833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c057d-9b7b-48f6-8348-de8234cabefa admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.822304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c057d-9b7b-48f6-8348-de8234cabefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.822916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c057d-9b7b-48f6-8348-de8234cabefa admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.824003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c057d-9b7b-48f6-8348-de8234cabefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:46.824447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5cbc91b5-63a7-4199-90bd-ce10374d09ef None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:46.825688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5cbc91b5-63a7-4199-90bd-ce10374d09ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:46.826331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c057d-9b7b-48f6-8348-de8234cabefa admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:46.836717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1060/2117] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:46.841446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc91b5-63a7-4199-90bd-ce10374d09ef None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.850627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1058/2118] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:46.850627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c057d-9b7b-48f6-8348-de8234cabefa admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.850903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc91b5-63a7-4199-90bd-ce10374d09ef None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:46.854829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c057d-9b7b-48f6-8348-de8234cabefa admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:46.855267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1bbbf-7ecb-4dbc-a88c-5401bb181e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:46.856147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1bbbf-7ecb-4dbc-a88c-5401bb181e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.856696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1bbbf-7ecb-4dbc-a88c-5401bb181e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.857064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1bbbf-7ecb-4dbc-a88c-5401bb181e12 admin admin] PATH_INFO: `/v3/projects/aac6055aa8a04374a2689f35c1004324/users/cdba5ce2b53a46a2ab613209b2d782ff/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.860049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a28af-1549-45bb-8a19-c74665c3a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:46.860724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a28af-1549-45bb-8a19-c74665c3a407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.861017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a28af-1549-45bb-8a19-c74665c3a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.861346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a28af-1549-45bb-8a19-c74665c3a407 admin admin] PATH_INFO: `/v3/projects/7df54bbd79d74079a4827568b3c1d614/users/4727bb541929418d9903485eb9299cb6/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:46.864480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a28af-1549-45bb-8a19-c74665c3a407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df54bbd79d74079a4827568b3c1d614, user_id=4727bb541929418d9903485eb9299cb6, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:46.867451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a28af-1549-45bb-8a19-c74665c3a407 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:46.882603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1bbbf-7ecb-4dbc-a88c-5401bb181e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac6055aa8a04374a2689f35c1004324, user_id=cdba5ce2b53a46a2ab613209b2d782ff, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:46.885311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1bbbf-7ecb-4dbc-a88c-5401bb181e12 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:46.891213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1059/2119] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:46 2022] PUT /identity/v3/projects/7df54bbd79d74079a4827568b3c1d614/users/4727bb541929418d9903485eb9299cb6/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:46.892224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a28af-1549-45bb-8a19-c74665c3a407 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:46.998872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1061/2120] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:46 2022] PUT /identity/v3/projects/aac6055aa8a04374a2689f35c1004324/users/cdba5ce2b53a46a2ab613209b2d782ff/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:46.998872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb418c5-3cc3-4394-8f03-1c4e87414e86 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:46.998872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb418c5-3cc3-4394-8f03-1c4e87414e86 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:46.998872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb418c5-3cc3-4394-8f03-1c4e87414e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.002810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:47.009395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a28af-1549-45bb-8a19-c74665c3a407 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:47.039942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-cfb418c5-3cc3-4394-8f03-1c4e87414e86 None None] MFA Rules not processed for user `4727bb541929418d9903485eb9299cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:47.041279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-cfb418c5-3cc3-4394-8f03-1c4e87414e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:47.087605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f04443-c84b-45a5-a82b-d5d68a6ea92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:47.088419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f04443-c84b-45a5-a82b-d5d68a6ea92c admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.088797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f04443-c84b-45a5-a82b-d5d68a6ea92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.089176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f04443-c84b-45a5-a82b-d5d68a6ea92c admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.090014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f04443-c84b-45a5-a82b-d5d68a6ea92c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:47.090442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f04443-c84b-45a5-a82b-d5d68a6ea92c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:47.092127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f04443-c84b-45a5-a82b-d5d68a6ea92c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:47.105015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1060/2121] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:09:47.105952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f04443-c84b-45a5-a82b-d5d68a6ea92c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:47.117283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f04443-c84b-45a5-a82b-d5d68a6ea92c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:47.122668 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd688ff-65e1-49c2-a886-c178658235bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:47.123482 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd688ff-65e1-49c2-a886-c178658235bc admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.123783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd688ff-65e1-49c2-a886-c178658235bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.124066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd688ff-65e1-49c2-a886-c178658235bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.124217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1062/2122] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:47.125069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb418c5-3cc3-4394-8f03-1c4e87414e86 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:47.128428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd688ff-65e1-49c2-a886-c178658235bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:47.130270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd688ff-65e1-49c2-a886-c178658235bc admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:47.138515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb418c5-3cc3-4394-8f03-1c4e87414e86 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:47.146192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1061/2123] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:47.146192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd688ff-65e1-49c2-a886-c178658235bc admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:47.146845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0988be-492c-4318-84cb-77df0bffd2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:47.146845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0988be-492c-4318-84cb-77df0bffd2be admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.146845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0988be-492c-4318-84cb-77df0bffd2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.146845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0988be-492c-4318-84cb-77df0bffd2be admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.147191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0988be-492c-4318-84cb-77df0bffd2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:47.147273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0fd688ff-65e1-49c2-a886-c178658235bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:47.147989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0988be-492c-4318-84cb-77df0bffd2be admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:47.210176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd688ff-65e1-49c2-a886-c178658235bc admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:47.214337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8264f08-dd9c-497f-8c21-78856282ec3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:47.214952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264f08-dd9c-497f-8c21-78856282ec3e service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.215236 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264f08-dd9c-497f-8c21-78856282ec3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.215512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264f08-dd9c-497f-8c21-78856282ec3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.233895 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8264f08-dd9c-497f-8c21-78856282ec3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:47.235423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8264f08-dd9c-497f-8c21-78856282ec3e service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:47.246222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1062/2124] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:47.247121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8264f08-dd9c-497f-8c21-78856282ec3e service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:47.257509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8264f08-dd9c-497f-8c21-78856282ec3e service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:47.262942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23057de-90ea-48a2-a658-5b7fadca57c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:47.263621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23057de-90ea-48a2-a658-5b7fadca57c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.263902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23057de-90ea-48a2-a658-5b7fadca57c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.264176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23057de-90ea-48a2-a658-5b7fadca57c9 admin admin] PATH_INFO: `/v3/projects/aac6055aa8a04374a2689f35c1004324/users/cdba5ce2b53a46a2ab613209b2d782ff/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.266303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23057de-90ea-48a2-a658-5b7fadca57c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac6055aa8a04374a2689f35c1004324, user_id=cdba5ce2b53a46a2ab613209b2d782ff, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:47.268873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23057de-90ea-48a2-a658-5b7fadca57c9 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:47.279679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1063/2125] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:47 2022] PUT /identity/v3/projects/aac6055aa8a04374a2689f35c1004324/users/cdba5ce2b53a46a2ab613209b2d782ff/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:47.295127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1063/2126] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:47 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:47.299100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23057de-90ea-48a2-a658-5b7fadca57c9 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:47.377232 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23057de-90ea-48a2-a658-5b7fadca57c9 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:47.425360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0988be-492c-4318-84cb-77df0bffd2be admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:47.449947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1cc5b-df58-4add-9b7d-4bdb93365812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:47.456732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1cc5b-df58-4add-9b7d-4bdb93365812 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.456732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1cc5b-df58-4add-9b7d-4bdb93365812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.456732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1cc5b-df58-4add-9b7d-4bdb93365812 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.456732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1cc5b-df58-4add-9b7d-4bdb93365812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:47.456732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1cc5b-df58-4add-9b7d-4bdb93365812 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:47.496118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0988be-492c-4318-84cb-77df0bffd2be admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:47.501508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:47.502323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.502608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.502879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] PATH_INFO: `/v3/users/030db27d39fa47768254409de5e9ae2d` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.504213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030db27d39fa47768254409de5e9ae2d)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:47.506315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:47.602719 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1064/2127] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:47 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:47.603682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1cc5b-df58-4add-9b7d-4bdb93365812 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:47.617685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1cc5b-df58-4add-9b7d-4bdb93365812 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:47.630014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:47.630014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148821-062d-44d3-843c-2f38e97baf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:47.630014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148821-062d-44d3-843c-2f38e97baf79 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.630014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148821-062d-44d3-843c-2f38e97baf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.630671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148821-062d-44d3-843c-2f38e97baf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.630671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd148821-062d-44d3-843c-2f38e97baf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:47.632561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd148821-062d-44d3-843c-2f38e97baf79 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:47.646293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1065/2128] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:47.650404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148821-062d-44d3-843c-2f38e97baf79 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:47.675213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148821-062d-44d3-843c-2f38e97baf79 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:47.675213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befdb17-e6cf-4b54-a5ac-f418ab07e5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:47.675213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdb17-e6cf-4b54-a5ac-f418ab07e5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.675213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdb17-e6cf-4b54-a5ac-f418ab07e5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.675545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befdb17-e6cf-4b54-a5ac-f418ab07e5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.675545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befdb17-e6cf-4b54-a5ac-f418ab07e5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:47.675545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befdb17-e6cf-4b54-a5ac-f418ab07e5a3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:47.689080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1066/2129] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:47.691211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befdb17-e6cf-4b54-a5ac-f418ab07e5a3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:47.703141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befdb17-e6cf-4b54-a5ac-f418ab07e5a3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:47.708825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a91fc-d80b-4c46-b1cd-388418710615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:47.709604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a91fc-d80b-4c46-b1cd-388418710615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.710011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a91fc-d80b-4c46-b1cd-388418710615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.710329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a91fc-d80b-4c46-b1cd-388418710615 admin admin] PATH_INFO: `/v3/projects/93d6be126587438eb0f10ae40b2b79c3/users/03d5437d9ee843698573d89e3af36a0e/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.742162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a91fc-d80b-4c46-b1cd-388418710615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d6be126587438eb0f10ae40b2b79c3, user_id=03d5437d9ee843698573d89e3af36a0e, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:47.744907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a91fc-d80b-4c46-b1cd-388418710615 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:47.767530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030db27d39fa47768254409de5e9ae2d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:47.776906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030db27d39fa47768254409de5e9ae2d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:47.790220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030db27d39fa47768254409de5e9ae2d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:47.881712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030db27d39fa47768254409de5e9ae2d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:47.882133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-216e0f6f-7f6b-4982-b5e8-15a9f69e1100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030db27d39fa47768254409de5e9ae2d'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:47.888243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1067/2130] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:47 2022] PUT /identity/v3/projects/93d6be126587438eb0f10ae40b2b79c3/users/03d5437d9ee843698573d89e3af36a0e/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:47.894439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1064/2131] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:47 2022] DELETE /identity/v3/users/030db27d39fa47768254409de5e9ae2d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:47.894795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afdc8-a6ef-4008-83ce-959e9eb5c2d1 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.895179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afdc8-a6ef-4008-83ce-959e9eb5c2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.896126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afdc8-a6ef-4008-83ce-959e9eb5c2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.900679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec26ce-ddfc-49fa-ad09-a1e344aadeb6 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:47.901017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec26ce-ddfc-49fa-ad09-a1e344aadeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:47.901238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec26ce-ddfc-49fa-ad09-a1e344aadeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:47.919270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-0c2afdc8-a6ef-4008-83ce-959e9eb5c2d1 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:47.920626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0c2afdc8-a6ef-4008-83ce-959e9eb5c2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:47.932943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2cec26ce-ddfc-49fa-ad09-a1e344aadeb6 None None] MFA Rules not processed for user `03d5437d9ee843698573d89e3af36a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:47.934168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2cec26ce-ddfc-49fa-ad09-a1e344aadeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:48.010199 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1068/2132] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:48.022060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2afdc8-a6ef-4008-83ce-959e9eb5c2d1 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:48.024107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0c2afdc8-a6ef-4008-83ce-959e9eb5c2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:48.040057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1065/2133] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:48.046768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec26ce-ddfc-49fa-ad09-a1e344aadeb6 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:48.048403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2cec26ce-ddfc-49fa-ad09-a1e344aadeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:48.066977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec26ce-ddfc-49fa-ad09-a1e344aadeb6 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:48.078458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2980b9-0468-4116-b11c-ad2fa8615fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:48.078458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2980b9-0468-4116-b11c-ad2fa8615fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:48.078458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2980b9-0468-4116-b11c-ad2fa8615fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:48.078458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2980b9-0468-4116-b11c-ad2fa8615fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:48.078763 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2980b9-0468-4116-b11c-ad2fa8615fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:48.086682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2980b9-0468-4116-b11c-ad2fa8615fd4 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:48.106961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2afdc8-a6ef-4008-83ce-959e9eb5c2d1 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:48.111977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc6661-be42-4164-a33a-2e771cee7d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:48.112689 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc6661-be42-4164-a33a-2e771cee7d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:48.113041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc6661-be42-4164-a33a-2e771cee7d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:48.113392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc6661-be42-4164-a33a-2e771cee7d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:48.123569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc6661-be42-4164-a33a-2e771cee7d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:48.124994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc6661-be42-4164-a33a-2e771cee7d06 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:48.137293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1069/2134] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:48.231225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1066/2135] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:48 2022] POST /identity/v3/projects => generated 363 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:48.232690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc6661-be42-4164-a33a-2e771cee7d06 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:48.245349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc6661-be42-4164-a33a-2e771cee7d06 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:48.309913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952023e-ede5-4604-b55e-af7b83549c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:48.310568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952023e-ede5-4604-b55e-af7b83549c54 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:48.310857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952023e-ede5-4604-b55e-af7b83549c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:48.311392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952023e-ede5-4604-b55e-af7b83549c54 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:48.312834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952023e-ede5-4604-b55e-af7b83549c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:48.314185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952023e-ede5-4604-b55e-af7b83549c54 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:48.432804 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1070/2136] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:48 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:48.436966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2980b9-0468-4116-b11c-ad2fa8615fd4 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:48.448028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2980b9-0468-4116-b11c-ad2fa8615fd4 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:48.453240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc8db3-0198-4724-a2de-bf5c8f6dc8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:48.458721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc8db3-0198-4724-a2de-bf5c8f6dc8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:48.458721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc8db3-0198-4724-a2de-bf5c8f6dc8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:48.458721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc8db3-0198-4724-a2de-bf5c8f6dc8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:48.458721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc8db3-0198-4724-a2de-bf5c8f6dc8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:48.458721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc8db3-0198-4724-a2de-bf5c8f6dc8cf admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:48.471616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1067/2137] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:48.472779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952023e-ede5-4604-b55e-af7b83549c54 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:48.483118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952023e-ede5-4604-b55e-af7b83549c54 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:48.487902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c55244-2f1f-4152-a248-b58ace40118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:48.488570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c55244-2f1f-4152-a248-b58ace40118e admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:48.489362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c55244-2f1f-4152-a248-b58ace40118e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:48.489665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c55244-2f1f-4152-a248-b58ace40118e admin admin] PATH_INFO: `/v3/projects/021d0baffbca46ab96140c1a4229e9b9/users/5802e704d6554f778f46432f7ac35205/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:48.506025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c55244-2f1f-4152-a248-b58ace40118e admin admin] RBAC: Authorizing `identity:create_grant(project_id=021d0baffbca46ab96140c1a4229e9b9, user_id=5802e704d6554f778f46432f7ac35205, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:48.508820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c55244-2f1f-4152-a248-b58ace40118e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:48.592122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1071/2138] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:48 2022] PUT /identity/v3/projects/021d0baffbca46ab96140c1a4229e9b9/users/5802e704d6554f778f46432f7ac35205/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:48.596637 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc8db3-0198-4724-a2de-bf5c8f6dc8cf admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:48.607440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc8db3-0198-4724-a2de-bf5c8f6dc8cf admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:48.682011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a93ed-40da-470c-bd8f-0fdf0d7fface admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:48.683776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a93ed-40da-470c-bd8f-0fdf0d7fface admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:48.683776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a93ed-40da-470c-bd8f-0fdf0d7fface admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:48.683776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a93ed-40da-470c-bd8f-0fdf0d7fface admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:48.684186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a93ed-40da-470c-bd8f-0fdf0d7fface admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:48.686510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c55244-2f1f-4152-a248-b58ace40118e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:48.687413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a93ed-40da-470c-bd8f-0fdf0d7fface admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:48.691734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-97c55244-2f1f-4152-a248-b58ace40118e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:48.704385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1068/2139] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:48.706257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a93ed-40da-470c-bd8f-0fdf0d7fface admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:48.710013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c55244-2f1f-4152-a248-b58ace40118e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:48.719142 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a93ed-40da-470c-bd8f-0fdf0d7fface admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:48.720939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:48.724608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:48.726625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f1b03-bf74-432d-8938-bcb3c2170371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:48.727061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:48.727061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] PATH_INFO: `/v3/projects/56cd152cf75447a390553631ed2c7844` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:48.727314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f1b03-bf74-432d-8938-bcb3c2170371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:48.727314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f1b03-bf74-432d-8938-bcb3c2170371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:48.727314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f1b03-bf74-432d-8938-bcb3c2170371 admin admin] PATH_INFO: `/v3/projects/021d0baffbca46ab96140c1a4229e9b9/users/5802e704d6554f778f46432f7ac35205/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:48.727670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cd152cf75447a390553631ed2c7844)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:48.729698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f1b03-bf74-432d-8938-bcb3c2170371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021d0baffbca46ab96140c1a4229e9b9, user_id=5802e704d6554f778f46432f7ac35205, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:48.730068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:48.732818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f1b03-bf74-432d-8938-bcb3c2170371 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:48.762531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1069/2140] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:48 2022] PUT /identity/v3/projects/021d0baffbca46ab96140c1a4229e9b9/users/5802e704d6554f778f46432f7ac35205/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:48.767470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208b680-5f24-40bc-b6ca-bb7e4a6d9249 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:48.767858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208b680-5f24-40bc-b6ca-bb7e4a6d9249 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:48.772919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208b680-5f24-40bc-b6ca-bb7e4a6d9249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:48.799920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6208b680-5f24-40bc-b6ca-bb7e4a6d9249 None None] MFA Rules not processed for user `5802e704d6554f778f46432f7ac35205`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:48.801230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6208b680-5f24-40bc-b6ca-bb7e4a6d9249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:48.898128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cd152cf75447a390553631ed2c7844', 'request_id': 'req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:48.901252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1070/2141] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:09:48.914503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208b680-5f24-40bc-b6ca-bb7e4a6d9249 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:48.915911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6208b680-5f24-40bc-b6ca-bb7e4a6d9249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:48.982123 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208b680-5f24-40bc-b6ca-bb7e4a6d9249 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:49.039331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc274763-1c13-47cc-8c46-25776e89ffaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:49.039967 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc274763-1c13-47cc-8c46-25776e89ffaf service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:49.040246 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc274763-1c13-47cc-8c46-25776e89ffaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:49.040518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc274763-1c13-47cc-8c46-25776e89ffaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:49.051506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cd152cf75447a390553631ed2c7844', 'request_id': 'req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:49.060114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cd152cf75447a390553631ed2c7844', 'request_id': 'req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:49.089386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] The token cache is being invalidate because project 56cd152cf75447a390553631ed2c7844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:49.089689 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:49.091904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e8803dee-cd72-4647-92f3-b4dd2c6d3a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:49.095126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1072/2142] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:48 2022] DELETE /identity/v3/projects/56cd152cf75447a390553631ed2c7844 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:49.095126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65e5d-dd07-44f6-872e-2857fd0e5daa None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:49.095126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65e5d-dd07-44f6-872e-2857fd0e5daa None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:49.095126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be65e5d-dd07-44f6-872e-2857fd0e5daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:49.117052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc274763-1c13-47cc-8c46-25776e89ffaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:49.118451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc274763-1c13-47cc-8c46-25776e89ffaf service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:49.125669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-8be65e5d-dd07-44f6-872e-2857fd0e5daa None None] MFA Rules not processed for user `cdba5ce2b53a46a2ab613209b2d782ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:49.127565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8be65e5d-dd07-44f6-872e-2857fd0e5daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:49.128387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1071/2143] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:49.129540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc274763-1c13-47cc-8c46-25776e89ffaf service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:49.214854 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1073/2144] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:49.220176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc274763-1c13-47cc-8c46-25776e89ffaf service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:49.226752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d253-42df-4818-b6b7-3b4d4e857467 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:49.227063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d253-42df-4818-b6b7-3b4d4e857467 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:49.227321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d253-42df-4818-b6b7-3b4d4e857467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:49.228798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:49.229749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:49.230287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:49.230764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] PATH_INFO: `/v3/users/4727bb541929418d9903485eb9299cb6` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:49.232197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4727bb541929418d9903485eb9299cb6)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:49.234394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:49.253021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-24c2d253-42df-4818-b6b7-3b4d4e857467 None None] MFA Rules not processed for user `4a7f41fb3eb649d8948d595000434759`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:49.254333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-24c2d253-42df-4818-b6b7-3b4d4e857467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:49.320777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1074/2145] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:49.331288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2d253-42df-4818-b6b7-3b4d4e857467 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:49.332635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-24c2d253-42df-4818-b6b7-3b4d4e857467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:49.405450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2d253-42df-4818-b6b7-3b4d4e857467 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:49.413070 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba7b2b-1a37-48bc-8909-d33afa03d77b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:49.413741 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba7b2b-1a37-48bc-8909-d33afa03d77b service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:49.414020 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba7b2b-1a37-48bc-8909-d33afa03d77b service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:49.414321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba7b2b-1a37-48bc-8909-d33afa03d77b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:49.416220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f0ba7b2b-1a37-48bc-8909-d33afa03d77b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:49.426971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba7b2b-1a37-48bc-8909-d33afa03d77b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:49.428648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba7b2b-1a37-48bc-8909-d33afa03d77b service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:49.437665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1075/2146] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:49.438413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba7b2b-1a37-48bc-8909-d33afa03d77b service nova] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:49.439627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f0ba7b2b-1a37-48bc-8909-d33afa03d77b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:49.451875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba7b2b-1a37-48bc-8909-d33afa03d77b service nova] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:49.455755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38442ef4-5f80-4cfa-8fb5-781c7e1bedaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:49.456355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38442ef4-5f80-4cfa-8fb5-781c7e1bedaa service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:49.456636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38442ef4-5f80-4cfa-8fb5-781c7e1bedaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:49.457565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38442ef4-5f80-4cfa-8fb5-781c7e1bedaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:49.459563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-38442ef4-5f80-4cfa-8fb5-781c7e1bedaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:49.524588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38442ef4-5f80-4cfa-8fb5-781c7e1bedaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:49.526174 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38442ef4-5f80-4cfa-8fb5-781c7e1bedaa service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:49.536166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1076/2147] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:49.580531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4727bb541929418d9903485eb9299cb6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:49.591140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4727bb541929418d9903485eb9299cb6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:49.610678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4727bb541929418d9903485eb9299cb6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:49.705375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4727bb541929418d9903485eb9299cb6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:49.706073 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1811081d-fe1e-4b39-bba6-78828db48d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4727bb541929418d9903485eb9299cb6'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:49.714068 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1072/2148] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:49 2022] DELETE /identity/v3/users/4727bb541929418d9903485eb9299cb6 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:49.734504 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:50.220169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38442ef4-5f80-4cfa-8fb5-781c7e1bedaa service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:50.221878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-38442ef4-5f80-4cfa-8fb5-781c7e1bedaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:50.246092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:50.262973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38442ef4-5f80-4cfa-8fb5-781c7e1bedaa service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:50.355731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:50.357896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:50.357896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:50.357896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] PATH_INFO: `/v3/projects/7df54bbd79d74079a4827568b3c1d614` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:50.358420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7df54bbd79d74079a4827568b3c1d614)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:50.360173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:50.511386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df54bbd79d74079a4827568b3c1d614', 'request_id': 'req-338031a3-e1e2-4ecb-af4e-c57da7b53254'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:50.597461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df54bbd79d74079a4827568b3c1d614', 'request_id': 'req-338031a3-e1e2-4ecb-af4e-c57da7b53254'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:50.605068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df54bbd79d74079a4827568b3c1d614', 'request_id': 'req-338031a3-e1e2-4ecb-af4e-c57da7b53254'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:50.621379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] The token cache is being invalidate because project 7df54bbd79d74079a4827568b3c1d614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:50.623247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:50.623247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:50.624342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1077/2149] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:50 2022] DELETE /identity/v3/projects/7df54bbd79d74079a4827568b3c1d614 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:50.629404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657cec8-4d22-4d32-a24e-42fcd812224d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:50.630089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657cec8-4d22-4d32-a24e-42fcd812224d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:50.630089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657cec8-4d22-4d32-a24e-42fcd812224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:50.650640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-f657cec8-4d22-4d32-a24e-42fcd812224d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:50.651930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f657cec8-4d22-4d32-a24e-42fcd812224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:50.685667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:50.685667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:50.731752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1073/2150] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:50.740532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a9d5c-b6e2-4a9f-8050-ec004bb72cd8 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:50.740910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a9d5c-b6e2-4a9f-8050-ec004bb72cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:50.741598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a9d5c-b6e2-4a9f-8050-ec004bb72cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:50.759939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338031a3-e1e2-4ecb-af4e-c57da7b53254 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:50.763754 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-554a9d5c-b6e2-4a9f-8050-ec004bb72cd8 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:50.765025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:50.765168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-554a9d5c-b6e2-4a9f-8050-ec004bb72cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:50.765954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:50.766367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:50.766875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] PATH_INFO: `/v3/users/ce9f9e0af5364256a397988590c0be60` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:50.768272 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9f9e0af5364256a397988590c0be60)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:50.771669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:50.775121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1074/2151] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:50.782371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a9d5c-b6e2-4a9f-8050-ec004bb72cd8 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:50.789972 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a9d5c-b6e2-4a9f-8050-ec004bb72cd8 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:50.797043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44123827-b98e-459f-b82b-8f42ea4d868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:50.798013 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123827-b98e-459f-b82b-8f42ea4d868e admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:50.798511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123827-b98e-459f-b82b-8f42ea4d868e admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:50.798885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123827-b98e-459f-b82b-8f42ea4d868e admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:50.799735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44123827-b98e-459f-b82b-8f42ea4d868e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:50.800208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44123827-b98e-459f-b82b-8f42ea4d868e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:50.802066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44123827-b98e-459f-b82b-8f42ea4d868e admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:50.818284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1075/2152] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:09:50.822005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44123827-b98e-459f-b82b-8f42ea4d868e admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:50.831714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44123827-b98e-459f-b82b-8f42ea4d868e admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:50.837135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c0cdb-e43c-462b-b4e4-a83c0eb8976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:50.837718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c0cdb-e43c-462b-b4e4-a83c0eb8976d admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:50.837998 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c0cdb-e43c-462b-b4e4-a83c0eb8976d admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:50.838309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c0cdb-e43c-462b-b4e4-a83c0eb8976d admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:50.838935 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c0cdb-e43c-462b-b4e4-a83c0eb8976d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:50.840832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c0cdb-e43c-462b-b4e4-a83c0eb8976d admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:51.002181 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1076/2153] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:50 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:51.006119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c0cdb-e43c-462b-b4e4-a83c0eb8976d admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:51.041201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9f9e0af5364256a397988590c0be60'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:51.042302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9f9e0af5364256a397988590c0be60'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:51.048783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9f9e0af5364256a397988590c0be60'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:51.065320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9f9e0af5364256a397988590c0be60'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:51.066304 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-478b04a4-e187-468b-98d9-fcf6fba06605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9f9e0af5364256a397988590c0be60'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:51.075133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c0cdb-e43c-462b-b4e4-a83c0eb8976d admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:51.080080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66433a-89e3-44f4-82e8-f8fd44d35aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:51.080713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66433a-89e3-44f4-82e8-f8fd44d35aec admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:51.080963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66433a-89e3-44f4-82e8-f8fd44d35aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:51.081234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66433a-89e3-44f4-82e8-f8fd44d35aec admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:51.081877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66433a-89e3-44f4-82e8-f8fd44d35aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:51.084015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66433a-89e3-44f4-82e8-f8fd44d35aec admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:51.244228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1078/2154] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:50 2022] DELETE /identity/v3/users/ce9f9e0af5364256a397988590c0be60 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:51.251905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd333b5-e602-41c7-883b-f0c4fcfd7b61 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:51.252443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd333b5-e602-41c7-883b-f0c4fcfd7b61 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:51.252912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd333b5-e602-41c7-883b-f0c4fcfd7b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:51.277656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-bfd333b5-e602-41c7-883b-f0c4fcfd7b61 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:51.279443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-bfd333b5-e602-41c7-883b-f0c4fcfd7b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:51.308248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1077/2155] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:51 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:51.314873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66433a-89e3-44f4-82e8-f8fd44d35aec admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:51.317552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1f66433a-89e3-44f4-82e8-f8fd44d35aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:51.354658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66433a-89e3-44f4-82e8-f8fd44d35aec admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:51.427873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1079/2156] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:51.437835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd333b5-e602-41c7-883b-f0c4fcfd7b61 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:51.440705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-bfd333b5-e602-41c7-883b-f0c4fcfd7b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:51.460906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b25139-b58d-4398-aa11-9ebed6d640dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:51.461524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b25139-b58d-4398-aa11-9ebed6d640dd admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:51.461817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b25139-b58d-4398-aa11-9ebed6d640dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:51.462073 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b25139-b58d-4398-aa11-9ebed6d640dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:51.462751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b25139-b58d-4398-aa11-9ebed6d640dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:51.464361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b25139-b58d-4398-aa11-9ebed6d640dd admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:51.474241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1078/2157] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:51.478299 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b25139-b58d-4398-aa11-9ebed6d640dd admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:51.488011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b25139-b58d-4398-aa11-9ebed6d640dd admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:51.493564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fb95a-5a17-456f-b0ed-6c504a4cb8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:51.494279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fb95a-5a17-456f-b0ed-6c504a4cb8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:51.494537 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fb95a-5a17-456f-b0ed-6c504a4cb8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:51.494820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fb95a-5a17-456f-b0ed-6c504a4cb8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:51.495461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fb95a-5a17-456f-b0ed-6c504a4cb8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:51.497069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fb95a-5a17-456f-b0ed-6c504a4cb8b1 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:51.507826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd333b5-e602-41c7-883b-f0c4fcfd7b61 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:51.508450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1079/2158] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:51.512665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fb95a-5a17-456f-b0ed-6c504a4cb8b1 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:51.514443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5062c3d-e2b8-4d04-b00c-52d0b8c0e1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:51.521758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5062c3d-e2b8-4d04-b00c-52d0b8c0e1bb service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:51.521758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5062c3d-e2b8-4d04-b00c-52d0b8c0e1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:51.521758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5062c3d-e2b8-4d04-b00c-52d0b8c0e1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:51.522541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fb95a-5a17-456f-b0ed-6c504a4cb8b1 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:51.524932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5062c3d-e2b8-4d04-b00c-52d0b8c0e1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:51.526462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5062c3d-e2b8-4d04-b00c-52d0b8c0e1bb service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:51.527366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09e2fd-0b3f-4e04-b65a-ccf49b22c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:51.528106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09e2fd-0b3f-4e04-b65a-ccf49b22c358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:51.528383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09e2fd-0b3f-4e04-b65a-ccf49b22c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:51.528809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09e2fd-0b3f-4e04-b65a-ccf49b22c358 admin admin] PATH_INFO: `/v3/projects/a269997cf5bb4d2b95d96b8286ac7fbb/users/e22e621f00254449b13c9bda8bf70253/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:51.538265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1080/2159] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:51.550901 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09e2fd-0b3f-4e04-b65a-ccf49b22c358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a269997cf5bb4d2b95d96b8286ac7fbb, user_id=e22e621f00254449b13c9bda8bf70253, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:51.554345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09e2fd-0b3f-4e04-b65a-ccf49b22c358 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:51.603815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:51.720124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1080/2160] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:51 2022] PUT /identity/v3/projects/a269997cf5bb4d2b95d96b8286ac7fbb/users/e22e621f00254449b13c9bda8bf70253/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:51.735706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239083-6c8f-468a-adac-9c3b8cabfaf8 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:51.736205 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239083-6c8f-468a-adac-9c3b8cabfaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:51.736554 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239083-6c8f-468a-adac-9c3b8cabfaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:51.792733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-34239083-6c8f-468a-adac-9c3b8cabfaf8 None None] MFA Rules not processed for user `e22e621f00254449b13c9bda8bf70253`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:51.793970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-34239083-6c8f-468a-adac-9c3b8cabfaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:51.870572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1081/2161] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:51.872918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09e2fd-0b3f-4e04-b65a-ccf49b22c358 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:51.938418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09e2fd-0b3f-4e04-b65a-ccf49b22c358 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:51.943653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e46bb-efd6-4ccd-896a-2533f8ba511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:51.944252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e46bb-efd6-4ccd-896a-2533f8ba511e admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:51.944527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e46bb-efd6-4ccd-896a-2533f8ba511e admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:51.944794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e46bb-efd6-4ccd-896a-2533f8ba511e admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:51.945421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e46bb-efd6-4ccd-896a-2533f8ba511e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:51.947351 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e46bb-efd6-4ccd-896a-2533f8ba511e admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:52.057734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239083-6c8f-468a-adac-9c3b8cabfaf8 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.059158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1081/2162] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:51 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:52.065174 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-34239083-6c8f-468a-adac-9c3b8cabfaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:52.071924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e46bb-efd6-4ccd-896a-2533f8ba511e admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.076090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239083-6c8f-468a-adac-9c3b8cabfaf8 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.144721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e46bb-efd6-4ccd-896a-2533f8ba511e admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.145686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.146266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.146646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.146995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] PATH_INFO: `/v3/projects/46237dbccc4c47a89db3741f48cbc2d6` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.148245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46237dbccc4c47a89db3741f48cbc2d6)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:52.150103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2047cd0-95ef-4609-8a6e-91d1fabfadbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.150464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:52.150856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2047cd0-95ef-4609-8a6e-91d1fabfadbe admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.151205 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2047cd0-95ef-4609-8a6e-91d1fabfadbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.151551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2047cd0-95ef-4609-8a6e-91d1fabfadbe admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.152440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2047cd0-95ef-4609-8a6e-91d1fabfadbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:52.154361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2047cd0-95ef-4609-8a6e-91d1fabfadbe admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:52.172762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:52.280473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1082/2163] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:52 2022] POST /identity/v3/users => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:52.284423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2047cd0-95ef-4609-8a6e-91d1fabfadbe admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.290967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46237dbccc4c47a89db3741f48cbc2d6', 'request_id': 'req-9800baeb-a034-4c0f-a921-833dc33498a5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:52.297152 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2047cd0-95ef-4609-8a6e-91d1fabfadbe admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.362614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe827d-39a7-4cd7-b7ab-295b6b466fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.363181 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe827d-39a7-4cd7-b7ab-295b6b466fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.363505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe827d-39a7-4cd7-b7ab-295b6b466fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.363778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe827d-39a7-4cd7-b7ab-295b6b466fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.365003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe827d-39a7-4cd7-b7ab-295b6b466fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:52.366746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe827d-39a7-4cd7-b7ab-295b6b466fd3 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:52.381860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1083/2164] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:52.382696 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe827d-39a7-4cd7-b7ab-295b6b466fd3 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.389085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46237dbccc4c47a89db3741f48cbc2d6', 'request_id': 'req-9800baeb-a034-4c0f-a921-833dc33498a5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:52.392926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe827d-39a7-4cd7-b7ab-295b6b466fd3 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.398040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46237dbccc4c47a89db3741f48cbc2d6', 'request_id': 'req-9800baeb-a034-4c0f-a921-833dc33498a5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:52.399299 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc0e6a-842e-499f-b51d-d2e9d6df6616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.400129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc0e6a-842e-499f-b51d-d2e9d6df6616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.400461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc0e6a-842e-499f-b51d-d2e9d6df6616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.400748 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc0e6a-842e-499f-b51d-d2e9d6df6616 admin admin] PATH_INFO: `/v3/projects/4f7330db41b34dd3b429bfc4e842a8da/users/f443405f66b042ec9417ad299b33ca33/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.413044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] The token cache is being invalidate because project 46237dbccc4c47a89db3741f48cbc2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:09:52.413302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:52.414187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9800baeb-a034-4c0f-a921-833dc33498a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:52.415806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1082/2165] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:09:52 2022] DELETE /identity/v3/projects/46237dbccc4c47a89db3741f48cbc2d6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:52.417517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc0e6a-842e-499f-b51d-d2e9d6df6616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7330db41b34dd3b429bfc4e842a8da, user_id=f443405f66b042ec9417ad299b33ca33, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:52.421101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc0e6a-842e-499f-b51d-d2e9d6df6616 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:52.423229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494b0d-8fa5-4dee-9996-f245ab607a9e None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.423700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494b0d-8fa5-4dee-9996-f245ab607a9e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.423994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494b0d-8fa5-4dee-9996-f245ab607a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.449003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-47494b0d-8fa5-4dee-9996-f245ab607a9e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:52.450268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-47494b0d-8fa5-4dee-9996-f245ab607a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:52.474007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1083/2166] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:52.475559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5b1bb-5df2-4464-9d6b-b1f8885e6839 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.475849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5b1bb-5df2-4464-9d6b-b1f8885e6839 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.476130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5b1bb-5df2-4464-9d6b-b1f8885e6839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.508115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6ac5b1bb-5df2-4464-9d6b-b1f8885e6839 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:52.509597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6ac5b1bb-5df2-4464-9d6b-b1f8885e6839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:52.519184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1084/2167] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:52.525300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5b1bb-5df2-4464-9d6b-b1f8885e6839 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.536721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5b1bb-5df2-4464-9d6b-b1f8885e6839 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.541609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538f90c-03e9-41e0-8d55-b2bb3091009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.542495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538f90c-03e9-41e0-8d55-b2bb3091009d admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.542909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538f90c-03e9-41e0-8d55-b2bb3091009d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.543193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538f90c-03e9-41e0-8d55-b2bb3091009d admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.543888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538f90c-03e9-41e0-8d55-b2bb3091009d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:09:52.544196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538f90c-03e9-41e0-8d55-b2bb3091009d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:52.545786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538f90c-03e9-41e0-8d55-b2bb3091009d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:52.565483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1085/2168] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:09:52.571983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538f90c-03e9-41e0-8d55-b2bb3091009d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.584222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538f90c-03e9-41e0-8d55-b2bb3091009d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.589461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87a871-f2af-4b63-8912-61edbab7b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.590087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87a871-f2af-4b63-8912-61edbab7b202 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.590413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87a871-f2af-4b63-8912-61edbab7b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.590696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87a871-f2af-4b63-8912-61edbab7b202 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.591329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87a871-f2af-4b63-8912-61edbab7b202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:52.593290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87a871-f2af-4b63-8912-61edbab7b202 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:52.611686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1084/2169] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:52 2022] PUT /identity/v3/projects/4f7330db41b34dd3b429bfc4e842a8da/users/f443405f66b042ec9417ad299b33ca33/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:52.615895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc0e6a-842e-499f-b51d-d2e9d6df6616 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.617493 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4ebc0e6a-842e-499f-b51d-d2e9d6df6616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:52.684021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc0e6a-842e-499f-b51d-d2e9d6df6616 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.689303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce39f18-52b4-4c8f-afc0-5bff69ce676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.689925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39f18-52b4-4c8f-afc0-5bff69ce676e admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.690237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39f18-52b4-4c8f-afc0-5bff69ce676e admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.690511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce39f18-52b4-4c8f-afc0-5bff69ce676e admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.691212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce39f18-52b4-4c8f-afc0-5bff69ce676e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:52.693352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce39f18-52b4-4c8f-afc0-5bff69ce676e admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:52.703363 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1085/2170] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:52.707466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce39f18-52b4-4c8f-afc0-5bff69ce676e admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.717889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce39f18-52b4-4c8f-afc0-5bff69ce676e admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.722694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15f1e0-c743-44c6-9ecc-04ecc07fc85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.723555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15f1e0-c743-44c6-9ecc-04ecc07fc85d admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.723718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15f1e0-c743-44c6-9ecc-04ecc07fc85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.724148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15f1e0-c743-44c6-9ecc-04ecc07fc85d admin admin] PATH_INFO: `/v3/projects/4f7330db41b34dd3b429bfc4e842a8da/users/f443405f66b042ec9417ad299b33ca33/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.726071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15f1e0-c743-44c6-9ecc-04ecc07fc85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7330db41b34dd3b429bfc4e842a8da, user_id=f443405f66b042ec9417ad299b33ca33, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:52.728749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15f1e0-c743-44c6-9ecc-04ecc07fc85d admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:52.741214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1086/2171] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:52 2022] PUT /identity/v3/projects/4f7330db41b34dd3b429bfc4e842a8da/users/f443405f66b042ec9417ad299b33ca33/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:52.751612 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380eca-8af1-4eaf-b1c4-13658f9a3893 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.752184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380eca-8af1-4eaf-b1c4-13658f9a3893 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.752468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380eca-8af1-4eaf-b1c4-13658f9a3893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.759954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1086/2172] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:52 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:52.764095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87a871-f2af-4b63-8912-61edbab7b202 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.784273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-62380eca-8af1-4eaf-b1c4-13658f9a3893 None None] MFA Rules not processed for user `f443405f66b042ec9417ad299b33ca33`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:52.785513 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-62380eca-8af1-4eaf-b1c4-13658f9a3893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:52.842707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87a871-f2af-4b63-8912-61edbab7b202 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.847948 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965ab5-4d40-4b13-9863-f8a450305b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.848847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965ab5-4d40-4b13-9863-f8a450305b8e admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.849138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965ab5-4d40-4b13-9863-f8a450305b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.849415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965ab5-4d40-4b13-9863-f8a450305b8e admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.850059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26965ab5-4d40-4b13-9863-f8a450305b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:52.852029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26965ab5-4d40-4b13-9863-f8a450305b8e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:52.862589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1087/2173] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:52.874954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380eca-8af1-4eaf-b1c4-13658f9a3893 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.882398 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-62380eca-8af1-4eaf-b1c4-13658f9a3893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:52.944795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380eca-8af1-4eaf-b1c4-13658f9a3893 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.948606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbfc42-b2ce-4982-ab71-94bae8d69bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.949227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbfc42-b2ce-4982-ab71-94bae8d69bee service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.949525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbfc42-b2ce-4982-ab71-94bae8d69bee service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.949835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbfc42-b2ce-4982-ab71-94bae8d69bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.951709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e4cbfc42-b2ce-4982-ab71-94bae8d69bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:52.966776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1087/2174] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:52 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:09:52.968114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965ab5-4d40-4b13-9863-f8a450305b8e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:52.986031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965ab5-4d40-4b13-9863-f8a450305b8e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:52.993009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308d4ba-afa4-43a2-9beb-d40d34f1120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:52.993634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308d4ba-afa4-43a2-9beb-d40d34f1120e admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:52.995715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308d4ba-afa4-43a2-9beb-d40d34f1120e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:52.995715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308d4ba-afa4-43a2-9beb-d40d34f1120e admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:52.995715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308d4ba-afa4-43a2-9beb-d40d34f1120e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:52.996986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308d4ba-afa4-43a2-9beb-d40d34f1120e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:53.014257 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1088/2175] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:53.015631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308d4ba-afa4-43a2-9beb-d40d34f1120e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:53.026889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbfc42-b2ce-4982-ab71-94bae8d69bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:53.028330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbfc42-b2ce-4982-ab71-94bae8d69bee service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:53.028443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308d4ba-afa4-43a2-9beb-d40d34f1120e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:53.033733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949b7f-9207-48bd-a5b8-140ccfcc639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:53.041343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949b7f-9207-48bd-a5b8-140ccfcc639b admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:53.041343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949b7f-9207-48bd-a5b8-140ccfcc639b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:53.041343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949b7f-9207-48bd-a5b8-140ccfcc639b admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:53.041343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18949b7f-9207-48bd-a5b8-140ccfcc639b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:53.041343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18949b7f-9207-48bd-a5b8-140ccfcc639b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:53.041940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1088/2176] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:09:53.050253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1089/2177] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:09:53.052541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbfc42-b2ce-4982-ab71-94bae8d69bee service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:53.064271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbfc42-b2ce-4982-ab71-94bae8d69bee service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:53.069364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc9d05-7cb4-4555-a45f-eb0f405a60e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:53.080063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc9d05-7cb4-4555-a45f-eb0f405a60e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:53.080063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc9d05-7cb4-4555-a45f-eb0f405a60e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:53.080063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc9d05-7cb4-4555-a45f-eb0f405a60e9 admin admin] PATH_INFO: `/v3/projects/e69fdc5dd541499bbae3b7ec57002b87/users/ecc2fd0e8138416bae0fd640103de8d2/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:53.088844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc9d05-7cb4-4555-a45f-eb0f405a60e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69fdc5dd541499bbae3b7ec57002b87, user_id=ecc2fd0e8138416bae0fd640103de8d2, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:53.091725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc9d05-7cb4-4555-a45f-eb0f405a60e9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:53.174496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1089/2178] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:53 2022] PUT /identity/v3/projects/e69fdc5dd541499bbae3b7ec57002b87/users/ecc2fd0e8138416bae0fd640103de8d2/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:53.185686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958f638-d9d1-4b8d-a29f-52b7e3e6fcba None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:53.186553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958f638-d9d1-4b8d-a29f-52b7e3e6fcba None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:53.187048 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958f638-d9d1-4b8d-a29f-52b7e3e6fcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:53.219301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e958f638-d9d1-4b8d-a29f-52b7e3e6fcba None None] MFA Rules not processed for user `ecc2fd0e8138416bae0fd640103de8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:53.220666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e958f638-d9d1-4b8d-a29f-52b7e3e6fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:53.288768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1090/2179] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:53.293799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc9d05-7cb4-4555-a45f-eb0f405a60e9 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:53.363741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc9d05-7cb4-4555-a45f-eb0f405a60e9 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:53.369180 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf840f-c784-4882-9b5a-a5a27cde9534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:53.369823 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf840f-c784-4882-9b5a-a5a27cde9534 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:53.370099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf840f-c784-4882-9b5a-a5a27cde9534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:53.370399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf840f-c784-4882-9b5a-a5a27cde9534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:53.371086 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf840f-c784-4882-9b5a-a5a27cde9534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:53.373094 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf840f-c784-4882-9b5a-a5a27cde9534 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:53.559164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1090/2180] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:09:53 2022] POST /identity/v3/projects => generated 363 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:53.564067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958f638-d9d1-4b8d-a29f-52b7e3e6fcba None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:53.577188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958f638-d9d1-4b8d-a29f-52b7e3e6fcba None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:53.753561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784be2f-8729-4864-abbc-d5c1b06c0008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:53.754281 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784be2f-8729-4864-abbc-d5c1b06c0008 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:53.754822 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784be2f-8729-4864-abbc-d5c1b06c0008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:53.755426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784be2f-8729-4864-abbc-d5c1b06c0008 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:53.756182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784be2f-8729-4864-abbc-d5c1b06c0008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:53.758285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784be2f-8729-4864-abbc-d5c1b06c0008 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:53.947563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1091/2181] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:09:53 2022] POST /identity/v3/users => generated 288 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:09:53.951571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf840f-c784-4882-9b5a-a5a27cde9534 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:53.964629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf840f-c784-4882-9b5a-a5a27cde9534 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:53.969888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c6bf4-7022-4294-b4e9-4ec4838ff975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:53.970540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c6bf4-7022-4294-b4e9-4ec4838ff975 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:53.971292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c6bf4-7022-4294-b4e9-4ec4838ff975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:53.971292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c6bf4-7022-4294-b4e9-4ec4838ff975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:53.971731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c6bf4-7022-4294-b4e9-4ec4838ff975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:53.973565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c6bf4-7022-4294-b4e9-4ec4838ff975 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:53.988297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1091/2182] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:53.989262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784be2f-8729-4864-abbc-d5c1b06c0008 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:53.999802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784be2f-8729-4864-abbc-d5c1b06c0008 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:54.005862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a435c1-a876-4539-af57-e34e0da70eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:54.007658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a435c1-a876-4539-af57-e34e0da70eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:54.008034 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a435c1-a876-4539-af57-e34e0da70eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:54.015217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a435c1-a876-4539-af57-e34e0da70eaf admin admin] PATH_INFO: `/v3/projects/f308fa1fdba14dda862a77be47e1361f/users/62d1086514174a168828a24ed3c965ee/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:54.028166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a435c1-a876-4539-af57-e34e0da70eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f308fa1fdba14dda862a77be47e1361f, user_id=62d1086514174a168828a24ed3c965ee, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:54.031058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a435c1-a876-4539-af57-e34e0da70eaf admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:54.066790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:54.157217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1092/2183] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:53 2022] PUT /identity/v3/projects/f308fa1fdba14dda862a77be47e1361f/users/62d1086514174a168828a24ed3c965ee/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:09:54.161686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c6bf4-7022-4294-b4e9-4ec4838ff975 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:54.172336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c6bf4-7022-4294-b4e9-4ec4838ff975 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:54.244024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4498dcd-d765-4d9c-83cc-c7faff5dda70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:54.244654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498dcd-d765-4d9c-83cc-c7faff5dda70 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:54.244942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498dcd-d765-4d9c-83cc-c7faff5dda70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:54.245228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498dcd-d765-4d9c-83cc-c7faff5dda70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:54.245985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4498dcd-d765-4d9c-83cc-c7faff5dda70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:54.247634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4498dcd-d765-4d9c-83cc-c7faff5dda70 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:54.259866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1092/2184] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:09:54.263543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a435c1-a876-4539-af57-e34e0da70eaf admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:54.281978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a435c1-a876-4539-af57-e34e0da70eaf admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:54.294476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2101-0956-48f1-be8d-65d9fba631fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:54.295216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2101-0956-48f1-be8d-65d9fba631fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:54.295696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2101-0956-48f1-be8d-65d9fba631fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:54.295969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2101-0956-48f1-be8d-65d9fba631fa admin admin] PATH_INFO: `/v3/projects/f308fa1fdba14dda862a77be47e1361f/users/62d1086514174a168828a24ed3c965ee/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:54.298332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b2101-0956-48f1-be8d-65d9fba631fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f308fa1fdba14dda862a77be47e1361f, user_id=62d1086514174a168828a24ed3c965ee, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:54.301233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b2101-0956-48f1-be8d-65d9fba631fa admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:54.312709 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1093/2185] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:09:54 2022] PUT /identity/v3/projects/f308fa1fdba14dda862a77be47e1361f/users/62d1086514174a168828a24ed3c965ee/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:09:54.323112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d8302-fb79-4096-9df0-206fb2e08ed7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:54.323403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d8302-fb79-4096-9df0-206fb2e08ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:54.323681 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d8302-fb79-4096-9df0-206fb2e08ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:54.359989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6d7d8302-fb79-4096-9df0-206fb2e08ed7 None None] MFA Rules not processed for user `62d1086514174a168828a24ed3c965ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:09:54.361532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6d7d8302-fb79-4096-9df0-206fb2e08ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:09:54.514243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1093/2186] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:09:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:09:54.599918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2101-0956-48f1-be8d-65d9fba631fa admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:54.662975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2101-0956-48f1-be8d-65d9fba631fa admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:54.667004 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b389941-063e-4847-820d-08369a32400a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:54.667628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b389941-063e-4847-820d-08369a32400a service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:54.667906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b389941-063e-4847-820d-08369a32400a service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:54.668181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b389941-063e-4847-820d-08369a32400a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:54.678844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b389941-063e-4847-820d-08369a32400a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:54.682036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b389941-063e-4847-820d-08369a32400a service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:54.690915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1094/2187] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:55.250531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d8302-fb79-4096-9df0-206fb2e08ed7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:55.261428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d8302-fb79-4096-9df0-206fb2e08ed7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:55.266330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c80bb-4af5-4a04-b53c-bf47d7f88885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:55.266330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c80bb-4af5-4a04-b53c-bf47d7f88885 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:55.266330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c80bb-4af5-4a04-b53c-bf47d7f88885 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:55.266604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c80bb-4af5-4a04-b53c-bf47d7f88885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:55.334347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c80bb-4af5-4a04-b53c-bf47d7f88885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:55.335796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c80bb-4af5-4a04-b53c-bf47d7f88885 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:55.344944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1094/2188] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:09:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:09:55.664093 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:56.063597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:57.957282 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:58.111311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:59.163456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:09:59.593263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b389941-063e-4847-820d-08369a32400a service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:09:59.667561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b389941-063e-4847-820d-08369a32400a service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:09:59.671983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:09:59.672664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:09:59.672981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:09:59.674696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] PATH_INFO: `/v3/users/ecc2fd0e8138416bae0fd640103de8d2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:09:59.679197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc2fd0e8138416bae0fd640103de8d2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:09:59.679197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:09:59.940479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc2fd0e8138416bae0fd640103de8d2'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:59.941131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc2fd0e8138416bae0fd640103de8d2'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:59.948443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc2fd0e8138416bae0fd640103de8d2'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:59.961738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc2fd0e8138416bae0fd640103de8d2'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:09:59.962479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc2fd0e8138416bae0fd640103de8d2'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:00.088393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1095/2189] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:09:59 2022] DELETE /identity/v3/users/ecc2fd0e8138416bae0fd640103de8d2 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:00.093096 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda741f-0a4f-482a-87a8-34f9a84a90e6 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:00.093383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda741f-0a4f-482a-87a8-34f9a84a90e6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:00.093665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda741f-0a4f-482a-87a8-34f9a84a90e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:00.113064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-beda741f-0a4f-482a-87a8-34f9a84a90e6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:00.115260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-beda741f-0a4f-482a-87a8-34f9a84a90e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:00.180268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1095/2190] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:00.190636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:00.192387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:00.264468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:00.275113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912a894-e02d-4d17-85ee-1a6b4a1368d7 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:00.278807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfe1dd-96fc-464e-964d-74b65705feaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:00.279420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe1dd-96fc-464e-964d-74b65705feaa service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:00.279731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe1dd-96fc-464e-964d-74b65705feaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:00.280010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe1dd-96fc-464e-964d-74b65705feaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:00.300421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfe1dd-96fc-464e-964d-74b65705feaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:00.300421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfe1dd-96fc-464e-964d-74b65705feaa service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:00.309607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1096/2191] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:00.820709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda741f-0a4f-482a-87a8-34f9a84a90e6 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:00.820709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-beda741f-0a4f-482a-87a8-34f9a84a90e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:00.831957 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda741f-0a4f-482a-87a8-34f9a84a90e6 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:00.837637 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:00.838395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:00.838677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:00.838974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] PATH_INFO: `/v3/projects/e69fdc5dd541499bbae3b7ec57002b87` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:00.840257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e69fdc5dd541499bbae3b7ec57002b87)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:00.842278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:01.013092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfe1dd-96fc-464e-964d-74b65705feaa service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:01.015154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-88dfe1dd-96fc-464e-964d-74b65705feaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:01.022909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e69fdc5dd541499bbae3b7ec57002b87', 'request_id': 'req-92ce2916-9762-4527-90bd-978ddab20c40'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.029725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e69fdc5dd541499bbae3b7ec57002b87', 'request_id': 'req-92ce2916-9762-4527-90bd-978ddab20c40'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.035926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e69fdc5dd541499bbae3b7ec57002b87', 'request_id': 'req-92ce2916-9762-4527-90bd-978ddab20c40'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.036099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfe1dd-96fc-464e-964d-74b65705feaa service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:01.118973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:01.119465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:01.119872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:01.120006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] PATH_INFO: `/v3/users/8ce78be649864366be87392ea99c6c5d` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:01.121139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce78be649864366be87392ea99c6c5d)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:01.123173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:01.172420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] The token cache is being invalidate because project e69fdc5dd541499bbae3b7ec57002b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:01.172719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.173465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.175345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1096/2192] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:00 2022] DELETE /identity/v3/projects/e69fdc5dd541499bbae3b7ec57002b87 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:01.179578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:01.181070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:01.194910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce2916-9762-4527-90bd-978ddab20c40 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:01.199627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:01.200255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:01.200549 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:01.200823 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] PATH_INFO: `/v3/users/62d1086514174a168828a24ed3c965ee` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:01.201967 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d1086514174a168828a24ed3c965ee)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:01.203926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:01.382628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce78be649864366be87392ea99c6c5d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.383317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce78be649864366be87392ea99c6c5d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.390855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce78be649864366be87392ea99c6c5d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.403080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce78be649864366be87392ea99c6c5d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.403806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-99e00aa4-281a-4a3b-9238-5bd238425163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce78be649864366be87392ea99c6c5d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.543334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d1086514174a168828a24ed3c965ee'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.550584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d1086514174a168828a24ed3c965ee'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.563449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d1086514174a168828a24ed3c965ee'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.621593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1097/2193] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:01 2022] DELETE /identity/v3/users/8ce78be649864366be87392ea99c6c5d => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:01.625872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d444032-a518-4162-a9ef-36e7dffe8399 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:01.626161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d444032-a518-4162-a9ef-36e7dffe8399 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:01.626493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d444032-a518-4162-a9ef-36e7dffe8399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:01.646976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6d444032-a518-4162-a9ef-36e7dffe8399 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:01.648257 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6d444032-a518-4162-a9ef-36e7dffe8399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:01.711018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1098/2194] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:01.720731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d444032-a518-4162-a9ef-36e7dffe8399 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:01.722117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6d444032-a518-4162-a9ef-36e7dffe8399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:01.731897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d1086514174a168828a24ed3c965ee'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.734031 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d1086514174a168828a24ed3c965ee'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:01.751929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1097/2195] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:01 2022] DELETE /identity/v3/users/62d1086514174a168828a24ed3c965ee => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:01.805151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d444032-a518-4162-a9ef-36e7dffe8399 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:01.850165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:01.857291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1cdb-6448-45f0-b3fd-4c5db786162f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:01.857921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1cdb-6448-45f0-b3fd-4c5db786162f service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:01.858285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1cdb-6448-45f0-b3fd-4c5db786162f service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:01.858811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1cdb-6448-45f0-b3fd-4c5db786162f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:01.860571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-140f1cdb-6448-45f0-b3fd-4c5db786162f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:01.931667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f1cdb-6448-45f0-b3fd-4c5db786162f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:01.933143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f1cdb-6448-45f0-b3fd-4c5db786162f service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:01.945018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1099/2196] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:02.306769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:02.308413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:02.333618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2802bf-cd3d-498f-aa6a-a4cc47232c85 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:02.345649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:02.346338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:02.346622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:02.346895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] PATH_INFO: `/v3/projects/f308fa1fdba14dda862a77be47e1361f` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:02.348629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f308fa1fdba14dda862a77be47e1361f)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:02.353470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:02.364982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:02.485920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1cdb-6448-45f0-b3fd-4c5db786162f service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:02.488169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-140f1cdb-6448-45f0-b3fd-4c5db786162f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:02.589323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1cdb-6448-45f0-b3fd-4c5db786162f service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:02.593460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3bd7b-c963-49ba-b4db-9d4d9203fd53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:02.594166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3bd7b-c963-49ba-b4db-9d4d9203fd53 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:02.594563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3bd7b-c963-49ba-b4db-9d4d9203fd53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:02.595480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3bd7b-c963-49ba-b4db-9d4d9203fd53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:02.597779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-25e3bd7b-c963-49ba-b4db-9d4d9203fd53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:02.647453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f308fa1fdba14dda862a77be47e1361f', 'request_id': 'req-630d090b-fe57-4956-b1f6-a51bd58dff07'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:02.654324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f308fa1fdba14dda862a77be47e1361f', 'request_id': 'req-630d090b-fe57-4956-b1f6-a51bd58dff07'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:02.660305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f308fa1fdba14dda862a77be47e1361f', 'request_id': 'req-630d090b-fe57-4956-b1f6-a51bd58dff07'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:02.667075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3bd7b-c963-49ba-b4db-9d4d9203fd53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:02.668559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3bd7b-c963-49ba-b4db-9d4d9203fd53 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:02.679661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1100/2197] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:02.680329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3bd7b-c963-49ba-b4db-9d4d9203fd53 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:02.681644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-25e3bd7b-c963-49ba-b4db-9d4d9203fd53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:02.695400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3bd7b-c963-49ba-b4db-9d4d9203fd53 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:02.771383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:02.772762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:02.773224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:02.773507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] PATH_INFO: `/v3/projects/492b18ed532541f3a89fb28be23037dc` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:02.775644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] RBAC: Authorizing `identity:delete_project(project_id=492b18ed532541f3a89fb28be23037dc)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:02.778118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] The token cache is being invalidate because project f308fa1fdba14dda862a77be47e1361f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:02.778454 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:02.778626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:02.779185 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-630d090b-fe57-4956-b1f6-a51bd58dff07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:02.780816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1098/2198] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:02 2022] DELETE /identity/v3/projects/f308fa1fdba14dda862a77be47e1361f => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:02.786549 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b7883-ad63-4638-b538-94900c7ec50a None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:02.786898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b7883-ad63-4638-b538-94900c7ec50a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:02.787314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b7883-ad63-4638-b538-94900c7ec50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:02.807048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-a03b7883-ad63-4638-b538-94900c7ec50a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:02.808276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a03b7883-ad63-4638-b538-94900c7ec50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:02.819015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1099/2199] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:02.828045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42b2de-b666-497e-aae6-9314fb408239 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:02.828331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42b2de-b666-497e-aae6-9314fb408239 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:02.828604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42b2de-b666-497e-aae6-9314fb408239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:02.850077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5c42b2de-b666-497e-aae6-9314fb408239 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:02.851426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5c42b2de-b666-497e-aae6-9314fb408239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:02.860030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1100/2200] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:02.864275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42b2de-b666-497e-aae6-9314fb408239 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:02.873714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42b2de-b666-497e-aae6-9314fb408239 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:02.878260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be592d-034f-426e-8a39-a550aa3a6694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:02.878855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be592d-034f-426e-8a39-a550aa3a6694 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:02.879128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be592d-034f-426e-8a39-a550aa3a6694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:02.879943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be592d-034f-426e-8a39-a550aa3a6694 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:02.880783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be592d-034f-426e-8a39-a550aa3a6694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:02.881082 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be592d-034f-426e-8a39-a550aa3a6694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:02.882686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be592d-034f-426e-8a39-a550aa3a6694 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:02.894373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1101/2201] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:10:02.896981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be592d-034f-426e-8a39-a550aa3a6694 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:02.898695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-21be592d-034f-426e-8a39-a550aa3a6694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:02.911076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be592d-034f-426e-8a39-a550aa3a6694 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:02.915687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:02.916286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:02.916566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:02.916837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] PATH_INFO: `/v3/users/03d5437d9ee843698573d89e3af36a0e` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:02.918005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d5437d9ee843698573d89e3af36a0e)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:02.919964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:02.953316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492b18ed532541f3a89fb28be23037dc', 'request_id': 'req-71d79ad4-d06a-413c-a62e-3a49e4cf128d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:03.088976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492b18ed532541f3a89fb28be23037dc', 'request_id': 'req-71d79ad4-d06a-413c-a62e-3a49e4cf128d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:03.095778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492b18ed532541f3a89fb28be23037dc', 'request_id': 'req-71d79ad4-d06a-413c-a62e-3a49e4cf128d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:03.107300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] The token cache is being invalidate because project 492b18ed532541f3a89fb28be23037dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:03.107775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:03.108470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:03.112102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1101/2202] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:02 2022] DELETE /identity/v3/projects/492b18ed532541f3a89fb28be23037dc => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:03.112102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:03.113205 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:03.217390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d79ad4-d06a-413c-a62e-3a49e4cf128d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:03.222018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f9521-3afb-4442-964f-85eabf05acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:03.222864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f9521-3afb-4442-964f-85eabf05acf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.223268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f9521-3afb-4442-964f-85eabf05acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.223637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f9521-3afb-4442-964f-85eabf05acf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.224566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f9521-3afb-4442-964f-85eabf05acf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:03.226658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f9521-3afb-4442-964f-85eabf05acf5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:03.248944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d5437d9ee843698573d89e3af36a0e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:03.257706 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d5437d9ee843698573d89e3af36a0e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:03.278361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d5437d9ee843698573d89e3af36a0e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:03.347922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1102/2203] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:03 2022] POST /identity/v3/projects => generated 369 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:03.349936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec8f0-67bf-4086-94a6-01fca5124d52 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.350247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec8f0-67bf-4086-94a6-01fca5124d52 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.350563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec8f0-67bf-4086-94a6-01fca5124d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.371807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b25ec8f0-67bf-4086-94a6-01fca5124d52 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:03.373109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b25ec8f0-67bf-4086-94a6-01fca5124d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:03.425552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d5437d9ee843698573d89e3af36a0e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:03.426973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d5437d9ee843698573d89e3af36a0e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:03.434755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1102/2204] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:02 2022] DELETE /identity/v3/users/03d5437d9ee843698573d89e3af36a0e => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:03.436066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:03.438271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:03.441361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1103/2205] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:03.443024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0859dc-d905-4278-977e-39961cf583ba None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.443413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0859dc-d905-4278-977e-39961cf583ba None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.443794 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0859dc-d905-4278-977e-39961cf583ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.466489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-5e0859dc-d905-4278-977e-39961cf583ba None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:03.468097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5e0859dc-d905-4278-977e-39961cf583ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:03.550183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f98811-853b-42bf-94bf-812d7b68102b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:03.567020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21721a-e333-407c-85f5-6367d9a558ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:03.567647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21721a-e333-407c-85f5-6367d9a558ce admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.567931 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21721a-e333-407c-85f5-6367d9a558ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.568207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21721a-e333-407c-85f5-6367d9a558ce admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.568848 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21721a-e333-407c-85f5-6367d9a558ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:03.571080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21721a-e333-407c-85f5-6367d9a558ce admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:03.574145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1104/2206] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:03.579645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d4853-ef72-4a6c-b4a4-e0b7fc0a46f0 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.580103 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d4853-ef72-4a6c-b4a4-e0b7fc0a46f0 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.580583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d4853-ef72-4a6c-b4a4-e0b7fc0a46f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.611562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f94d4853-ef72-4a6c-b4a4-e0b7fc0a46f0 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:03.613621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f94d4853-ef72-4a6c-b4a4-e0b7fc0a46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:03.625042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1105/2207] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:03.626235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d4853-ef72-4a6c-b4a4-e0b7fc0a46f0 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:03.630301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f94d4853-ef72-4a6c-b4a4-e0b7fc0a46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:03.702314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d4853-ef72-4a6c-b4a4-e0b7fc0a46f0 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:03.713791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1103/2208] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:03 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:03.714981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21721a-e333-407c-85f5-6367d9a558ce admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:03.717509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e3419-dcba-445a-bbd2-f701361e85ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:03.718238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e3419-dcba-445a-bbd2-f701361e85ac service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.718540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e3419-dcba-445a-bbd2-f701361e85ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.719108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e3419-dcba-445a-bbd2-f701361e85ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.723702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:03.727171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21721a-e333-407c-85f5-6367d9a558ce admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:03.732359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823658c-b68a-44ba-9829-da513c0b9c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:03.733037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823658c-b68a-44ba-9829-da513c0b9c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.733321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823658c-b68a-44ba-9829-da513c0b9c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.733593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823658c-b68a-44ba-9829-da513c0b9c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.735138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823658c-b68a-44ba-9829-da513c0b9c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:03.735426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823658c-b68a-44ba-9829-da513c0b9c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:03.736188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e3419-dcba-445a-bbd2-f701361e85ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:03.737472 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823658c-b68a-44ba-9829-da513c0b9c51 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:03.738027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e3419-dcba-445a-bbd2-f701361e85ac service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:03.749486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1106/2209] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:03.751865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1104/2210] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:03.752000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e3419-dcba-445a-bbd2-f701361e85ac service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:03.759221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823658c-b68a-44ba-9829-da513c0b9c51 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:03.763929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e3419-dcba-445a-bbd2-f701361e85ac service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:03.772028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31261a26-9003-4cbf-8881-99cbecfbf5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:03.772686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31261a26-9003-4cbf-8881-99cbecfbf5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.772829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823658c-b68a-44ba-9829-da513c0b9c51 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:03.772981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31261a26-9003-4cbf-8881-99cbecfbf5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.773241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31261a26-9003-4cbf-8881-99cbecfbf5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.773901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31261a26-9003-4cbf-8881-99cbecfbf5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:03.775667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31261a26-9003-4cbf-8881-99cbecfbf5a8 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:03.778239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9f12-8519-4264-854b-3175359786cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:03.779006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9f12-8519-4264-854b-3175359786cd admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.779417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9f12-8519-4264-854b-3175359786cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.779765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9f12-8519-4264-854b-3175359786cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.782253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9f12-8519-4264-854b-3175359786cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:03.787554 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9f12-8519-4264-854b-3175359786cd admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:03.790131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1107/2211] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:03.797692 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31261a26-9003-4cbf-8881-99cbecfbf5a8 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:03.809062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31261a26-9003-4cbf-8881-99cbecfbf5a8 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:03.814185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf89c7-edf2-483c-9d6d-91d2f1890321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:03.814835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf89c7-edf2-483c-9d6d-91d2f1890321 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.815121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf89c7-edf2-483c-9d6d-91d2f1890321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.815400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf89c7-edf2-483c-9d6d-91d2f1890321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.816052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf89c7-edf2-483c-9d6d-91d2f1890321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:03.818399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf89c7-edf2-483c-9d6d-91d2f1890321 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:03.830246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1108/2212] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:10:03.833809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf89c7-edf2-483c-9d6d-91d2f1890321 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:03.844008 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf89c7-edf2-483c-9d6d-91d2f1890321 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:03.849271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b72462-4b13-403b-97a3-d0697906971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:03.853909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b72462-4b13-403b-97a3-d0697906971d admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.854323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b72462-4b13-403b-97a3-d0697906971d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.854681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b72462-4b13-403b-97a3-d0697906971d admin admin] PATH_INFO: `/v3/projects/65a3a8e2aef54ec2a9aeb2f58bc0698e/users/200a127305bd431685a01b25d222d832/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.875654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b72462-4b13-403b-97a3-d0697906971d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a3a8e2aef54ec2a9aeb2f58bc0698e, user_id=200a127305bd431685a01b25d222d832, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:03.878562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b72462-4b13-403b-97a3-d0697906971d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:03.920486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1105/2213] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:03 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:03.921510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9f12-8519-4264-854b-3175359786cd admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:03.985824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1109/2214] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:03 2022] PUT /identity/v3/projects/65a3a8e2aef54ec2a9aeb2f58bc0698e/users/200a127305bd431685a01b25d222d832/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:03.995848 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473cdb-5901-4061-ab72-a04da6b786fa None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:03.996200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473cdb-5901-4061-ab72-a04da6b786fa None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:03.996538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473cdb-5901-4061-ab72-a04da6b786fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:03.998285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9f12-8519-4264-854b-3175359786cd admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:04.026100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-94473cdb-5901-4061-ab72-a04da6b786fa None None] MFA Rules not processed for user `200a127305bd431685a01b25d222d832`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:04.027427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-94473cdb-5901-4061-ab72-a04da6b786fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:04.055178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e7f07-167b-4812-91a4-8eb7c7276d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:04.055795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e7f07-167b-4812-91a4-8eb7c7276d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.056102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e7f07-167b-4812-91a4-8eb7c7276d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.056373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e7f07-167b-4812-91a4-8eb7c7276d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.057040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e7f07-167b-4812-91a4-8eb7c7276d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:04.059312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e7f07-167b-4812-91a4-8eb7c7276d5b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:04.097307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1110/2215] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:04.101756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94473cdb-5901-4061-ab72-a04da6b786fa None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:04.112253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94473cdb-5901-4061-ab72-a04da6b786fa None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:04.123685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65993-8fba-48f8-85f7-23e7887b905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:04.124319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65993-8fba-48f8-85f7-23e7887b905a admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.124627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65993-8fba-48f8-85f7-23e7887b905a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.124865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65993-8fba-48f8-85f7-23e7887b905a admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.125707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db65993-8fba-48f8-85f7-23e7887b905a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:04.127749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db65993-8fba-48f8-85f7-23e7887b905a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:04.187424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1106/2216] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:03 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:04.188500 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e7f07-167b-4812-91a4-8eb7c7276d5b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:04.199074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e7f07-167b-4812-91a4-8eb7c7276d5b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:04.204141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b4ea-fd2d-4633-b44e-af776626508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:04.204802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b4ea-fd2d-4633-b44e-af776626508a admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.205084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b4ea-fd2d-4633-b44e-af776626508a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.205359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b4ea-fd2d-4633-b44e-af776626508a admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.206133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b4ea-fd2d-4633-b44e-af776626508a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:04.207855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b4ea-fd2d-4633-b44e-af776626508a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:04.222365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1107/2217] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:04.223817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b4ea-fd2d-4633-b44e-af776626508a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:04.241332 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b4ea-fd2d-4633-b44e-af776626508a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:04.246151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ae03d-ced4-43ac-a021-6642fbf16a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:04.246784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ae03d-ced4-43ac-a021-6642fbf16a1a admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.247065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ae03d-ced4-43ac-a021-6642fbf16a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.247335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ae03d-ced4-43ac-a021-6642fbf16a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.247978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ae03d-ced4-43ac-a021-6642fbf16a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:04.249572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ae03d-ced4-43ac-a021-6642fbf16a1a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:04.260358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1108/2218] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:10:04.264829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ae03d-ced4-43ac-a021-6642fbf16a1a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:04.276621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ae03d-ced4-43ac-a021-6642fbf16a1a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:04.280426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1111/2219] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:04 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:04.281685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65993-8fba-48f8-85f7-23e7887b905a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:04.365485 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:04.373015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbface-95c4-4fd8-bdf4-5f524c857715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:04.373495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbface-95c4-4fd8-bdf4-5f524c857715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.373803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbface-95c4-4fd8-bdf4-5f524c857715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.374079 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbface-95c4-4fd8-bdf4-5f524c857715 admin admin] PATH_INFO: `/v3/projects/62fd8492eeae4c23a42f810acba83a31/users/414816fb225245cea22ef98d4aa47814/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.381637 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65993-8fba-48f8-85f7-23e7887b905a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:04.387301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db712-0035-4852-adea-29cf5c93e8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:04.388320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db712-0035-4852-adea-29cf5c93e8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.388602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db712-0035-4852-adea-29cf5c93e8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.392823 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db712-0035-4852-adea-29cf5c93e8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.392823 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5db712-0035-4852-adea-29cf5c93e8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:04.392999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbface-95c4-4fd8-bdf4-5f524c857715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fd8492eeae4c23a42f810acba83a31, user_id=414816fb225245cea22ef98d4aa47814, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:04.393080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5db712-0035-4852-adea-29cf5c93e8f4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:04.393784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbface-95c4-4fd8-bdf4-5f524c857715 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:04.486237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1109/2220] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:04 2022] PUT /identity/v3/projects/62fd8492eeae4c23a42f810acba83a31/users/414816fb225245cea22ef98d4aa47814/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:04.490479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1112/2221] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:04 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:04.490631 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbface-95c4-4fd8-bdf4-5f524c857715 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:04.490631 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8dbbface-95c4-4fd8-bdf4-5f524c857715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:04.492978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db712-0035-4852-adea-29cf5c93e8f4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:04.503390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db712-0035-4852-adea-29cf5c93e8f4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:04.555711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbface-95c4-4fd8-bdf4-5f524c857715 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:04.560348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:04.560978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.561503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.561775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] PATH_INFO: `/v3/projects/93d6be126587438eb0f10ae40b2b79c3` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.562892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d6be126587438eb0f10ae40b2b79c3)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:04.564518 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea8f34-c90b-4915-975e-a63cf4bdc286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:04.564783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:04.565309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8f34-c90b-4915-975e-a63cf4bdc286 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.565665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8f34-c90b-4915-975e-a63cf4bdc286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.566014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8f34-c90b-4915-975e-a63cf4bdc286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.566828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea8f34-c90b-4915-975e-a63cf4bdc286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:04.568691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea8f34-c90b-4915-975e-a63cf4bdc286 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:04.579704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1113/2222] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:04.581229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c863f-fc6b-4649-a67f-f5bd05912ec3 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.581229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c863f-fc6b-4649-a67f-f5bd05912ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.581521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c863f-fc6b-4649-a67f-f5bd05912ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.613512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c14c863f-fc6b-4649-a67f-f5bd05912ec3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:04.615672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c14c863f-fc6b-4649-a67f-f5bd05912ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:04.625630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1114/2223] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:04.626491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c863f-fc6b-4649-a67f-f5bd05912ec3 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:04.636851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c863f-fc6b-4649-a67f-f5bd05912ec3 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:04.641913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f797ae7-2db4-4594-8109-162dda567afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:04.643157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797ae7-2db4-4594-8109-162dda567afa admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.643157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797ae7-2db4-4594-8109-162dda567afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.643499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797ae7-2db4-4594-8109-162dda567afa admin admin] PATH_INFO: `/v3/projects/dea89199b2b043349f1ee6c632ee7361/users/443329e090bb4de59b7153d751e8e825/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.690249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f797ae7-2db4-4594-8109-162dda567afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea89199b2b043349f1ee6c632ee7361, user_id=443329e090bb4de59b7153d751e8e825, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:04.690249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f797ae7-2db4-4594-8109-162dda567afa admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:04.844266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1115/2224] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:04 2022] PUT /identity/v3/projects/dea89199b2b043349f1ee6c632ee7361/users/443329e090bb4de59b7153d751e8e825/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:04.845135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f797ae7-2db4-4594-8109-162dda567afa admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:04.850262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2f797ae7-2db4-4594-8109-162dda567afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:04.859939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d6be126587438eb0f10ae40b2b79c3', 'request_id': 'req-d6f12930-d871-4cc2-bf7b-417bfd3108e2'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:04.867857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d6be126587438eb0f10ae40b2b79c3', 'request_id': 'req-d6f12930-d871-4cc2-bf7b-417bfd3108e2'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:04.874900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d6be126587438eb0f10ae40b2b79c3', 'request_id': 'req-d6f12930-d871-4cc2-bf7b-417bfd3108e2'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:04.912900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f797ae7-2db4-4594-8109-162dda567afa admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:04.940187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] The token cache is being invalidate because project 93d6be126587438eb0f10ae40b2b79c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:04.943847 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:04.943847 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:04.944461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1110/2225] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:04 2022] DELETE /identity/v3/projects/93d6be126587438eb0f10ae40b2b79c3 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:04.945221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:04.946863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:04.968290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cecbdd-807e-4df9-8923-fb49f713c883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:04.969018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cecbdd-807e-4df9-8923-fb49f713c883 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:04.969325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cecbdd-807e-4df9-8923-fb49f713c883 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:04.969621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cecbdd-807e-4df9-8923-fb49f713c883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:04.972303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-27cecbdd-807e-4df9-8923-fb49f713c883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:05.018118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f12930-d871-4cc2-bf7b-417bfd3108e2 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:05.023592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2e4ae-b2ad-49d3-b381-ab9377a58147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:05.024259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2e4ae-b2ad-49d3-b381-ab9377a58147 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:05.027932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2e4ae-b2ad-49d3-b381-ab9377a58147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:05.027932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2e4ae-b2ad-49d3-b381-ab9377a58147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:05.027932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2e4ae-b2ad-49d3-b381-ab9377a58147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:05.027932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2e4ae-b2ad-49d3-b381-ab9377a58147 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:05.037759 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1111/2226] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:05.038618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2e4ae-b2ad-49d3-b381-ab9377a58147 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:05.038884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cecbdd-807e-4df9-8923-fb49f713c883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:05.040418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cecbdd-807e-4df9-8923-fb49f713c883 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:05.042325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-afc2e4ae-b2ad-49d3-b381-ab9377a58147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:05.050279 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1116/2227] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:05.051204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cecbdd-807e-4df9-8923-fb49f713c883 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:05.055655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2e4ae-b2ad-49d3-b381-ab9377a58147 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:05.060480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cecbdd-807e-4df9-8923-fb49f713c883 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:05.062385 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:05.063027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:05.068044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:05.068044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] PATH_INFO: `/v3/users/5802e704d6554f778f46432f7ac35205` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:05.068044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5802e704d6554f778f46432f7ac35205)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:05.068350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5e8c2-fc90-4ea9-8b0b-5471f914f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:05.068350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e8c2-fc90-4ea9-8b0b-5471f914f1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:05.068350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e8c2-fc90-4ea9-8b0b-5471f914f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:05.068615 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:05.068700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e8c2-fc90-4ea9-8b0b-5471f914f1a8 admin admin] PATH_INFO: `/v3/projects/dea89199b2b043349f1ee6c632ee7361/users/443329e090bb4de59b7153d751e8e825/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:05.070662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5e8c2-fc90-4ea9-8b0b-5471f914f1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea89199b2b043349f1ee6c632ee7361, user_id=443329e090bb4de59b7153d751e8e825, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:05.073311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5e8c2-fc90-4ea9-8b0b-5471f914f1a8 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:05.084179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1117/2228] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:05 2022] PUT /identity/v3/projects/dea89199b2b043349f1ee6c632ee7361/users/443329e090bb4de59b7153d751e8e825/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:05.095480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cbcba-26e3-4afb-ada3-4328a29ce3d7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:05.095800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cbcba-26e3-4afb-ada3-4328a29ce3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:05.096104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cbcba-26e3-4afb-ada3-4328a29ce3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:05.125612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-596cbcba-26e3-4afb-ada3-4328a29ce3d7 None None] MFA Rules not processed for user `443329e090bb4de59b7153d751e8e825`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:05.126859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-596cbcba-26e3-4afb-ada3-4328a29ce3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:05.196584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1118/2229] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:05.207941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cbcba-26e3-4afb-ada3-4328a29ce3d7 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:05.209344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-596cbcba-26e3-4afb-ada3-4328a29ce3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:05.267937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cbcba-26e3-4afb-ada3-4328a29ce3d7 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:05.272057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9138-aeb8-44e2-b8d9-84eb3652a08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:05.272701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9138-aeb8-44e2-b8d9-84eb3652a08e service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:05.273023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9138-aeb8-44e2-b8d9-84eb3652a08e service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:05.273332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb9138-aeb8-44e2-b8d9-84eb3652a08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:05.282720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb9138-aeb8-44e2-b8d9-84eb3652a08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:05.284215 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb9138-aeb8-44e2-b8d9-84eb3652a08e service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:05.300258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1119/2230] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:05.365298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5802e704d6554f778f46432f7ac35205'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:05.372848 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5802e704d6554f778f46432f7ac35205'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:05.385469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5802e704d6554f778f46432f7ac35205'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:05.537659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5802e704d6554f778f46432f7ac35205'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:05.538489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9278ed58-0ac9-498f-9b10-23d3a4a1742a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5802e704d6554f778f46432f7ac35205'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:05.545232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1112/2231] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:05 2022] DELETE /identity/v3/users/5802e704d6554f778f46432f7ac35205 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:06.188077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9138-aeb8-44e2-b8d9-84eb3652a08e service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:06.294045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb9138-aeb8-44e2-b8d9-84eb3652a08e service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:06.354489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:06.355270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:06.355545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:06.355889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] PATH_INFO: `/v3/projects/021d0baffbca46ab96140c1a4229e9b9` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:06.357036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] RBAC: Authorizing `identity:delete_project(project_id=021d0baffbca46ab96140c1a4229e9b9)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:06.359109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:06.543349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021d0baffbca46ab96140c1a4229e9b9', 'request_id': 'req-553acc44-ec1d-44c0-8a70-381902db742d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:06.688517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021d0baffbca46ab96140c1a4229e9b9', 'request_id': 'req-553acc44-ec1d-44c0-8a70-381902db742d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:06.695488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021d0baffbca46ab96140c1a4229e9b9', 'request_id': 'req-553acc44-ec1d-44c0-8a70-381902db742d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:06.706738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] The token cache is being invalidate because project 021d0baffbca46ab96140c1a4229e9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:06.707014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:06.707789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-553acc44-ec1d-44c0-8a70-381902db742d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:06.709541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1120/2232] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:06 2022] DELETE /identity/v3/projects/021d0baffbca46ab96140c1a4229e9b9 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:06.714460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911994d7-b58e-42b2-b8ad-26135bd58214 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:06.714958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911994d7-b58e-42b2-b8ad-26135bd58214 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:06.715100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911994d7-b58e-42b2-b8ad-26135bd58214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:06.735694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-911994d7-b58e-42b2-b8ad-26135bd58214 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:06.736958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-911994d7-b58e-42b2-b8ad-26135bd58214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:06.834388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1113/2233] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:06.841986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6001dc-6b6e-4d7d-acba-322c5bf79aac None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:06.842295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6001dc-6b6e-4d7d-acba-322c5bf79aac None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:06.842621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6001dc-6b6e-4d7d-acba-322c5bf79aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:06.866987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-de6001dc-6b6e-4d7d-acba-322c5bf79aac None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:06.868602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-de6001dc-6b6e-4d7d-acba-322c5bf79aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:06.882465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1121/2234] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:06.883541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911994d7-b58e-42b2-b8ad-26135bd58214 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:06.894429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911994d7-b58e-42b2-b8ad-26135bd58214 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:06.900563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31f4b1-4059-44c2-9437-0e109e9ec1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:06.901178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f4b1-4059-44c2-9437-0e109e9ec1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:06.901495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f4b1-4059-44c2-9437-0e109e9ec1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:06.901769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f4b1-4059-44c2-9437-0e109e9ec1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:06.902475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31f4b1-4059-44c2-9437-0e109e9ec1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:06.903186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31f4b1-4059-44c2-9437-0e109e9ec1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:06.904364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31f4b1-4059-44c2-9437-0e109e9ec1f9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:06.922679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1114/2235] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:10:06.922826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6001dc-6b6e-4d7d-acba-322c5bf79aac None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:06.932329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6001dc-6b6e-4d7d-acba-322c5bf79aac None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:06.937543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd0f7a-abd8-4641-b37d-5d5771d18c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:06.938158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd0f7a-abd8-4641-b37d-5d5771d18c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:06.938468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd0f7a-abd8-4641-b37d-5d5771d18c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:06.938899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd0f7a-abd8-4641-b37d-5d5771d18c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:06.939457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd0f7a-abd8-4641-b37d-5d5771d18c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:06.941347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd0f7a-abd8-4641-b37d-5d5771d18c1a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:06.993571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612db8b6-f411-412a-b980-436bfd6ce7cf None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:06.993865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612db8b6-f411-412a-b980-436bfd6ce7cf None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:06.994141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612db8b6-f411-412a-b980-436bfd6ce7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:07.023288 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-612db8b6-f411-412a-b980-436bfd6ce7cf None None] MFA Rules not processed for user `414816fb225245cea22ef98d4aa47814`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:07.024552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-612db8b6-f411-412a-b980-436bfd6ce7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:07.090046 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1115/2236] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:07.123949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1122/2237] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:06 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:07.128008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612db8b6-f411-412a-b980-436bfd6ce7cf None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:07.140540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612db8b6-f411-412a-b980-436bfd6ce7cf None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:07.196995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e3592-c003-4b9f-bb27-7d25a69189a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:07.197598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e3592-c003-4b9f-bb27-7d25a69189a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:07.197880 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e3592-c003-4b9f-bb27-7d25a69189a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:07.198152 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e3592-c003-4b9f-bb27-7d25a69189a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:07.198814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e3592-c003-4b9f-bb27-7d25a69189a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:07.200720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e3592-c003-4b9f-bb27-7d25a69189a2 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:07.231833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:07.244997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd0f7a-abd8-4641-b37d-5d5771d18c1a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:07.244997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f6bd0f7a-abd8-4641-b37d-5d5771d18c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:07.306427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1116/2238] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:07 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:07.316811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e3592-c003-4b9f-bb27-7d25a69189a2 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:07.330989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd0f7a-abd8-4641-b37d-5d5771d18c1a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:07.334756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e3592-c003-4b9f-bb27-7d25a69189a2 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:07.336980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842dd3f-2af4-4a40-9e9f-5683ee3c1238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:07.337617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842dd3f-2af4-4a40-9e9f-5683ee3c1238 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:07.337901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842dd3f-2af4-4a40-9e9f-5683ee3c1238 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:07.338176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842dd3f-2af4-4a40-9e9f-5683ee3c1238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:07.339699 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b7ca-6ce4-4738-bdd2-2fb87c2c3741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:07.340301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b7ca-6ce4-4738-bdd2-2fb87c2c3741 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:07.340706 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b7ca-6ce4-4738-bdd2-2fb87c2c3741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:07.340984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2b7ca-6ce4-4738-bdd2-2fb87c2c3741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:07.341732 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2b7ca-6ce4-4738-bdd2-2fb87c2c3741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:07.343970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2b7ca-6ce4-4738-bdd2-2fb87c2c3741 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:07.356635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1117/2239] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:10:07.360386 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b7ca-6ce4-4738-bdd2-2fb87c2c3741 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:07.370736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2b7ca-6ce4-4738-bdd2-2fb87c2c3741 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:07.375659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d6b38-48f7-49ed-82e0-ae5d9c56834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:07.376190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d6b38-48f7-49ed-82e0-ae5d9c56834b admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:07.376464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d6b38-48f7-49ed-82e0-ae5d9c56834b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:07.376731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d6b38-48f7-49ed-82e0-ae5d9c56834b admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:07.377364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d6b38-48f7-49ed-82e0-ae5d9c56834b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:07.379171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d6b38-48f7-49ed-82e0-ae5d9c56834b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:07.389198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1118/2240] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:07.393436 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d6b38-48f7-49ed-82e0-ae5d9c56834b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:07.401874 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842dd3f-2af4-4a40-9e9f-5683ee3c1238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:07.403450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842dd3f-2af4-4a40-9e9f-5683ee3c1238 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:07.403565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d6b38-48f7-49ed-82e0-ae5d9c56834b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:07.408279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22da512-178b-459d-ab10-9f52fd5344ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:07.408924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22da512-178b-459d-ab10-9f52fd5344ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:07.409199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22da512-178b-459d-ab10-9f52fd5344ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:07.409469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22da512-178b-459d-ab10-9f52fd5344ff admin admin] PATH_INFO: `/v3/projects/e49f2ba9070b412e9381336cf3ea8df4/users/daed8b2907ee44c099229c06127af1e3/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:07.414008 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1123/2241] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:07.427369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22da512-178b-459d-ab10-9f52fd5344ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49f2ba9070b412e9381336cf3ea8df4, user_id=daed8b2907ee44c099229c06127af1e3, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:07.430150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22da512-178b-459d-ab10-9f52fd5344ff admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:07.601089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1119/2242] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:07 2022] PUT /identity/v3/projects/e49f2ba9070b412e9381336cf3ea8df4/users/daed8b2907ee44c099229c06127af1e3/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:07.612276 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d78ed-bd4f-49f9-ba35-22268c1774b2 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:07.612563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d78ed-bd4f-49f9-ba35-22268c1774b2 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:07.612840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d78ed-bd4f-49f9-ba35-22268c1774b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:07.643650 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-191d78ed-bd4f-49f9-ba35-22268c1774b2 None None] MFA Rules not processed for user `daed8b2907ee44c099229c06127af1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:07.644839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-191d78ed-bd4f-49f9-ba35-22268c1774b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:07.712460 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1124/2243] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:07.717127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22da512-178b-459d-ab10-9f52fd5344ff admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:07.746620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:07.780993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22da512-178b-459d-ab10-9f52fd5344ff admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:07.785893 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37eca53-e61f-4a39-b593-b25096ef20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:07.786626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37eca53-e61f-4a39-b593-b25096ef20fd admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:07.786909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37eca53-e61f-4a39-b593-b25096ef20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:07.787304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37eca53-e61f-4a39-b593-b25096ef20fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:07.787889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37eca53-e61f-4a39-b593-b25096ef20fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:07.790494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37eca53-e61f-4a39-b593-b25096ef20fd admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:07.901941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1120/2244] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:07 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:07.905900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d78ed-bd4f-49f9-ba35-22268c1774b2 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:07.918784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d78ed-bd4f-49f9-ba35-22268c1774b2 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:07.982642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c986-8db0-4f9f-b813-47567e135a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:07.983536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c986-8db0-4f9f-b813-47567e135a49 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:07.984173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c986-8db0-4f9f-b813-47567e135a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:07.984173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c986-8db0-4f9f-b813-47567e135a49 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:07.987565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0c986-8db0-4f9f-b813-47567e135a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:07.987565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0c986-8db0-4f9f-b813-47567e135a49 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:08.121297 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1125/2245] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:07 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:08.125200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37eca53-e61f-4a39-b593-b25096ef20fd admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:08.135495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37eca53-e61f-4a39-b593-b25096ef20fd admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:08.140042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d89e6-94aa-4f03-bd3f-afa7ef1b7b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:08.140631 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d89e6-94aa-4f03-bd3f-afa7ef1b7b40 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:08.140912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d89e6-94aa-4f03-bd3f-afa7ef1b7b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:08.141184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d89e6-94aa-4f03-bd3f-afa7ef1b7b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:08.141822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d89e6-94aa-4f03-bd3f-afa7ef1b7b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:08.143454 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d89e6-94aa-4f03-bd3f-afa7ef1b7b40 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:08.154236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1121/2246] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:10:08.158325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c986-8db0-4f9f-b813-47567e135a49 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:08.169314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c986-8db0-4f9f-b813-47567e135a49 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:08.173901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe69e9-25c0-4536-a595-35c539143c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:08.174583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe69e9-25c0-4536-a595-35c539143c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:08.174863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe69e9-25c0-4536-a595-35c539143c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:08.175135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe69e9-25c0-4536-a595-35c539143c45 admin admin] PATH_INFO: `/v3/projects/cdb359ffb044476bb25b0b99bb32ab87/users/5cced1c672044e49aa91ed25c4d1d472/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:08.192677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe69e9-25c0-4536-a595-35c539143c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb359ffb044476bb25b0b99bb32ab87, user_id=5cced1c672044e49aa91ed25c4d1d472, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:08.195506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe69e9-25c0-4536-a595-35c539143c45 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:08.326855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1126/2247] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:08 2022] PUT /identity/v3/projects/cdb359ffb044476bb25b0b99bb32ab87/users/5cced1c672044e49aa91ed25c4d1d472/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:08.335127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d89e6-94aa-4f03-bd3f-afa7ef1b7b40 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:08.345316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d89e6-94aa-4f03-bd3f-afa7ef1b7b40 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:08.458065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e1dd0-52a5-4ecc-8ced-0974247969d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:08.458780 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1dd0-52a5-4ecc-8ced-0974247969d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:08.459054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1dd0-52a5-4ecc-8ced-0974247969d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:08.459322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1dd0-52a5-4ecc-8ced-0974247969d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:08.460000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e1dd0-52a5-4ecc-8ced-0974247969d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:08.461600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e1dd0-52a5-4ecc-8ced-0974247969d3 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:08.472523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1122/2248] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:10:08.477653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe69e9-25c0-4536-a595-35c539143c45 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:08.489274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe69e9-25c0-4536-a595-35c539143c45 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:08.494139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd2d1a-7cab-4c7d-aa6c-15e17ebd9f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:08.494844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd2d1a-7cab-4c7d-aa6c-15e17ebd9f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:08.495126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd2d1a-7cab-4c7d-aa6c-15e17ebd9f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:08.495403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd2d1a-7cab-4c7d-aa6c-15e17ebd9f0f admin admin] PATH_INFO: `/v3/projects/cdb359ffb044476bb25b0b99bb32ab87/users/5cced1c672044e49aa91ed25c4d1d472/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:08.497347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd2d1a-7cab-4c7d-aa6c-15e17ebd9f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb359ffb044476bb25b0b99bb32ab87, user_id=5cced1c672044e49aa91ed25c4d1d472, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:08.500087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd2d1a-7cab-4c7d-aa6c-15e17ebd9f0f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:08.511066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1127/2249] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:08 2022] PUT /identity/v3/projects/cdb359ffb044476bb25b0b99bb32ab87/users/5cced1c672044e49aa91ed25c4d1d472/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:08.525506 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c578-80eb-423d-baae-98c66fda2ccf None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:08.525909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c578-80eb-423d-baae-98c66fda2ccf None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:08.526188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c578-80eb-423d-baae-98c66fda2ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:08.554187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2e46c578-80eb-423d-baae-98c66fda2ccf None None] MFA Rules not processed for user `5cced1c672044e49aa91ed25c4d1d472`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:08.555422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2e46c578-80eb-423d-baae-98c66fda2ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:08.626609 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1123/2250] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:08.663574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd2d1a-7cab-4c7d-aa6c-15e17ebd9f0f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:08.716226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd2d1a-7cab-4c7d-aa6c-15e17ebd9f0f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:08.719866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d50de7-dbe9-44ac-a660-29a5ba0e41b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:08.720466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d50de7-dbe9-44ac-a660-29a5ba0e41b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:08.720745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d50de7-dbe9-44ac-a660-29a5ba0e41b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:08.721019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d50de7-dbe9-44ac-a660-29a5ba0e41b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:08.730783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d50de7-dbe9-44ac-a660-29a5ba0e41b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:08.732196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d50de7-dbe9-44ac-a660-29a5ba0e41b2 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:08.741887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1128/2251] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:09.199413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c578-80eb-423d-baae-98c66fda2ccf None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:09.267719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c578-80eb-423d-baae-98c66fda2ccf None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:09.282020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:09.282971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:09.283316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:09.283651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] PATH_INFO: `/v3/users/daed8b2907ee44c099229c06127af1e3` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:09.284888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=daed8b2907ee44c099229c06127af1e3)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:09.287166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:09.730896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daed8b2907ee44c099229c06127af1e3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:09.737647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daed8b2907ee44c099229c06127af1e3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:09.751007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daed8b2907ee44c099229c06127af1e3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:09.846199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daed8b2907ee44c099229c06127af1e3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:09.846539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daed8b2907ee44c099229c06127af1e3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:09.855064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1124/2252] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:09 2022] DELETE /identity/v3/users/daed8b2907ee44c099229c06127af1e3 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:09.859885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe035e-90c6-4355-838d-48adad139dd7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:09.860350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe035e-90c6-4355-838d-48adad139dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:09.860504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe035e-90c6-4355-838d-48adad139dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:09.884028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-0fbe035e-90c6-4355-838d-48adad139dd7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:09.885232 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0fbe035e-90c6-4355-838d-48adad139dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:09.950871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1129/2253] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:09.961076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:09.962514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:10.024804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf7466-0dd4-435f-88aa-bfe88814a21b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:10.030402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ab3de-ef0f-4342-8afc-556581725792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:10.031115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ab3de-ef0f-4342-8afc-556581725792 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:10.031510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ab3de-ef0f-4342-8afc-556581725792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:10.032193 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ab3de-ef0f-4342-8afc-556581725792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:10.042903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ab3de-ef0f-4342-8afc-556581725792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:10.053022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ab3de-ef0f-4342-8afc-556581725792 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:10.054624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1125/2254] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:10.137712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:10.220467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe035e-90c6-4355-838d-48adad139dd7 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:10.221910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0fbe035e-90c6-4355-838d-48adad139dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:10.234376 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe035e-90c6-4355-838d-48adad139dd7 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:10.240110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:10.240759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:10.241040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:10.241316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] PATH_INFO: `/v3/users/200a127305bd431685a01b25d222d832` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:10.242488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=200a127305bd431685a01b25d222d832)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:10.244414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:10.318472 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ab3de-ef0f-4342-8afc-556581725792 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:10.318472 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-190ab3de-ef0f-4342-8afc-556581725792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:10.331504 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ab3de-ef0f-4342-8afc-556581725792 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:10.338247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:10.339125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:10.339527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:10.339867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] PATH_INFO: `/v3/users/e22e621f00254449b13c9bda8bf70253` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:10.341071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22e621f00254449b13c9bda8bf70253)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:10.343209 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:10.491084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '200a127305bd431685a01b25d222d832'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:10.492408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '200a127305bd431685a01b25d222d832'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:10.500607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '200a127305bd431685a01b25d222d832'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:10.527959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '200a127305bd431685a01b25d222d832'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:10.528904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-46cceaa3-8b6e-40f3-a16f-336d61b35927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '200a127305bd431685a01b25d222d832'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:10.619817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22e621f00254449b13c9bda8bf70253'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:10.632213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22e621f00254449b13c9bda8bf70253'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:10.647415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22e621f00254449b13c9bda8bf70253'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:10.686276 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1130/2255] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:10 2022] DELETE /identity/v3/users/200a127305bd431685a01b25d222d832 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:10.688009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf6fa-6ca6-4f62-a809-5d21b38c996f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:10.688295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf6fa-6ca6-4f62-a809-5d21b38c996f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:10.688571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf6fa-6ca6-4f62-a809-5d21b38c996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:10.709382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-ae4cf6fa-6ca6-4f62-a809-5d21b38c996f None None] MFA Rules not processed for user `414816fb225245cea22ef98d4aa47814`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:10.710625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ae4cf6fa-6ca6-4f62-a809-5d21b38c996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:10.773313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1131/2256] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:10.773313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d8df-25d2-47e9-b4a8-1120ffd18bd4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:10.773710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22e621f00254449b13c9bda8bf70253'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:10.773710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22e621f00254449b13c9bda8bf70253'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:10.788903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1126/2257] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:10 2022] DELETE /identity/v3/users/e22e621f00254449b13c9bda8bf70253 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:10.792139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d8df-25d2-47e9-b4a8-1120ffd18bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:10.792139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:10.792139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d8df-25d2-47e9-b4a8-1120ffd18bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:10.793866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:10.796384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:10.833066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b702d8df-25d2-47e9-b4a8-1120ffd18bd4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:10.833066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b702d8df-25d2-47e9-b4a8-1120ffd18bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:10.903411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7d3c-3a29-4444-a73b-9fffe91df26e admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:10.909066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:10.909713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:10.909995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:10.910288 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] PATH_INFO: `/v3/projects/e49f2ba9070b412e9381336cf3ea8df4` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:10.911542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49f2ba9070b412e9381336cf3ea8df4)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:10.913461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:10.913933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1132/2258] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:10.918619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc9b7-a904-4369-8a32-f22f69ef019c None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:10.918910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc9b7-a904-4369-8a32-f22f69ef019c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:10.919182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc9b7-a904-4369-8a32-f22f69ef019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:10.940664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-3b8cc9b7-a904-4369-8a32-f22f69ef019c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:10.941986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3b8cc9b7-a904-4369-8a32-f22f69ef019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:10.951893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1133/2259] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:10.952632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc9b7-a904-4369-8a32-f22f69ef019c None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:10.959873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3b8cc9b7-a904-4369-8a32-f22f69ef019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:11.019444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc9b7-a904-4369-8a32-f22f69ef019c None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:11.023259 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b9306-49e4-4a7f-b51a-9bc2bcbd5a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:11.023875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b9306-49e4-4a7f-b51a-9bc2bcbd5a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:11.024157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b9306-49e4-4a7f-b51a-9bc2bcbd5a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:11.024431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b9306-49e4-4a7f-b51a-9bc2bcbd5a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:11.033777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b9306-49e4-4a7f-b51a-9bc2bcbd5a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:11.035237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b9306-49e4-4a7f-b51a-9bc2bcbd5a18 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:11.045201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1134/2260] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:11.046244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b9306-49e4-4a7f-b51a-9bc2bcbd5a18 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:11.055928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b9306-49e4-4a7f-b51a-9bc2bcbd5a18 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:11.059596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5613a17-cb27-4f34-87f5-d2b224de52fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:11.060204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5613a17-cb27-4f34-87f5-d2b224de52fc service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:11.060482 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5613a17-cb27-4f34-87f5-d2b224de52fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:11.060757 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5613a17-cb27-4f34-87f5-d2b224de52fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:11.070998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5613a17-cb27-4f34-87f5-d2b224de52fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:11.072416 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5613a17-cb27-4f34-87f5-d2b224de52fc service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:11.084691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1135/2261] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:11.112053 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49f2ba9070b412e9381336cf3ea8df4', 'request_id': 'req-799c9a63-b95f-45f5-822d-600510849b39'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:11.120610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49f2ba9070b412e9381336cf3ea8df4', 'request_id': 'req-799c9a63-b95f-45f5-822d-600510849b39'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:11.128447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49f2ba9070b412e9381336cf3ea8df4', 'request_id': 'req-799c9a63-b95f-45f5-822d-600510849b39'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:11.294924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] The token cache is being invalidate because project e49f2ba9070b412e9381336cf3ea8df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:11.295221 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:11.295958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:11.297721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1127/2262] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:10 2022] DELETE /identity/v3/projects/e49f2ba9070b412e9381336cf3ea8df4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:11.302379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5613a17-cb27-4f34-87f5-d2b224de52fc service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:11.313966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5613a17-cb27-4f34-87f5-d2b224de52fc service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:11.376806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:11.377383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:11.377673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:11.378015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] PATH_INFO: `/v3/users/5cced1c672044e49aa91ed25c4d1d472` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:11.379770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cced1c672044e49aa91ed25c4d1d472)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:11.381738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:11.695217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cced1c672044e49aa91ed25c4d1d472'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:11.695897 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cced1c672044e49aa91ed25c4d1d472'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:11.705673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cced1c672044e49aa91ed25c4d1d472'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:11.726988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cced1c672044e49aa91ed25c4d1d472'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:11.728015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cced1c672044e49aa91ed25c4d1d472'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:11.848697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:11.849153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1136/2263] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:11 2022] DELETE /identity/v3/users/5cced1c672044e49aa91ed25c4d1d472 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:11.849153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:11.849296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:11.851352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:11.864538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c9a63-b95f-45f5-822d-600510849b39 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:11.936714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e10ea3-5879-4031-89df-a033b5343c79 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:11.945614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:11.946326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:11.946602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:11.946886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] PATH_INFO: `/v3/projects/a269997cf5bb4d2b95d96b8286ac7fbb` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:11.951310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a269997cf5bb4d2b95d96b8286ac7fbb)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:11.951310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:11.972309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:11.973608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:11.973954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:11.974312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] PATH_INFO: `/v3/projects/65a3a8e2aef54ec2a9aeb2f58bc0698e` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:11.975601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a3a8e2aef54ec2a9aeb2f58bc0698e)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:11.977558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:12.371459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a269997cf5bb4d2b95d96b8286ac7fbb', 'request_id': 'req-5f9052d5-449d-4a60-acb0-dc054d69c52d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:12.379455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a3a8e2aef54ec2a9aeb2f58bc0698e', 'request_id': 'req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:12.386804 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a3a8e2aef54ec2a9aeb2f58bc0698e', 'request_id': 'req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:12.394120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a3a8e2aef54ec2a9aeb2f58bc0698e', 'request_id': 'req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:12.503753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a269997cf5bb4d2b95d96b8286ac7fbb', 'request_id': 'req-5f9052d5-449d-4a60-acb0-dc054d69c52d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:12.515947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a269997cf5bb4d2b95d96b8286ac7fbb', 'request_id': 'req-5f9052d5-449d-4a60-acb0-dc054d69c52d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:12.545073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] The token cache is being invalidate because project a269997cf5bb4d2b95d96b8286ac7fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:12.545379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:12.558714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:12.562964 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1137/2264] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:11 2022] DELETE /identity/v3/projects/a269997cf5bb4d2b95d96b8286ac7fbb => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:12.562964 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:12.564362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:12.652712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9052d5-449d-4a60-acb0-dc054d69c52d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:12.669318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] The token cache is being invalidate because project 65a3a8e2aef54ec2a9aeb2f58bc0698e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:12.669318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:12.669318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:12.669318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1128/2265] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:11 2022] DELETE /identity/v3/projects/65a3a8e2aef54ec2a9aeb2f58bc0698e => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:12.669318 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:12.669724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:12.740219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:12.741290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:12.741744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:12.742252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] PATH_INFO: `/v3/users/238113c9ad014abc8b1026f06fda6d43` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:12.747573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=238113c9ad014abc8b1026f06fda6d43)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:12.750417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:12.769052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b96e-9e89-4cdc-86b7-9d2e304487fc admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:12.774538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:12.775502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:12.775502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:12.775699 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] PATH_INFO: `/v3/users/f443405f66b042ec9417ad299b33ca33` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:12.777044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f443405f66b042ec9417ad299b33ca33)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:12.779160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:13.013986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f443405f66b042ec9417ad299b33ca33'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.014686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238113c9ad014abc8b1026f06fda6d43'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.014686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238113c9ad014abc8b1026f06fda6d43'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.021822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f443405f66b042ec9417ad299b33ca33'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.022232 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238113c9ad014abc8b1026f06fda6d43'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.034085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238113c9ad014abc8b1026f06fda6d43'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.034343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f443405f66b042ec9417ad299b33ca33'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.034810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238113c9ad014abc8b1026f06fda6d43'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.111333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f443405f66b042ec9417ad299b33ca33'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.111963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f443405f66b042ec9417ad299b33ca33'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.118420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1129/2266] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:12 2022] DELETE /identity/v3/users/f443405f66b042ec9417ad299b33ca33 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:13.120536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:13.120642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:13.188602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7cb9f-8ae3-462e-a387-874bd6764f5e admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:13.193786 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:13.194480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:13.194767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:13.195113 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] PATH_INFO: `/v3/users/443329e090bb4de59b7153d751e8e825` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:13.196352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443329e090bb4de59b7153d751e8e825)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:13.198429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:13.264279 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1138/2267] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:12 2022] DELETE /identity/v3/users/238113c9ad014abc8b1026f06fda6d43 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:13.265643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:13.267677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:13.287785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:13.341244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86552afb-cbbe-4baf-a724-5101762d75b0 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:13.346013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:13.346722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:13.347002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:13.347274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] PATH_INFO: `/v3/projects/cdb359ffb044476bb25b0b99bb32ab87` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:13.348413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb359ffb044476bb25b0b99bb32ab87)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:13.350686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:13.485354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443329e090bb4de59b7153d751e8e825'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.492695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443329e090bb4de59b7153d751e8e825'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.505239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443329e090bb4de59b7153d751e8e825'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.544837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb359ffb044476bb25b0b99bb32ab87', 'request_id': 'req-da4327be-7d8d-4513-ae61-1ab7d84c997a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.644211 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443329e090bb4de59b7153d751e8e825'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.646420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443329e090bb4de59b7153d751e8e825'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.658391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1130/2268] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:13 2022] DELETE /identity/v3/users/443329e090bb4de59b7153d751e8e825 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:13.659458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:13.661020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:13.735306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61b133-da91-4315-9aa7-62a4ca408613 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:13.741698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e53815-ea69-4dc1-8287-b586ba1c406c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:13.742364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e53815-ea69-4dc1-8287-b586ba1c406c service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:13.742648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e53815-ea69-4dc1-8287-b586ba1c406c service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:13.742923 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e53815-ea69-4dc1-8287-b586ba1c406c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:13.744771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-83e53815-ea69-4dc1-8287-b586ba1c406c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:13.756805 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb359ffb044476bb25b0b99bb32ab87', 'request_id': 'req-da4327be-7d8d-4513-ae61-1ab7d84c997a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.766060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb359ffb044476bb25b0b99bb32ab87', 'request_id': 'req-da4327be-7d8d-4513-ae61-1ab7d84c997a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.790368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:13.803916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] The token cache is being invalidate because project cdb359ffb044476bb25b0b99bb32ab87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:13.804138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.804909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-da4327be-7d8d-4513-ae61-1ab7d84c997a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:13.806685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1139/2269] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:13 2022] DELETE /identity/v3/projects/cdb359ffb044476bb25b0b99bb32ab87 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:13.811038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34606b2-4234-4948-9fa4-7ef46aac0859 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:13.811325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34606b2-4234-4948-9fa4-7ef46aac0859 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:13.811858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34606b2-4234-4948-9fa4-7ef46aac0859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:13.832097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c34606b2-4234-4948-9fa4-7ef46aac0859 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:13.834019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c34606b2-4234-4948-9fa4-7ef46aac0859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:13.847377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e53815-ea69-4dc1-8287-b586ba1c406c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:13.849563 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e53815-ea69-4dc1-8287-b586ba1c406c service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:13.862267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1131/2270] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:13.863821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d84a-c6d9-4f4d-881f-4630b17788f3 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:13.864297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d84a-c6d9-4f4d-881f-4630b17788f3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:13.864599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d84a-c6d9-4f4d-881f-4630b17788f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:13.892864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5892d84a-c6d9-4f4d-881f-4630b17788f3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:13.894401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5892d84a-c6d9-4f4d-881f-4630b17788f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:13.899885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1140/2271] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:13.904939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1132/2272] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:13.911698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34606b2-4234-4948-9fa4-7ef46aac0859 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:13.913828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c34606b2-4234-4948-9fa4-7ef46aac0859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:13.919268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3849aa0-5416-4553-8042-481589d5dc6d None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:13.919268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3849aa0-5416-4553-8042-481589d5dc6d None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:13.919268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3849aa0-5416-4553-8042-481589d5dc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:13.952253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-d3849aa0-5416-4553-8042-481589d5dc6d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:13.953474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d3849aa0-5416-4553-8042-481589d5dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:13.963046 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1133/2273] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:13.963741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3849aa0-5416-4553-8042-481589d5dc6d None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:13.965024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d3849aa0-5416-4553-8042-481589d5dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:13.980178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3849aa0-5416-4553-8042-481589d5dc6d None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:13.985417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:13.991326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:13.991326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:13.991326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] PATH_INFO: `/v3/projects/4f7330db41b34dd3b429bfc4e842a8da` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:13.991326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7330db41b34dd3b429bfc4e842a8da)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:13.991713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34606b2-4234-4948-9fa4-7ef46aac0859 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:13.991800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:13.992682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d19ee-56c9-4690-a1ea-679a2d55085e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:13.993458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d19ee-56c9-4690-a1ea-679a2d55085e service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:13.993688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d19ee-56c9-4690-a1ea-679a2d55085e service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:13.993970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d19ee-56c9-4690-a1ea-679a2d55085e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.004994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d19ee-56c9-4690-a1ea-679a2d55085e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:14.006512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d19ee-56c9-4690-a1ea-679a2d55085e service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:14.018259 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1141/2274] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:14.020715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d19ee-56c9-4690-a1ea-679a2d55085e service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:14.030765 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d19ee-56c9-4690-a1ea-679a2d55085e service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:14.035989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568e389-7828-46be-9781-3df23aa0585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:14.036633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568e389-7828-46be-9781-3df23aa0585f admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.037003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568e389-7828-46be-9781-3df23aa0585f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.037280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568e389-7828-46be-9781-3df23aa0585f admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.037931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568e389-7828-46be-9781-3df23aa0585f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:14.038264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568e389-7828-46be-9781-3df23aa0585f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:14.039859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568e389-7828-46be-9781-3df23aa0585f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:14.052594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1142/2275] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:14.060834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568e389-7828-46be-9781-3df23aa0585f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:14.067815 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568e389-7828-46be-9781-3df23aa0585f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:14.078689 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22dc5-049f-4eea-bd5a-9e8dc4e5e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:14.079324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22dc5-049f-4eea-bd5a-9e8dc4e5e73f admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.079612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22dc5-049f-4eea-bd5a-9e8dc4e5e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.080269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22dc5-049f-4eea-bd5a-9e8dc4e5e73f admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.080531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf22dc5-049f-4eea-bd5a-9e8dc4e5e73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:14.089523 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf22dc5-049f-4eea-bd5a-9e8dc4e5e73f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:14.183095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7330db41b34dd3b429bfc4e842a8da', 'request_id': 'req-6d90819a-5e50-4a6e-a057-2d2cc20b530a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:14.193230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7330db41b34dd3b429bfc4e842a8da', 'request_id': 'req-6d90819a-5e50-4a6e-a057-2d2cc20b530a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:14.201181 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7330db41b34dd3b429bfc4e842a8da', 'request_id': 'req-6d90819a-5e50-4a6e-a057-2d2cc20b530a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:14.247300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1143/2276] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:14 2022] POST /identity/v3/projects => generated 359 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:14.251869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22dc5-049f-4eea-bd5a-9e8dc4e5e73f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:14.323909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22dc5-049f-4eea-bd5a-9e8dc4e5e73f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:14.325495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e5aaa-0a87-4601-b5af-93d827e5cbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:14.326451 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e5aaa-0a87-4601-b5af-93d827e5cbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.326826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e5aaa-0a87-4601-b5af-93d827e5cbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.327223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e5aaa-0a87-4601-b5af-93d827e5cbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.328048 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e5aaa-0a87-4601-b5af-93d827e5cbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:14.330076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e5aaa-0a87-4601-b5af-93d827e5cbd3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:14.362114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] The token cache is being invalidate because project 4f7330db41b34dd3b429bfc4e842a8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:14.362437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:14.363102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:14.364850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1134/2277] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:13 2022] DELETE /identity/v3/projects/4f7330db41b34dd3b429bfc4e842a8da => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:14.368359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:14.370177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:14.443529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90819a-5e50-4a6e-a057-2d2cc20b530a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:14.448599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:14.449259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.449533 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.449800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] PATH_INFO: `/v3/projects/dea89199b2b043349f1ee6c632ee7361` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.450952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea89199b2b043349f1ee6c632ee7361)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:14.452919 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:14.484851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1144/2278] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:14 2022] POST /identity/v3/users => generated 280 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:14.484851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502d2fd-4bd4-46a0-9676-2843621fea0c None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.484851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502d2fd-4bd4-46a0-9676-2843621fea0c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.485240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502d2fd-4bd4-46a0-9676-2843621fea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.504317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f502d2fd-4bd4-46a0-9676-2843621fea0c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:14.505515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f502d2fd-4bd4-46a0-9676-2843621fea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:14.513272 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1145/2279] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:14.514031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502d2fd-4bd4-46a0-9676-2843621fea0c None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:14.515347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f502d2fd-4bd4-46a0-9676-2843621fea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:14.527692 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502d2fd-4bd4-46a0-9676-2843621fea0c None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:14.536112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4b0bd-8302-4673-80a8-a5761709419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:14.536112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4b0bd-8302-4673-80a8-a5761709419e admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.536112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4b0bd-8302-4673-80a8-a5761709419e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.536112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4b0bd-8302-4673-80a8-a5761709419e admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.536616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4b0bd-8302-4673-80a8-a5761709419e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:14.537018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4b0bd-8302-4673-80a8-a5761709419e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:14.547180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1146/2280] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:14.548395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd04dcf-3b7f-40b5-bbfe-686f63c548cc None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.548696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd04dcf-3b7f-40b5-bbfe-686f63c548cc None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.548959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd04dcf-3b7f-40b5-bbfe-686f63c548cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.569320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-8bd04dcf-3b7f-40b5-bbfe-686f63c548cc None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:14.570492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8bd04dcf-3b7f-40b5-bbfe-686f63c548cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:14.579560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1147/2281] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:14.589872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd04dcf-3b7f-40b5-bbfe-686f63c548cc None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:14.590784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd04dcf-3b7f-40b5-bbfe-686f63c548cc None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:14.595504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e20ce-8d99-442b-9b72-4993e1f59c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:14.596107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e20ce-8d99-442b-9b72-4993e1f59c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.596394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e20ce-8d99-442b-9b72-4993e1f59c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.596669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e20ce-8d99-442b-9b72-4993e1f59c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.597324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e20ce-8d99-442b-9b72-4993e1f59c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:14.600105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e20ce-8d99-442b-9b72-4993e1f59c41 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:14.610638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1148/2282] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:14.611733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e20ce-8d99-442b-9b72-4993e1f59c41 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:14.633636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e20ce-8d99-442b-9b72-4993e1f59c41 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:14.633636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635218cf-0beb-4923-a2d6-b2502012d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:14.633636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635218cf-0beb-4923-a2d6-b2502012d97e admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.633636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635218cf-0beb-4923-a2d6-b2502012d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.634088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635218cf-0beb-4923-a2d6-b2502012d97e admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.634088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635218cf-0beb-4923-a2d6-b2502012d97e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:14.634088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635218cf-0beb-4923-a2d6-b2502012d97e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:14.634088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635218cf-0beb-4923-a2d6-b2502012d97e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:14.646483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1149/2283] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:14.647284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635218cf-0beb-4923-a2d6-b2502012d97e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:14.656769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635218cf-0beb-4923-a2d6-b2502012d97e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:14.662624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865806c-473f-4b20-9f21-9627aad000c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:14.663294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865806c-473f-4b20-9f21-9627aad000c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.663579 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865806c-473f-4b20-9f21-9627aad000c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.663857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865806c-473f-4b20-9f21-9627aad000c7 admin admin] PATH_INFO: `/v3/projects/6f59544c1c1947f3a51b809521b43687/users/c7b1d78944ba4e14b357ef36adf65d00/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.681311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865806c-473f-4b20-9f21-9627aad000c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f59544c1c1947f3a51b809521b43687, user_id=c7b1d78944ba4e14b357ef36adf65d00, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:14.684255 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865806c-473f-4b20-9f21-9627aad000c7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:14.907522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1150/2284] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:14 2022] PUT /identity/v3/projects/6f59544c1c1947f3a51b809521b43687/users/c7b1d78944ba4e14b357ef36adf65d00/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:14.908117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865806c-473f-4b20-9f21-9627aad000c7 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:14.920698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea89199b2b043349f1ee6c632ee7361', 'request_id': 'req-1466ef34-3980-49a0-8311-4f4bc84d5695'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:14.928848 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea89199b2b043349f1ee6c632ee7361', 'request_id': 'req-1466ef34-3980-49a0-8311-4f4bc84d5695'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:14.935227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea89199b2b043349f1ee6c632ee7361', 'request_id': 'req-1466ef34-3980-49a0-8311-4f4bc84d5695'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:14.977585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865806c-473f-4b20-9f21-9627aad000c7 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:14.982499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983ee07-5fa1-4b46-8fbb-84e734ee3f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:14.983104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ee07-5fa1-4b46-8fbb-84e734ee3f08 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:14.983386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ee07-5fa1-4b46-8fbb-84e734ee3f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:14.983727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ee07-5fa1-4b46-8fbb-84e734ee3f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:14.984556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983ee07-5fa1-4b46-8fbb-84e734ee3f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:14.986711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983ee07-5fa1-4b46-8fbb-84e734ee3f08 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:15.041620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] The token cache is being invalidate because project dea89199b2b043349f1ee6c632ee7361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:15.047981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:15.047981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:15.047981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1135/2285] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:14 2022] DELETE /identity/v3/projects/dea89199b2b043349f1ee6c632ee7361 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:15.047981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:15.047981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.114856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ef34-3980-49a0-8311-4f4bc84d5695 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:15.119634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:15.121464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.121464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.121464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] PATH_INFO: `/v3/projects/cbf2afbd0d5d4b65a519bc93f7b8d669` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.121949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf2afbd0d5d4b65a519bc93f7b8d669)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:15.123907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:15.158038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1151/2286] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:14 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:15.159452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd303e0-025d-4591-885a-d2f629c02f34 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.159741 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd303e0-025d-4591-885a-d2f629c02f34 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.160016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd303e0-025d-4591-885a-d2f629c02f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.209551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-bdd303e0-025d-4591-885a-d2f629c02f34 None None] MFA Rules not processed for user `c7b1d78944ba4e14b357ef36adf65d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:15.210802 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-bdd303e0-025d-4591-885a-d2f629c02f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.290130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1152/2287] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:15.293367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78ca77-1541-44b4-81d8-235a93ac9754 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.293578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78ca77-1541-44b4-81d8-235a93ac9754 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.293855 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78ca77-1541-44b4-81d8-235a93ac9754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.296248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf2afbd0d5d4b65a519bc93f7b8d669', 'request_id': 'req-3e7e7108-0f72-454a-97c6-9fd41f7fb399'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:15.316437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6c78ca77-1541-44b4-81d8-235a93ac9754 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:15.317969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6c78ca77-1541-44b4-81d8-235a93ac9754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.320708 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf2afbd0d5d4b65a519bc93f7b8d669', 'request_id': 'req-3e7e7108-0f72-454a-97c6-9fd41f7fb399'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:15.333687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf2afbd0d5d4b65a519bc93f7b8d669', 'request_id': 'req-3e7e7108-0f72-454a-97c6-9fd41f7fb399'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:15.384629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1153/2288] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:15.385494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78ca77-1541-44b4-81d8-235a93ac9754 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:15.386796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6c78ca77-1541-44b4-81d8-235a93ac9754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.398283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78ca77-1541-44b4-81d8-235a93ac9754 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:15.402905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d500b2-90ad-4af2-ac74-dd9e33c6ba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:15.408312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d500b2-90ad-4af2-ac74-dd9e33c6ba76 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.408312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d500b2-90ad-4af2-ac74-dd9e33c6ba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.408312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d500b2-90ad-4af2-ac74-dd9e33c6ba76 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.408312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d500b2-90ad-4af2-ac74-dd9e33c6ba76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:15.408312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d500b2-90ad-4af2-ac74-dd9e33c6ba76 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:15.470937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] The token cache is being invalidate because project cbf2afbd0d5d4b65a519bc93f7b8d669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:15.471360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:15.472141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:15.473851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1136/2289] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:15 2022] DELETE /identity/v3/projects/cbf2afbd0d5d4b65a519bc93f7b8d669 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:15.477345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:15.477345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.507491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1154/2290] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:15 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:15.508930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d887f3d-8463-4cdd-9147-5e21f2fa79e7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.509219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d887f3d-8463-4cdd-9147-5e21f2fa79e7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.509493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d887f3d-8463-4cdd-9147-5e21f2fa79e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.533243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-4d887f3d-8463-4cdd-9147-5e21f2fa79e7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:15.534540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4d887f3d-8463-4cdd-9147-5e21f2fa79e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.549722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1155/2291] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:15.551988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed37d9-e9d5-4994-87f7-216ea6054a9b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.552561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed37d9-e9d5-4994-87f7-216ea6054a9b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.556017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed37d9-e9d5-4994-87f7-216ea6054a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.560149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e7108-0f72-454a-97c6-9fd41f7fb399 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:15.565453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a91ec0-a3af-4ec6-80cd-0933ccdc48e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:15.566149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91ec0-a3af-4ec6-80cd-0933ccdc48e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.566456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91ec0-a3af-4ec6-80cd-0933ccdc48e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.567468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91ec0-a3af-4ec6-80cd-0933ccdc48e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.569356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-33a91ec0-a3af-4ec6-80cd-0933ccdc48e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.575625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e4ed37d9-e9d5-4994-87f7-216ea6054a9b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:15.576841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e4ed37d9-e9d5-4994-87f7-216ea6054a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.595751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1156/2292] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:15.596785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed37d9-e9d5-4994-87f7-216ea6054a9b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:15.599059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e4ed37d9-e9d5-4994-87f7-216ea6054a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.611220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed37d9-e9d5-4994-87f7-216ea6054a9b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:15.621147 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c5e72-77f4-4217-952a-001eaeff4a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:15.621455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c5e72-77f4-4217-952a-001eaeff4a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.621455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c5e72-77f4-4217-952a-001eaeff4a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.625122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c5e72-77f4-4217-952a-001eaeff4a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.625122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c5e72-77f4-4217-952a-001eaeff4a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:15.625122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c5e72-77f4-4217-952a-001eaeff4a46 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:15.638334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1157/2293] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:15.638334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c5e72-77f4-4217-952a-001eaeff4a46 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:15.652277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c5e72-77f4-4217-952a-001eaeff4a46 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:15.657863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd77e2-b0bc-462b-9d60-3095c44f6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:15.658598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd77e2-b0bc-462b-9d60-3095c44f6ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.659537 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd77e2-b0bc-462b-9d60-3095c44f6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.659993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd77e2-b0bc-462b-9d60-3095c44f6ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.661528 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd77e2-b0bc-462b-9d60-3095c44f6ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:15.662016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd77e2-b0bc-462b-9d60-3095c44f6ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:15.662609 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a91ec0-a3af-4ec6-80cd-0933ccdc48e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:15.663703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd77e2-b0bc-462b-9d60-3095c44f6ba7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:15.664409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a91ec0-a3af-4ec6-80cd-0933ccdc48e7 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:15.673913 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1137/2294] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:15.675355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5115-ba7c-49c8-8f9f-63f3077fe67e None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.675799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5115-ba7c-49c8-8f9f-63f3077fe67e None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.676279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e5115-ba7c-49c8-8f9f-63f3077fe67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.678466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1158/2295] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:15.679569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd77e2-b0bc-462b-9d60-3095c44f6ba7 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:15.695430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd77e2-b0bc-462b-9d60-3095c44f6ba7 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:15.701606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2319dd-30ad-49a0-96bc-a8e464a2499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:15.702248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2319dd-30ad-49a0-96bc-a8e464a2499c admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.702552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2319dd-30ad-49a0-96bc-a8e464a2499c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.702824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2319dd-30ad-49a0-96bc-a8e464a2499c admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.703504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2319dd-30ad-49a0-96bc-a8e464a2499c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:15.705217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2319dd-30ad-49a0-96bc-a8e464a2499c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:15.708886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-440e5115-ba7c-49c8-8f9f-63f3077fe67e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:15.710267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-440e5115-ba7c-49c8-8f9f-63f3077fe67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.715687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1159/2296] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:15.716498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2319dd-30ad-49a0-96bc-a8e464a2499c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:15.728424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2319dd-30ad-49a0-96bc-a8e464a2499c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:15.728725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1138/2297] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:15.729903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e5115-ba7c-49c8-8f9f-63f3077fe67e None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:15.731496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-440e5115-ba7c-49c8-8f9f-63f3077fe67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:15.743927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7ca5a-d0bf-458c-9b51-22a2faefd019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:15.744560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ca5a-d0bf-458c-9b51-22a2faefd019 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.744891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ca5a-d0bf-458c-9b51-22a2faefd019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.745170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7ca5a-d0bf-458c-9b51-22a2faefd019 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.745812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7ca5a-d0bf-458c-9b51-22a2faefd019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:15.747751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7ca5a-d0bf-458c-9b51-22a2faefd019 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:15.748274 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e5115-ba7c-49c8-8f9f-63f3077fe67e None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:15.753636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:15.755252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.755744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.756213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] PATH_INFO: `/v3/users/c7b1d78944ba4e14b357ef36adf65d00` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:15.757571 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b1d78944ba4e14b357ef36adf65d00)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:15.759911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:15.896491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1160/2298] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:15 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:15.897403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7ca5a-d0bf-458c-9b51-22a2faefd019 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:15.978985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7ca5a-d0bf-458c-9b51-22a2faefd019 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:15.984938 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26a092-ee28-4812-ac63-947d649d11de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:15.985425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26a092-ee28-4812-ac63-947d649d11de admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:15.985832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26a092-ee28-4812-ac63-947d649d11de admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:15.986110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26a092-ee28-4812-ac63-947d649d11de admin admin] PATH_INFO: `/v3/projects/d7a1dc4384f2490b8489517ea72fead9/users/166dc228445248aca173b2e5ee72c5d0/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.004016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26a092-ee28-4812-ac63-947d649d11de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a1dc4384f2490b8489517ea72fead9, user_id=166dc228445248aca173b2e5ee72c5d0, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.007994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26a092-ee28-4812-ac63-947d649d11de admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.028170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b1d78944ba4e14b357ef36adf65d00'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:16.043775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b1d78944ba4e14b357ef36adf65d00'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:16.056889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b1d78944ba4e14b357ef36adf65d00'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:16.111457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1161/2299] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:15 2022] PUT /identity/v3/projects/d7a1dc4384f2490b8489517ea72fead9/users/166dc228445248aca173b2e5ee72c5d0/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:16.112938 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26a092-ee28-4812-ac63-947d649d11de admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.168529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b1d78944ba4e14b357ef36adf65d00'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:16.169154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b1d78944ba4e14b357ef36adf65d00'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:16.175684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1139/2300] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:15 2022] DELETE /identity/v3/users/c7b1d78944ba4e14b357ef36adf65d00 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:16.178002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.179342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:16.179469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26a092-ee28-4812-ac63-947d649d11de admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.198494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:16.242764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524de3d1-b551-4c8f-8b2d-157beed594ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.243446 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de3d1-b551-4c8f-8b2d-157beed594ad admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.243732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de3d1-b551-4c8f-8b2d-157beed594ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.244007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524de3d1-b551-4c8f-8b2d-157beed594ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.244663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524de3d1-b551-4c8f-8b2d-157beed594ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:16.244972 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524de3d1-b551-4c8f-8b2d-157beed594ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.246615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524de3d1-b551-4c8f-8b2d-157beed594ad admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.254761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615c621-c9ff-4f04-8ff2-a4ae67f4b6a7 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.262376 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1162/2301] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:16.262521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9956306-82a2-425c-a007-6b653d28f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.262521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9956306-82a2-425c-a007-6b653d28f14f admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.262738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd6af6-0015-47f7-821f-e8eec909c55b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.262820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9956306-82a2-425c-a007-6b653d28f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.262893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd6af6-0015-47f7-821f-e8eec909c55b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.262978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9956306-82a2-425c-a007-6b653d28f14f admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.263105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd6af6-0015-47f7-821f-e8eec909c55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.263201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9956306-82a2-425c-a007-6b653d28f14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.263286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9956306-82a2-425c-a007-6b653d28f14f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.290932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-8dbd6af6-0015-47f7-821f-e8eec909c55b None None] MFA Rules not processed for user `166dc228445248aca173b2e5ee72c5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:16.292138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8dbd6af6-0015-47f7-821f-e8eec909c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:16.356274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1163/2302] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:16.357942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd708ee-6196-4946-9ccf-f2f8bf85bd21 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.358583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd708ee-6196-4946-9ccf-f2f8bf85bd21 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.358864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd708ee-6196-4946-9ccf-f2f8bf85bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.364140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1140/2303] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:16 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:16.364984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9956306-82a2-425c-a007-6b653d28f14f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.371401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f9956306-82a2-425c-a007-6b653d28f14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:16.378121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6cd708ee-6196-4946-9ccf-f2f8bf85bd21 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:16.379990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6cd708ee-6196-4946-9ccf-f2f8bf85bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:16.384471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9956306-82a2-425c-a007-6b653d28f14f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.388512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1164/2304] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:16.389284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd708ee-6196-4946-9ccf-f2f8bf85bd21 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.392414 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225682d-e295-4b52-885a-c477c5735c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.393123 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225682d-e295-4b52-885a-c477c5735c82 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.393405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225682d-e295-4b52-885a-c477c5735c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.393675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225682d-e295-4b52-885a-c477c5735c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.394682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225682d-e295-4b52-885a-c477c5735c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.398139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225682d-e295-4b52-885a-c477c5735c82 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.400283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd708ee-6196-4946-9ccf-f2f8bf85bd21 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.405023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0905e9f-10de-4ec1-b094-eb94a481bea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.405653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0905e9f-10de-4ec1-b094-eb94a481bea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.405931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0905e9f-10de-4ec1-b094-eb94a481bea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.406203 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0905e9f-10de-4ec1-b094-eb94a481bea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.406892 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0905e9f-10de-4ec1-b094-eb94a481bea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.408845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0905e9f-10de-4ec1-b094-eb94a481bea4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.419702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1165/2305] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:16.420656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0905e9f-10de-4ec1-b094-eb94a481bea4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.422507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b0905e9f-10de-4ec1-b094-eb94a481bea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:16.475891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:16.479501 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0905e9f-10de-4ec1-b094-eb94a481bea4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.483276 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f6c87-78d4-4ee0-809e-63aa2fc79718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.483891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f6c87-78d4-4ee0-809e-63aa2fc79718 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.484171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f6c87-78d4-4ee0-809e-63aa2fc79718 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.484448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f6c87-78d4-4ee0-809e-63aa2fc79718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.493078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f6c87-78d4-4ee0-809e-63aa2fc79718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.494542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f6c87-78d4-4ee0-809e-63aa2fc79718 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.503372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1166/2306] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:16.507155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f6c87-78d4-4ee0-809e-63aa2fc79718 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.507155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-097f6c87-78d4-4ee0-809e-63aa2fc79718 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:16.540196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1141/2307] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:16 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:16.541450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225682d-e295-4b52-885a-c477c5735c82 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.569250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f6c87-78d4-4ee0-809e-63aa2fc79718 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.623868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225682d-e295-4b52-885a-c477c5735c82 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.632254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406cac0-3fd5-401d-9899-8d37d7011ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.632635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614eb0b-5611-4040-bac4-f4a9e240a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.633113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406cac0-3fd5-401d-9899-8d37d7011ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.633238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614eb0b-5611-4040-bac4-f4a9e240a2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.633427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406cac0-3fd5-401d-9899-8d37d7011ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.633598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614eb0b-5611-4040-bac4-f4a9e240a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.633694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406cac0-3fd5-401d-9899-8d37d7011ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.633853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614eb0b-5611-4040-bac4-f4a9e240a2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.634791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614eb0b-5611-4040-bac4-f4a9e240a2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.636453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614eb0b-5611-4040-bac4-f4a9e240a2a1 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.643508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406cac0-3fd5-401d-9899-8d37d7011ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.645513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406cac0-3fd5-401d-9899-8d37d7011ac8 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.651213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1142/2308] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:16.651213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614eb0b-5611-4040-bac4-f4a9e240a2a1 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.658674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1167/2309] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:16.658674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406cac0-3fd5-401d-9899-8d37d7011ac8 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.658857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614eb0b-5611-4040-bac4-f4a9e240a2a1 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.664190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ce4f-4f99-4e0a-b250-09f22ad10aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.664794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ce4f-4f99-4e0a-b250-09f22ad10aed admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.665074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ce4f-4f99-4e0a-b250-09f22ad10aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.665344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ce4f-4f99-4e0a-b250-09f22ad10aed admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.665497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406cac0-3fd5-401d-9899-8d37d7011ac8 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.665975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ce4f-4f99-4e0a-b250-09f22ad10aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.668031 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ce4f-4f99-4e0a-b250-09f22ad10aed admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.670308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4773d-5de7-40b8-84ea-dd59360603ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.670898 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4773d-5de7-40b8-84ea-dd59360603ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.671182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4773d-5de7-40b8-84ea-dd59360603ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.671458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4773d-5de7-40b8-84ea-dd59360603ce admin admin] PATH_INFO: `/v3/projects/3d469e90d97f4585b2a277aca87f5d3c/users/1ffdd65c7a1b4147a4e380a71794f600/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.687171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4773d-5de7-40b8-84ea-dd59360603ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d469e90d97f4585b2a277aca87f5d3c, user_id=1ffdd65c7a1b4147a4e380a71794f600, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.689725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4773d-5de7-40b8-84ea-dd59360603ce admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.783292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1143/2310] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:16 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:16.784541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ce4f-4f99-4e0a-b250-09f22ad10aed admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.794474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ce4f-4f99-4e0a-b250-09f22ad10aed admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.799219 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40212fdc-2068-4a8e-81a2-56ecb3eed049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.799807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212fdc-2068-4a8e-81a2-56ecb3eed049 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.800084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212fdc-2068-4a8e-81a2-56ecb3eed049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.800353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212fdc-2068-4a8e-81a2-56ecb3eed049 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.802194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40212fdc-2068-4a8e-81a2-56ecb3eed049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.803812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40212fdc-2068-4a8e-81a2-56ecb3eed049 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.817449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1144/2311] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:16.821634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40212fdc-2068-4a8e-81a2-56ecb3eed049 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.831809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40212fdc-2068-4a8e-81a2-56ecb3eed049 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.841884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423bfdb-a4ba-4ee5-a3de-af2a8a36bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.841884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423bfdb-a4ba-4ee5-a3de-af2a8a36bc7a admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.841884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423bfdb-a4ba-4ee5-a3de-af2a8a36bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.841884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423bfdb-a4ba-4ee5-a3de-af2a8a36bc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.842285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423bfdb-a4ba-4ee5-a3de-af2a8a36bc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.842285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423bfdb-a4ba-4ee5-a3de-af2a8a36bc7a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:16.851183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1145/2312] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:10:16.856469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423bfdb-a4ba-4ee5-a3de-af2a8a36bc7a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:16.870866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423bfdb-a4ba-4ee5-a3de-af2a8a36bc7a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:16.879774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1168/2313] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:16 2022] PUT /identity/v3/projects/3d469e90d97f4585b2a277aca87f5d3c/users/1ffdd65c7a1b4147a4e380a71794f600/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:16.897448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40effb-761a-48ce-9b10-39963ab9813b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.897731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40effb-761a-48ce-9b10-39963ab9813b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.898003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40effb-761a-48ce-9b10-39963ab9813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.929055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6d40effb-761a-48ce-9b10-39963ab9813b None None] MFA Rules not processed for user `1ffdd65c7a1b4147a4e380a71794f600`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:16.929877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6d40effb-761a-48ce-9b10-39963ab9813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:16.946875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3720-6b25-4620-9cf6-3fc4c5114d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:16.947554 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3720-6b25-4620-9cf6-3fc4c5114d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:16.951479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3720-6b25-4620-9cf6-3fc4c5114d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:16.951479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3720-6b25-4620-9cf6-3fc4c5114d1b admin admin] PATH_INFO: `/v3/projects/c9c7f4245fa348458c566b5f3b7bba35/users/3b01d47ddfd64e8d82f55ab24a126ddc/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:16.966848 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d3720-6b25-4620-9cf6-3fc4c5114d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c7f4245fa348458c566b5f3b7bba35, user_id=3b01d47ddfd64e8d82f55ab24a126ddc, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:16.969624 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d3720-6b25-4620-9cf6-3fc4c5114d1b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:17.002263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1169/2314] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:17.003721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40effb-761a-48ce-9b10-39963ab9813b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:17.014952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40effb-761a-48ce-9b10-39963ab9813b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:17.019658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588411b-b7d6-4382-a8e9-220351f7d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:17.020310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588411b-b7d6-4382-a8e9-220351f7d74f admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.020632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588411b-b7d6-4382-a8e9-220351f7d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.020907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588411b-b7d6-4382-a8e9-220351f7d74f admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.021573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588411b-b7d6-4382-a8e9-220351f7d74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:17.023496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588411b-b7d6-4382-a8e9-220351f7d74f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:17.090259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1146/2315] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:16 2022] PUT /identity/v3/projects/c9c7f4245fa348458c566b5f3b7bba35/users/3b01d47ddfd64e8d82f55ab24a126ddc/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:17.098858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0638f9-bb62-4efd-9bb4-c0a3befd5ec4 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.099404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0638f9-bb62-4efd-9bb4-c0a3befd5ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.099831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0638f9-bb62-4efd-9bb4-c0a3befd5ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.126486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1170/2316] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:17 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:17.130627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588411b-b7d6-4382-a8e9-220351f7d74f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:17.141684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6d0638f9-bb62-4efd-9bb4-c0a3befd5ec4 None None] MFA Rules not processed for user `3b01d47ddfd64e8d82f55ab24a126ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:17.143050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6d0638f9-bb62-4efd-9bb4-c0a3befd5ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:17.231462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588411b-b7d6-4382-a8e9-220351f7d74f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:17.236656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1f55e-c79c-467e-afa3-f56b95a49c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:17.237750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1f55e-c79c-467e-afa3-f56b95a49c5e admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.238135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1f55e-c79c-467e-afa3-f56b95a49c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.238639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1f55e-c79c-467e-afa3-f56b95a49c5e admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.240055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1f55e-c79c-467e-afa3-f56b95a49c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:17.241906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1147/2317] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:17.242068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1f55e-c79c-467e-afa3-f56b95a49c5e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:17.246384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0638f9-bb62-4efd-9bb4-c0a3befd5ec4 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:17.247894 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6d0638f9-bb62-4efd-9bb4-c0a3befd5ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:17.263546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0638f9-bb62-4efd-9bb4-c0a3befd5ec4 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:17.277813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:17.280606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.281089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.281636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] PATH_INFO: `/v3/projects/6f59544c1c1947f3a51b809521b43687` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.285239 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f59544c1c1947f3a51b809521b43687)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:17.288935 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:17.373936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1171/2318] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:17 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:17.373936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1f55e-c79c-467e-afa3-f56b95a49c5e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:17.396085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1f55e-c79c-467e-afa3-f56b95a49c5e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:17.418271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28209-2562-4a65-9fbb-695e403131b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:17.418271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28209-2562-4a65-9fbb-695e403131b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.418271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28209-2562-4a65-9fbb-695e403131b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.418271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28209-2562-4a65-9fbb-695e403131b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.418711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba28209-2562-4a65-9fbb-695e403131b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:17.418711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba28209-2562-4a65-9fbb-695e403131b5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:17.479420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f59544c1c1947f3a51b809521b43687', 'request_id': 'req-54caadca-da67-49d3-958d-d4afc8b5dbc5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:17.485885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f59544c1c1947f3a51b809521b43687', 'request_id': 'req-54caadca-da67-49d3-958d-d4afc8b5dbc5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:17.492203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f59544c1c1947f3a51b809521b43687', 'request_id': 'req-54caadca-da67-49d3-958d-d4afc8b5dbc5'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:17.552093 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1172/2319] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:17 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:17.553459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28209-2562-4a65-9fbb-695e403131b5 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:17.637495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] The token cache is being invalidate because project 6f59544c1c1947f3a51b809521b43687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:17.637821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:17.638573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:17.641490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28209-2562-4a65-9fbb-695e403131b5 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:17.646051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1148/2320] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:17 2022] DELETE /identity/v3/projects/6f59544c1c1947f3a51b809521b43687 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:17.646778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:17.648243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:17.651816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848cf46-420a-4de3-a87b-d890031e7910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:17.652456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848cf46-420a-4de3-a87b-d890031e7910 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.652744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848cf46-420a-4de3-a87b-d890031e7910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.653023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848cf46-420a-4de3-a87b-d890031e7910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.653680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848cf46-420a-4de3-a87b-d890031e7910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:17.655470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848cf46-420a-4de3-a87b-d890031e7910 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:17.673877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1173/2321] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:17.673877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c572e7-3d79-43e7-9063-88d4ff7aa77c None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.673877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c572e7-3d79-43e7-9063-88d4ff7aa77c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.673877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c572e7-3d79-43e7-9063-88d4ff7aa77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.697051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d7c572e7-3d79-43e7-9063-88d4ff7aa77c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:17.699249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d7c572e7-3d79-43e7-9063-88d4ff7aa77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:17.711028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1174/2322] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:17.712252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c572e7-3d79-43e7-9063-88d4ff7aa77c None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:17.713753 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d7c572e7-3d79-43e7-9063-88d4ff7aa77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:17.726883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c572e7-3d79-43e7-9063-88d4ff7aa77c None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:17.731901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b053325-3bf8-49ff-ab9b-cb2213e11d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:17.732987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b053325-3bf8-49ff-ab9b-cb2213e11d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.733434 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b053325-3bf8-49ff-ab9b-cb2213e11d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.733916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b053325-3bf8-49ff-ab9b-cb2213e11d69 admin admin] PATH_INFO: `/v3/projects/0b1cecc97c8142bfbf343ae210e33a4f/users/580c150629724c93b5e7eb32d421d73f/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.741549 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caadca-da67-49d3-958d-d4afc8b5dbc5 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:17.748186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb31ca-5965-42e5-9d3b-0662108cc099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:17.748876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb31ca-5965-42e5-9d3b-0662108cc099 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.749355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb31ca-5965-42e5-9d3b-0662108cc099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.749613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb31ca-5965-42e5-9d3b-0662108cc099 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.750528 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb31ca-5965-42e5-9d3b-0662108cc099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:17.752862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb31ca-5965-42e5-9d3b-0662108cc099 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:17.753390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b053325-3bf8-49ff-ab9b-cb2213e11d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1cecc97c8142bfbf343ae210e33a4f, user_id=580c150629724c93b5e7eb32d421d73f, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:17.757139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b053325-3bf8-49ff-ab9b-cb2213e11d69 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:17.860216 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1149/2323] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:17 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:17.861565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f070c-e698-41fd-be57-41e61a9e7e40 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.861851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f070c-e698-41fd-be57-41e61a9e7e40 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.862188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f070c-e698-41fd-be57-41e61a9e7e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.866554 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1175/2324] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:17 2022] PUT /identity/v3/projects/0b1cecc97c8142bfbf343ae210e33a4f/users/580c150629724c93b5e7eb32d421d73f/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:17.867439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b053325-3bf8-49ff-ab9b-cb2213e11d69 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:17.889427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c87f070c-e698-41fd-be57-41e61a9e7e40 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:17.891357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c87f070c-e698-41fd-be57-41e61a9e7e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:17.950608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b053325-3bf8-49ff-ab9b-cb2213e11d69 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:17.955114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c607b8c-df88-4f62-8fe2-e78cd6c5853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:17.957643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c607b8c-df88-4f62-8fe2-e78cd6c5853d admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.957643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c607b8c-df88-4f62-8fe2-e78cd6c5853d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.957643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c607b8c-df88-4f62-8fe2-e78cd6c5853d admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.957643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c607b8c-df88-4f62-8fe2-e78cd6c5853d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:17.959384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c607b8c-df88-4f62-8fe2-e78cd6c5853d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:17.973903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1176/2325] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:17.973903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c607b8c-df88-4f62-8fe2-e78cd6c5853d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:17.985192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c607b8c-df88-4f62-8fe2-e78cd6c5853d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:17.989669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1150/2326] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:17.990655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f070c-e698-41fd-be57-41e61a9e7e40 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:17.992327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a6bc9-9e11-4af6-a90a-4e8960dbef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:17.993081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a6bc9-9e11-4af6-a90a-4e8960dbef30 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:17.993373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a6bc9-9e11-4af6-a90a-4e8960dbef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:17.993932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a6bc9-9e11-4af6-a90a-4e8960dbef30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:17.994784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a6bc9-9e11-4af6-a90a-4e8960dbef30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:17.996697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a6bc9-9e11-4af6-a90a-4e8960dbef30 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.005140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f070c-e698-41fd-be57-41e61a9e7e40 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.010034 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab94a21-b14b-4c0c-a344-0525c97b6c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.017897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94a21-b14b-4c0c-a344-0525c97b6c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.017897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94a21-b14b-4c0c-a344-0525c97b6c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.017897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94a21-b14b-4c0c-a344-0525c97b6c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.017897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab94a21-b14b-4c0c-a344-0525c97b6c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.017897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab94a21-b14b-4c0c-a344-0525c97b6c17 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.018307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1177/2327] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:18.019999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a6bc9-9e11-4af6-a90a-4e8960dbef30 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.026023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1151/2328] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:18.027041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab94a21-b14b-4c0c-a344-0525c97b6c17 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.033363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a6bc9-9e11-4af6-a90a-4e8960dbef30 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.038907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab94a21-b14b-4c0c-a344-0525c97b6c17 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.044343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa1ad-d221-4c67-b4c9-59410c8f6808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.048265 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a290c87-5538-4287-a6ee-9dd365ca8969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.048496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa1ad-d221-4c67-b4c9-59410c8f6808 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.048600 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290c87-5538-4287-a6ee-9dd365ca8969 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.048678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa1ad-d221-4c67-b4c9-59410c8f6808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.048678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fa1ad-d221-4c67-b4c9-59410c8f6808 admin admin] PATH_INFO: `/v3/projects/0b1cecc97c8142bfbf343ae210e33a4f/users/580c150629724c93b5e7eb32d421d73f/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.048811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290c87-5538-4287-a6ee-9dd365ca8969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.048811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a290c87-5538-4287-a6ee-9dd365ca8969 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.048811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a290c87-5538-4287-a6ee-9dd365ca8969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:18.048811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a290c87-5538-4287-a6ee-9dd365ca8969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.050076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a290c87-5538-4287-a6ee-9dd365ca8969 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.050497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa1ad-d221-4c67-b4c9-59410c8f6808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1cecc97c8142bfbf343ae210e33a4f, user_id=580c150629724c93b5e7eb32d421d73f, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.054415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fa1ad-d221-4c67-b4c9-59410c8f6808 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.067069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1152/2329] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:18 2022] PUT /identity/v3/projects/0b1cecc97c8142bfbf343ae210e33a4f/users/580c150629724c93b5e7eb32d421d73f/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:18.068074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa1ad-d221-4c67-b4c9-59410c8f6808 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.075413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1178/2330] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:18.078471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30686b6-2ff0-467d-89b4-8996f547dc74 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.084924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30686b6-2ff0-467d-89b4-8996f547dc74 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.084924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30686b6-2ff0-467d-89b4-8996f547dc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.114755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c30686b6-2ff0-467d-89b4-8996f547dc74 None None] MFA Rules not processed for user `580c150629724c93b5e7eb32d421d73f`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:18.116150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c30686b6-2ff0-467d-89b4-8996f547dc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:18.144940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fa1ad-d221-4c67-b4c9-59410c8f6808 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.150037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c49a48-5a6f-475b-9aee-33adb8479094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.150731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c49a48-5a6f-475b-9aee-33adb8479094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.151062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c49a48-5a6f-475b-9aee-33adb8479094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.151534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c49a48-5a6f-475b-9aee-33adb8479094 admin admin] PATH_INFO: `/v3/projects/b499723e8fcf4017ae0797b0437e3ca3/users/b1a5072da134452d974bd18352765b12/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.155208 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:18.173858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c49a48-5a6f-475b-9aee-33adb8479094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b499723e8fcf4017ae0797b0437e3ca3, user_id=b1a5072da134452d974bd18352765b12, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.177406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c49a48-5a6f-475b-9aee-33adb8479094 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.199720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1179/2331] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:18.200566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30686b6-2ff0-467d-89b4-8996f547dc74 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.214382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30686b6-2ff0-467d-89b4-8996f547dc74 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.221065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd985ac-355e-412e-bf33-0b66a8234a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.221704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd985ac-355e-412e-bf33-0b66a8234a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.221994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd985ac-355e-412e-bf33-0b66a8234a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.222293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd985ac-355e-412e-bf33-0b66a8234a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.223675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd985ac-355e-412e-bf33-0b66a8234a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.225921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd985ac-355e-412e-bf33-0b66a8234a8c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.347067 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1153/2332] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:18 2022] PUT /identity/v3/projects/b499723e8fcf4017ae0797b0437e3ca3/users/b1a5072da134452d974bd18352765b12/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:18.348586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c49a48-5a6f-475b-9aee-33adb8479094 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.350478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c1c49a48-5a6f-475b-9aee-33adb8479094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:18.382311 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1180/2333] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:18 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:18.386163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420f18-f382-49c3-971e-24407957b807 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.386565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420f18-f382-49c3-971e-24407957b807 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.387134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420f18-f382-49c3-971e-24407957b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.423196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-88420f18-f382-49c3-971e-24407957b807 None None] MFA Rules not processed for user `b1a5072da134452d974bd18352765b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:18.423803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c49a48-5a6f-475b-9aee-33adb8479094 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.424672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-88420f18-f382-49c3-971e-24407957b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:18.492874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab01542-a0bc-4bc8-b911-48a1f17358b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.493594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab01542-a0bc-4bc8-b911-48a1f17358b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.493925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab01542-a0bc-4bc8-b911-48a1f17358b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.494309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab01542-a0bc-4bc8-b911-48a1f17358b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.511415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1181/2334] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:18.511415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88420f18-f382-49c3-971e-24407957b807 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.619796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab01542-a0bc-4bc8-b911-48a1f17358b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.621404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab01542-a0bc-4bc8-b911-48a1f17358b9 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.622248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88420f18-f382-49c3-971e-24407957b807 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.628774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f419f7c-2468-4117-bcdd-b57c4f795e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.630057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f419f7c-2468-4117-bcdd-b57c4f795e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.630679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f419f7c-2468-4117-bcdd-b57c4f795e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.631057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f419f7c-2468-4117-bcdd-b57c4f795e0d admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.634780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f419f7c-2468-4117-bcdd-b57c4f795e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.638261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f419f7c-2468-4117-bcdd-b57c4f795e0d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.655426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1154/2335] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:18.656321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab01542-a0bc-4bc8-b911-48a1f17358b9 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.673381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab01542-a0bc-4bc8-b911-48a1f17358b9 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.689567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63396541-22bc-4360-8a05-b1b9e33bbefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.689567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63396541-22bc-4360-8a05-b1b9e33bbefb admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.690550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:18.691856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63396541-22bc-4360-8a05-b1b9e33bbefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.692302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63396541-22bc-4360-8a05-b1b9e33bbefb admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.693056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63396541-22bc-4360-8a05-b1b9e33bbefb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.695160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63396541-22bc-4360-8a05-b1b9e33bbefb admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.759896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1182/2336] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:18 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:18.765852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f419f7c-2468-4117-bcdd-b57c4f795e0d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.776528 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f419f7c-2468-4117-bcdd-b57c4f795e0d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.782148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c208925-a6b0-4edd-8a3a-a09822cc22d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.782784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c208925-a6b0-4edd-8a3a-a09822cc22d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.783080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c208925-a6b0-4edd-8a3a-a09822cc22d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.783891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c208925-a6b0-4edd-8a3a-a09822cc22d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.784057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c208925-a6b0-4edd-8a3a-a09822cc22d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.786278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c208925-a6b0-4edd-8a3a-a09822cc22d2 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.796529 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1183/2337] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:18.800463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c208925-a6b0-4edd-8a3a-a09822cc22d2 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.811253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c208925-a6b0-4edd-8a3a-a09822cc22d2 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.817517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c45f3-7386-4544-af21-2fe76e3cbdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.818539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c45f3-7386-4544-af21-2fe76e3cbdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.818893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c45f3-7386-4544-af21-2fe76e3cbdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.819173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c45f3-7386-4544-af21-2fe76e3cbdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.819828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c45f3-7386-4544-af21-2fe76e3cbdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.821728 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c45f3-7386-4544-af21-2fe76e3cbdc8 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.835071 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1184/2338] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:18.839140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c45f3-7386-4544-af21-2fe76e3cbdc8 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.852612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c45f3-7386-4544-af21-2fe76e3cbdc8 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.859999 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1155/2339] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:18 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:18.861881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0e7e1-d78d-4450-bf0f-ef9aa97b63fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.861881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0e7e1-d78d-4450-bf0f-ef9aa97b63fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.861881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0e7e1-d78d-4450-bf0f-ef9aa97b63fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.861881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0e7e1-d78d-4450-bf0f-ef9aa97b63fc admin admin] PATH_INFO: `/v3/projects/34660b6e4173413cb7d8246be57985b4/users/9cda862737604dda9c80060b61542fe9/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.865484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63396541-22bc-4360-8a05-b1b9e33bbefb admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:18.888793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0e7e1-d78d-4450-bf0f-ef9aa97b63fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=34660b6e4173413cb7d8246be57985b4, user_id=9cda862737604dda9c80060b61542fe9, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.891656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0e7e1-d78d-4450-bf0f-ef9aa97b63fc admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.963351 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63396541-22bc-4360-8a05-b1b9e33bbefb admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:18.968628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06bf70-89eb-4f1c-9933-28aeaf274a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:18.969394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06bf70-89eb-4f1c-9933-28aeaf274a84 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:18.969740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06bf70-89eb-4f1c-9933-28aeaf274a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:18.970026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06bf70-89eb-4f1c-9933-28aeaf274a84 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:18.970807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06bf70-89eb-4f1c-9933-28aeaf274a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:18.972871 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06bf70-89eb-4f1c-9933-28aeaf274a84 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:18.993431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1185/2340] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:18 2022] PUT /identity/v3/projects/34660b6e4173413cb7d8246be57985b4/users/9cda862737604dda9c80060b61542fe9/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:19.006694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7363aa-2c9f-4af2-927b-b44317f351a6 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:19.010959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7363aa-2c9f-4af2-927b-b44317f351a6 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:19.010959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7363aa-2c9f-4af2-927b-b44317f351a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:19.042278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-ec7363aa-2c9f-4af2-927b-b44317f351a6 None None] MFA Rules not processed for user `9cda862737604dda9c80060b61542fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:19.043505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ec7363aa-2c9f-4af2-927b-b44317f351a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:19.119726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1156/2341] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:18 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:19.123850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06bf70-89eb-4f1c-9933-28aeaf274a84 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:19.135214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1186/2342] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:19.139924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06bf70-89eb-4f1c-9933-28aeaf274a84 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:19.146608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7363aa-2c9f-4af2-927b-b44317f351a6 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:19.148111 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ec7363aa-2c9f-4af2-927b-b44317f351a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:19.211249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7363aa-2c9f-4af2-927b-b44317f351a6 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:19.213573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9d08-6668-4495-b0a4-9305a1a581c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:19.214790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9d08-6668-4495-b0a4-9305a1a581c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:19.215142 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9d08-6668-4495-b0a4-9305a1a581c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:19.215253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f11fc1-c2fc-4360-b2f8-5dba74f3e52a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:19.215541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9d08-6668-4495-b0a4-9305a1a581c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:19.215859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11fc1-c2fc-4360-b2f8-5dba74f3e52a service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:19.216195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11fc1-c2fc-4360-b2f8-5dba74f3e52a service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:19.216470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11fc1-c2fc-4360-b2f8-5dba74f3e52a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:19.216586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f9d08-6668-4495-b0a4-9305a1a581c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:19.219077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f9d08-6668-4495-b0a4-9305a1a581c4 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:19.225801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f11fc1-c2fc-4360-b2f8-5dba74f3e52a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:19.230852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f11fc1-c2fc-4360-b2f8-5dba74f3e52a service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:19.230975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1157/2343] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:19.233589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9d08-6668-4495-b0a4-9305a1a581c4 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:19.236363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1187/2344] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:19.243989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9d08-6668-4495-b0a4-9305a1a581c4 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:19.248593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd52a4-dcab-4cdd-b1f4-09604a8346c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:19.249236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd52a4-dcab-4cdd-b1f4-09604a8346c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:19.249514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd52a4-dcab-4cdd-b1f4-09604a8346c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:19.249785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd52a4-dcab-4cdd-b1f4-09604a8346c7 admin admin] PATH_INFO: `/v3/projects/8042bdef00244122a8be8adc002a65f8/users/2410c1303318400f989d806973872728/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:19.263088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f11fc1-c2fc-4360-b2f8-5dba74f3e52a service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:19.265828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd52a4-dcab-4cdd-b1f4-09604a8346c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8042bdef00244122a8be8adc002a65f8, user_id=2410c1303318400f989d806973872728, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:19.268584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd52a4-dcab-4cdd-b1f4-09604a8346c7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:19.274384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f11fc1-c2fc-4360-b2f8-5dba74f3e52a service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:19.279066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:19.279902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:19.280184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:19.280483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] PATH_INFO: `/v3/users/9cda862737604dda9c80060b61542fe9` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:19.281618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cda862737604dda9c80060b61542fe9)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:19.283888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:19.373076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1158/2345] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:19 2022] PUT /identity/v3/projects/8042bdef00244122a8be8adc002a65f8/users/2410c1303318400f989d806973872728/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:19.377320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd52a4-dcab-4cdd-b1f4-09604a8346c7 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:19.450757 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd52a4-dcab-4cdd-b1f4-09604a8346c7 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:19.456305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:19.463127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:19.463127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:19.463127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] PATH_INFO: `/v3/users/1ffdd65c7a1b4147a4e380a71794f600` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:19.463127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ffdd65c7a1b4147a4e380a71794f600)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:19.463127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:19.530041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cda862737604dda9c80060b61542fe9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:19.530738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cda862737604dda9c80060b61542fe9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:19.538339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cda862737604dda9c80060b61542fe9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:19.550378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cda862737604dda9c80060b61542fe9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:19.552960 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cda862737604dda9c80060b61542fe9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:19.717493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1188/2346] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:19 2022] DELETE /identity/v3/users/9cda862737604dda9c80060b61542fe9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:19.723725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:19.723725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:19.789060 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b15d-411d-4a68-957f-1ddac4b9c852 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:19.794069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d118c-59ed-4f2a-9f04-d63224c850fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:19.795698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d118c-59ed-4f2a-9f04-d63224c850fe admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:19.795698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d118c-59ed-4f2a-9f04-d63224c850fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:19.795991 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d118c-59ed-4f2a-9f04-d63224c850fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:19.797600 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d118c-59ed-4f2a-9f04-d63224c850fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:19.798285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d118c-59ed-4f2a-9f04-d63224c850fe admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:19.813273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1189/2347] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:19.813273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa61ce-18b8-4055-8cdf-be533472430f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:19.813273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa61ce-18b8-4055-8cdf-be533472430f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:19.813273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa61ce-18b8-4055-8cdf-be533472430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:19.831709 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-52aa61ce-18b8-4055-8cdf-be533472430f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:19.833747 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-52aa61ce-18b8-4055-8cdf-be533472430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:19.853740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1190/2348] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:19.854626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa61ce-18b8-4055-8cdf-be533472430f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:19.854994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ffdd65c7a1b4147a4e380a71794f600'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:19.864182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ffdd65c7a1b4147a4e380a71794f600'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:19.868392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa61ce-18b8-4055-8cdf-be533472430f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:19.874657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e110-6afe-4849-8c0d-dfdc8aac141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:19.884291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e110-6afe-4849-8c0d-dfdc8aac141e admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:19.884291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e110-6afe-4849-8c0d-dfdc8aac141e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:19.884291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e110-6afe-4849-8c0d-dfdc8aac141e admin admin] PATH_INFO: `/v3/projects/8042bdef00244122a8be8adc002a65f8/users/2410c1303318400f989d806973872728/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:19.884291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6e110-6afe-4849-8c0d-dfdc8aac141e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8042bdef00244122a8be8adc002a65f8, user_id=2410c1303318400f989d806973872728, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:19.884291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6e110-6afe-4849-8c0d-dfdc8aac141e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:19.884991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ffdd65c7a1b4147a4e380a71794f600'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:19.895971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1191/2349] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:19 2022] PUT /identity/v3/projects/8042bdef00244122a8be8adc002a65f8/users/2410c1303318400f989d806973872728/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:19.897163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e110-6afe-4849-8c0d-dfdc8aac141e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:19.898811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-27e6e110-6afe-4849-8c0d-dfdc8aac141e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:19.936414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:19.975197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e110-6afe-4849-8c0d-dfdc8aac141e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:19.978878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a4e94-6442-4a3b-9ec4-54413a2bb636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:19.979488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a4e94-6442-4a3b-9ec4-54413a2bb636 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:19.979769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a4e94-6442-4a3b-9ec4-54413a2bb636 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:19.980038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a4e94-6442-4a3b-9ec4-54413a2bb636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:20.006435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ffdd65c7a1b4147a4e380a71794f600'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:20.007078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e7f2d014-9254-4e62-9330-ac4f1e25d352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ffdd65c7a1b4147a4e380a71794f600'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:20.014063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1159/2350] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:19 2022] DELETE /identity/v3/users/1ffdd65c7a1b4147a4e380a71794f600 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:20.015055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac58ac9-3fde-4a64-a224-f7fd15c12404 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:20.015345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac58ac9-3fde-4a64-a224-f7fd15c12404 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:20.015728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac58ac9-3fde-4a64-a224-f7fd15c12404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:20.052279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-1ac58ac9-3fde-4a64-a224-f7fd15c12404 None None] MFA Rules not processed for user `2410c1303318400f989d806973872728`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:20.054121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1ac58ac9-3fde-4a64-a224-f7fd15c12404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:20.056679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a4e94-6442-4a3b-9ec4-54413a2bb636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:20.058724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a4e94-6442-4a3b-9ec4-54413a2bb636 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:20.071243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1192/2351] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:20.073016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791a86d-c41a-4f61-b12e-97fb8ec40cd5 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:20.073306 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791a86d-c41a-4f61-b12e-97fb8ec40cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:20.073582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791a86d-c41a-4f61-b12e-97fb8ec40cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:20.096675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-3791a86d-c41a-4f61-b12e-97fb8ec40cd5 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:20.098542 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3791a86d-c41a-4f61-b12e-97fb8ec40cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:20.156623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1160/2352] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:20.164346 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac58ac9-3fde-4a64-a224-f7fd15c12404 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:20.166028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1ac58ac9-3fde-4a64-a224-f7fd15c12404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:20.171105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1193/2353] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:20.185042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791a86d-c41a-4f61-b12e-97fb8ec40cd5 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:20.188884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3791a86d-c41a-4f61-b12e-97fb8ec40cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:20.241985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac58ac9-3fde-4a64-a224-f7fd15c12404 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:20.246640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfc208-c1cb-42d2-8e9f-affac294b8b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:20.247460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfc208-c1cb-42d2-8e9f-affac294b8b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:20.247913 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfc208-c1cb-42d2-8e9f-affac294b8b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:20.248953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfc208-c1cb-42d2-8e9f-affac294b8b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:20.250973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-cecfc208-c1cb-42d2-8e9f-affac294b8b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:20.262455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791a86d-c41a-4f61-b12e-97fb8ec40cd5 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:20.269186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295204a-9936-4af6-bc98-0c39eaa15fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:20.270340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295204a-9936-4af6-bc98-0c39eaa15fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:20.274732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295204a-9936-4af6-bc98-0c39eaa15fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:20.274732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295204a-9936-4af6-bc98-0c39eaa15fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:20.288061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295204a-9936-4af6-bc98-0c39eaa15fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:20.289617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295204a-9936-4af6-bc98-0c39eaa15fd9 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:20.303543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1194/2354] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:20.322498 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfc208-c1cb-42d2-8e9f-affac294b8b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:20.324045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfc208-c1cb-42d2-8e9f-affac294b8b7 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:20.343736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1161/2355] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:20.500609 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:20.704485 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295204a-9936-4af6-bc98-0c39eaa15fd9 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:20.705959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7295204a-9936-4af6-bc98-0c39eaa15fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:20.720197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295204a-9936-4af6-bc98-0c39eaa15fd9 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:20.726565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:20.728680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:20.728680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:20.728680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] PATH_INFO: `/v3/projects/34660b6e4173413cb7d8246be57985b4` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:20.729064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34660b6e4173413cb7d8246be57985b4)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:20.731207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:20.864363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34660b6e4173413cb7d8246be57985b4', 'request_id': 'req-3ada322c-883c-4f68-9ae3-a01ffc28ca74'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:20.890373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfc208-c1cb-42d2-8e9f-affac294b8b7 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:20.892543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-cecfc208-c1cb-42d2-8e9f-affac294b8b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:20.909428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfc208-c1cb-42d2-8e9f-affac294b8b7 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:20.968106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:20.968744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:20.969025 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:20.969301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] PATH_INFO: `/v3/projects/3d469e90d97f4585b2a277aca87f5d3c` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:20.970460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d469e90d97f4585b2a277aca87f5d3c)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:20.972392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:20.990883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34660b6e4173413cb7d8246be57985b4', 'request_id': 'req-3ada322c-883c-4f68-9ae3-a01ffc28ca74'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.002196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34660b6e4173413cb7d8246be57985b4', 'request_id': 'req-3ada322c-883c-4f68-9ae3-a01ffc28ca74'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.014729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] The token cache is being invalidate because project 34660b6e4173413cb7d8246be57985b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:21.015023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.015812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-3ada322c-883c-4f68-9ae3-a01ffc28ca74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.017316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1195/2356] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:20 2022] DELETE /identity/v3/projects/34660b6e4173413cb7d8246be57985b4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:21.024073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f015b-50a3-488c-a352-49bc1d157ba3 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:21.024450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f015b-50a3-488c-a352-49bc1d157ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:21.027000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f015b-50a3-488c-a352-49bc1d157ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:21.045303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-a85f015b-50a3-488c-a352-49bc1d157ba3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:21.046606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a85f015b-50a3-488c-a352-49bc1d157ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:21.055169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1196/2357] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:21.063026 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eecb8-6558-4f7b-95aa-db78f08979fb None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:21.063316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eecb8-6558-4f7b-95aa-db78f08979fb None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:21.063619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eecb8-6558-4f7b-95aa-db78f08979fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:21.088804 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-fa4eecb8-6558-4f7b-95aa-db78f08979fb None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:21.090327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fa4eecb8-6558-4f7b-95aa-db78f08979fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:21.129774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d469e90d97f4585b2a277aca87f5d3c', 'request_id': 'req-d808541a-b054-4087-9e49-67235feae8ff'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.145915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d469e90d97f4585b2a277aca87f5d3c', 'request_id': 'req-d808541a-b054-4087-9e49-67235feae8ff'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.163899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d469e90d97f4585b2a277aca87f5d3c', 'request_id': 'req-d808541a-b054-4087-9e49-67235feae8ff'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.222716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1197/2358] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:21.227140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eecb8-6558-4f7b-95aa-db78f08979fb None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:21.256180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eecb8-6558-4f7b-95aa-db78f08979fb None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:21.261207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c77a-dd60-4749-a770-153fbcf8fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:21.261837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c77a-dd60-4749-a770-153fbcf8fedf admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:21.262118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c77a-dd60-4749-a770-153fbcf8fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:21.262426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c77a-dd60-4749-a770-153fbcf8fedf admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:21.263121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c77a-dd60-4749-a770-153fbcf8fedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:21.263384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c77a-dd60-4749-a770-153fbcf8fedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:21.265279 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c77a-dd60-4749-a770-153fbcf8fedf admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:21.289881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] The token cache is being invalidate because project 3d469e90d97f4585b2a277aca87f5d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:21.289881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.289881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.289881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1162/2359] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:20 2022] DELETE /identity/v3/projects/3d469e90d97f4585b2a277aca87f5d3c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:21.292228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:21.294302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:21.303495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1198/2360] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:21.305118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c77a-dd60-4749-a770-153fbcf8fedf admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:21.308496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3e86c77a-dd60-4749-a770-153fbcf8fedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:21.315124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808541a-b054-4087-9e49-67235feae8ff admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:21.334314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:21.335149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:21.335529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:21.335789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c77a-dd60-4749-a770-153fbcf8fedf admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:21.335988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] PATH_INFO: `/v3/users/580c150629724c93b5e7eb32d421d73f` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:21.337951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=580c150629724c93b5e7eb32d421d73f)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:21.340370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:21.344613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a061f-60f9-4f88-ab6b-7c391a1a87cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:21.345647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a061f-60f9-4f88-ab6b-7c391a1a87cd admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:21.346182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a061f-60f9-4f88-ab6b-7c391a1a87cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:21.346770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a061f-60f9-4f88-ab6b-7c391a1a87cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:21.348081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a061f-60f9-4f88-ab6b-7c391a1a87cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:21.350763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a061f-60f9-4f88-ab6b-7c391a1a87cd admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:21.450253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1199/2361] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:21 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:21.452379 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a061f-60f9-4f88-ab6b-7c391a1a87cd admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:21.517827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a061f-60f9-4f88-ab6b-7c391a1a87cd admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:21.523055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872ee9f-3c19-43c4-8f2c-b36a2aa25c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:21.523663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872ee9f-3c19-43c4-8f2c-b36a2aa25c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:21.523944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872ee9f-3c19-43c4-8f2c-b36a2aa25c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:21.524217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872ee9f-3c19-43c4-8f2c-b36a2aa25c4f admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:21.524852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872ee9f-3c19-43c4-8f2c-b36a2aa25c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:21.526873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872ee9f-3c19-43c4-8f2c-b36a2aa25c4f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:21.594861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580c150629724c93b5e7eb32d421d73f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.603247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580c150629724c93b5e7eb32d421d73f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.615779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580c150629724c93b5e7eb32d421d73f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.752176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1200/2362] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:21 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:21.756699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872ee9f-3c19-43c4-8f2c-b36a2aa25c4f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:21.766710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872ee9f-3c19-43c4-8f2c-b36a2aa25c4f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:21.772227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290530e4-87b1-4e37-8116-3210ff9705b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:21.772827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290530e4-87b1-4e37-8116-3210ff9705b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:21.773109 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290530e4-87b1-4e37-8116-3210ff9705b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:21.773387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290530e4-87b1-4e37-8116-3210ff9705b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:21.774040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290530e4-87b1-4e37-8116-3210ff9705b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:21.775678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290530e4-87b1-4e37-8116-3210ff9705b2 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:21.786628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1201/2363] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:10:21.790469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290530e4-87b1-4e37-8116-3210ff9705b2 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:21.794490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580c150629724c93b5e7eb32d421d73f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.795128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580c150629724c93b5e7eb32d421d73f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:21.801002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290530e4-87b1-4e37-8116-3210ff9705b2 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:21.806478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f8f05-a85b-4cac-a4d7-98fefe16c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:21.807093 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f8f05-a85b-4cac-a4d7-98fefe16c125 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:21.807375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f8f05-a85b-4cac-a4d7-98fefe16c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:21.807651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f8f05-a85b-4cac-a4d7-98fefe16c125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:21.808328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f8f05-a85b-4cac-a4d7-98fefe16c125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:21.809944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f8f05-a85b-4cac-a4d7-98fefe16c125 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:21.818886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1163/2364] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:21 2022] DELETE /identity/v3/users/580c150629724c93b5e7eb32d421d73f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:21.824459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1202/2365] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:10:21.826312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:21.827731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:21.892949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc56c13-496c-4ee7-a803-04ed87c33dcd admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:21.898498 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e921-4fee-4092-ac48-2d0c9da3e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:21.899162 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e921-4fee-4092-ac48-2d0c9da3e42a admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:21.899445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e921-4fee-4092-ac48-2d0c9da3e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:21.899720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e921-4fee-4092-ac48-2d0c9da3e42a admin admin] PATH_INFO: `/v3/projects/e482e4db04904a8991f6fd4d91ce3356/users/fbb73389ac774916afaa996c87fdc010/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:21.918893 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624e921-4fee-4092-ac48-2d0c9da3e42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e482e4db04904a8991f6fd4d91ce3356, user_id=fbb73389ac774916afaa996c87fdc010, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:21.921739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624e921-4fee-4092-ac48-2d0c9da3e42a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:22.070192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1164/2366] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:21 2022] PUT /identity/v3/projects/e482e4db04904a8991f6fd4d91ce3356/users/fbb73389ac774916afaa996c87fdc010/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:22.073256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc3a6f-0f05-4ae5-91b8-2a18ad318819 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:22.083308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc3a6f-0f05-4ae5-91b8-2a18ad318819 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:22.083308 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc3a6f-0f05-4ae5-91b8-2a18ad318819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:22.095573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-47dc3a6f-0f05-4ae5-91b8-2a18ad318819 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:22.096853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-47dc3a6f-0f05-4ae5-91b8-2a18ad318819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:22.169796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1203/2367] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:22.180589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e921-4fee-4092-ac48-2d0c9da3e42a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:22.182582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7624e921-4fee-4092-ac48-2d0c9da3e42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:22.244150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e921-4fee-4092-ac48-2d0c9da3e42a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:22.250470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf97f0-de88-4264-b5bb-440eb805c117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:22.251360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf97f0-de88-4264-b5bb-440eb805c117 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:22.251649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf97f0-de88-4264-b5bb-440eb805c117 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:22.251926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf97f0-de88-4264-b5bb-440eb805c117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:22.268098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf97f0-de88-4264-b5bb-440eb805c117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:22.271945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf97f0-de88-4264-b5bb-440eb805c117 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:22.283775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1165/2368] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:22.302085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc3a6f-0f05-4ae5-91b8-2a18ad318819 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:22.303593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-47dc3a6f-0f05-4ae5-91b8-2a18ad318819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:22.323974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc3a6f-0f05-4ae5-91b8-2a18ad318819 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:22.330878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:22.331989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:22.332292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:22.332659 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] PATH_INFO: `/v3/projects/0b1cecc97c8142bfbf343ae210e33a4f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:22.334267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1cecc97c8142bfbf343ae210e33a4f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:22.336686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:22.542501 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1cecc97c8142bfbf343ae210e33a4f', 'request_id': 'req-e1e247b5-2bf7-44d8-a39d-236e89fc6141'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:22.740534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1cecc97c8142bfbf343ae210e33a4f', 'request_id': 'req-e1e247b5-2bf7-44d8-a39d-236e89fc6141'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:22.749765 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1cecc97c8142bfbf343ae210e33a4f', 'request_id': 'req-e1e247b5-2bf7-44d8-a39d-236e89fc6141'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:22.765186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] The token cache is being invalidate because project 0b1cecc97c8142bfbf343ae210e33a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:22.765752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:22.766636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e1e247b5-2bf7-44d8-a39d-236e89fc6141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:22.769178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1204/2369] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:22 2022] DELETE /identity/v3/projects/0b1cecc97c8142bfbf343ae210e33a4f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:22.774473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071300e-adcb-4342-91d5-a7aa540a2de3 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:22.774764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071300e-adcb-4342-91d5-a7aa540a2de3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:22.775036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071300e-adcb-4342-91d5-a7aa540a2de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:22.810351 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-f071300e-adcb-4342-91d5-a7aa540a2de3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:22.811862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f071300e-adcb-4342-91d5-a7aa540a2de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:22.884796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1166/2370] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:22.897991 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e434-8968-458c-8498-ef3c69958750 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:22.898439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e434-8968-458c-8498-ef3c69958750 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:22.900183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e434-8968-458c-8498-ef3c69958750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:22.923886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-6709e434-8968-458c-8498-ef3c69958750 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:22.925569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6709e434-8968-458c-8498-ef3c69958750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:22.935274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1205/2371] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:22.940085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071300e-adcb-4342-91d5-a7aa540a2de3 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:22.951977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071300e-adcb-4342-91d5-a7aa540a2de3 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:22.957611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b076ea5-aa87-4ed0-aaf9-de1ec1545863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:22.959865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b076ea5-aa87-4ed0-aaf9-de1ec1545863 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:22.959865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b076ea5-aa87-4ed0-aaf9-de1ec1545863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:22.959865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b076ea5-aa87-4ed0-aaf9-de1ec1545863 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:22.960934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b076ea5-aa87-4ed0-aaf9-de1ec1545863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:22.961643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b076ea5-aa87-4ed0-aaf9-de1ec1545863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:22.965235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b076ea5-aa87-4ed0-aaf9-de1ec1545863 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:22.977861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1167/2372] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:22.982364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e434-8968-458c-8498-ef3c69958750 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:22.993288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e434-8968-458c-8498-ef3c69958750 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:23.001250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c56a2-c0ff-47dc-8350-272a4bcd02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:23.001250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c56a2-c0ff-47dc-8350-272a4bcd02dd admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:23.001565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c56a2-c0ff-47dc-8350-272a4bcd02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:23.001850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c56a2-c0ff-47dc-8350-272a4bcd02dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:23.002887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c56a2-c0ff-47dc-8350-272a4bcd02dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:23.006889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c56a2-c0ff-47dc-8350-272a4bcd02dd admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:23.152353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1206/2373] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:22 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:23.153794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b076ea5-aa87-4ed0-aaf9-de1ec1545863 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:23.168502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b076ea5-aa87-4ed0-aaf9-de1ec1545863 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:23.248861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:23.248974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2cb5d-cfab-45d3-b7a2-bebb3de42776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:23.248974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2cb5d-cfab-45d3-b7a2-bebb3de42776 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:23.248974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2cb5d-cfab-45d3-b7a2-bebb3de42776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:23.248974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2cb5d-cfab-45d3-b7a2-bebb3de42776 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:23.249314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2cb5d-cfab-45d3-b7a2-bebb3de42776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:23.250242 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2cb5d-cfab-45d3-b7a2-bebb3de42776 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:23.435683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1168/2374] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:23 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:23.440374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c56a2-c0ff-47dc-8350-272a4bcd02dd admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:23.452619 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c56a2-c0ff-47dc-8350-272a4bcd02dd admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:23.463648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae4085-2fcd-4720-889c-0300413e2312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:23.464716 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae4085-2fcd-4720-889c-0300413e2312 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:23.465143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae4085-2fcd-4720-889c-0300413e2312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:23.465720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae4085-2fcd-4720-889c-0300413e2312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:23.466750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae4085-2fcd-4720-889c-0300413e2312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:23.477958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae4085-2fcd-4720-889c-0300413e2312 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:23.494127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1207/2375] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:23.498228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2cb5d-cfab-45d3-b7a2-bebb3de42776 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:23.511307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2cb5d-cfab-45d3-b7a2-bebb3de42776 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:23.517769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2efb44-b2c3-4430-9ac7-7d58fe4ca11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:23.518859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2efb44-b2c3-4430-9ac7-7d58fe4ca11c admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:23.519167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2efb44-b2c3-4430-9ac7-7d58fe4ca11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:23.519483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2efb44-b2c3-4430-9ac7-7d58fe4ca11c admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:23.520277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2efb44-b2c3-4430-9ac7-7d58fe4ca11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:23.522298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2efb44-b2c3-4430-9ac7-7d58fe4ca11c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:23.544573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1169/2376] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:23.549294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae4085-2fcd-4720-889c-0300413e2312 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:23.563581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae4085-2fcd-4720-889c-0300413e2312 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:23.571056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfc2e9-7baf-4099-a637-ad204d68551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:23.572249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfc2e9-7baf-4099-a637-ad204d68551c admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:23.572714 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfc2e9-7baf-4099-a637-ad204d68551c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:23.573383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfc2e9-7baf-4099-a637-ad204d68551c admin admin] PATH_INFO: `/v3/projects/864944bdfb8a4f1db6fe606f8d32f8cb/users/0acf2c8982654c99a276f3b4515b9b69/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:23.599027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfc2e9-7baf-4099-a637-ad204d68551c admin admin] RBAC: Authorizing `identity:create_grant(project_id=864944bdfb8a4f1db6fe606f8d32f8cb, user_id=0acf2c8982654c99a276f3b4515b9b69, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:23.601766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfc2e9-7baf-4099-a637-ad204d68551c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:23.720602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1208/2377] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:23 2022] PUT /identity/v3/projects/864944bdfb8a4f1db6fe606f8d32f8cb/users/0acf2c8982654c99a276f3b4515b9b69/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:23.732844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2efb44-b2c3-4430-9ac7-7d58fe4ca11c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:23.734702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-df2efb44-b2c3-4430-9ac7-7d58fe4ca11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:23.745941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd89c57-cd8c-41f1-8d88-11d8cff9b5ad None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:23.746264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd89c57-cd8c-41f1-8d88-11d8cff9b5ad None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:23.746823 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd89c57-cd8c-41f1-8d88-11d8cff9b5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:23.805219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-dbd89c57-cd8c-41f1-8d88-11d8cff9b5ad None None] MFA Rules not processed for user `0acf2c8982654c99a276f3b4515b9b69`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:23.806842 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-dbd89c57-cd8c-41f1-8d88-11d8cff9b5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:23.807105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2efb44-b2c3-4430-9ac7-7d58fe4ca11c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:23.889119 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af79ec-6fa2-4c9c-b1e6-753ea4af1c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:23.889858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af79ec-6fa2-4c9c-b1e6-753ea4af1c77 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:23.890140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af79ec-6fa2-4c9c-b1e6-753ea4af1c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:23.890452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af79ec-6fa2-4c9c-b1e6-753ea4af1c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:23.892301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-64af79ec-6fa2-4c9c-b1e6-753ea4af1c77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:23.900630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1209/2378] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:23.962251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af79ec-6fa2-4c9c-b1e6-753ea4af1c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:23.964255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af79ec-6fa2-4c9c-b1e6-753ea4af1c77 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:23.976593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1170/2379] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:23.988025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd89c57-cd8c-41f1-8d88-11d8cff9b5ad None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:23.989377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-dbd89c57-cd8c-41f1-8d88-11d8cff9b5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:24.006385 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd89c57-cd8c-41f1-8d88-11d8cff9b5ad None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:24.010142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fe83d-c741-4453-9d39-36737abfeb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:24.010805 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe83d-c741-4453-9d39-36737abfeb66 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:24.011090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe83d-c741-4453-9d39-36737abfeb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:24.011371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe83d-c741-4453-9d39-36737abfeb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:24.022164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fe83d-c741-4453-9d39-36737abfeb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:24.023586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fe83d-c741-4453-9d39-36737abfeb66 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:24.033939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1210/2380] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:24.152272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:26.496067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:26.528537 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af79ec-6fa2-4c9c-b1e6-753ea4af1c77 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:26.545461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af79ec-6fa2-4c9c-b1e6-753ea4af1c77 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:26.556204 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8151ec4-fe16-4ab1-a25b-d211ca3d77e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:26.556862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8151ec4-fe16-4ab1-a25b-d211ca3d77e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:26.557352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8151ec4-fe16-4ab1-a25b-d211ca3d77e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:26.557683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8151ec4-fe16-4ab1-a25b-d211ca3d77e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:26.561048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c8151ec4-fe16-4ab1-a25b-d211ca3d77e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:26.655825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8151ec4-fe16-4ab1-a25b-d211ca3d77e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:26.657595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8151ec4-fe16-4ab1-a25b-d211ca3d77e5 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:26.669484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1171/2381] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:28.453123 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:29.434491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189a97f-1259-4592-bf50-6b097a9297f1 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:29.434969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189a97f-1259-4592-bf50-6b097a9297f1 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:29.435064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189a97f-1259-4592-bf50-6b097a9297f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:29.478473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-7189a97f-1259-4592-bf50-6b097a9297f1 None None] MFA Rules not processed for user `fbb73389ac774916afaa996c87fdc010`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:29.479717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7189a97f-1259-4592-bf50-6b097a9297f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:29.552840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1211/2382] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:29.557928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8151ec4-fe16-4ab1-a25b-d211ca3d77e5 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:29.559648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c8151ec4-fe16-4ab1-a25b-d211ca3d77e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:29.642410 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8151ec4-fe16-4ab1-a25b-d211ca3d77e5 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:29.648269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb375c39-eecc-4b75-a739-e70c59d92ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:29.648885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb375c39-eecc-4b75-a739-e70c59d92ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:29.649164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb375c39-eecc-4b75-a739-e70c59d92ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:29.649438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb375c39-eecc-4b75-a739-e70c59d92ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:29.651237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb375c39-eecc-4b75-a739-e70c59d92ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:29.652048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb375c39-eecc-4b75-a739-e70c59d92ba9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:29.796976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1172/2383] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:29 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:29.802509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189a97f-1259-4592-bf50-6b097a9297f1 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:29.814198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189a97f-1259-4592-bf50-6b097a9297f1 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:29.820033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:29.905685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19717cd2-fb1f-45fa-bd8f-15829d398805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:29.906454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717cd2-fb1f-45fa-bd8f-15829d398805 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:29.906737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717cd2-fb1f-45fa-bd8f-15829d398805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:29.907009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717cd2-fb1f-45fa-bd8f-15829d398805 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:29.907658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19717cd2-fb1f-45fa-bd8f-15829d398805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:29.909734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19717cd2-fb1f-45fa-bd8f-15829d398805 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:30.052431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1212/2384] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:29 2022] POST /identity/v3/users => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:30.053590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb375c39-eecc-4b75-a739-e70c59d92ba9 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:30.064730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb375c39-eecc-4b75-a739-e70c59d92ba9 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:30.070130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bf078-2a5d-44b8-a67a-1e3b547648ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:30.070710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bf078-2a5d-44b8-a67a-1e3b547648ad admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:30.071058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bf078-2a5d-44b8-a67a-1e3b547648ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:30.071256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bf078-2a5d-44b8-a67a-1e3b547648ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:30.071909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bf078-2a5d-44b8-a67a-1e3b547648ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:30.073668 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061bf078-2a5d-44b8-a67a-1e3b547648ad admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:30.089820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1173/2385] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:30.091261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19717cd2-fb1f-45fa-bd8f-15829d398805 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:30.106438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19717cd2-fb1f-45fa-bd8f-15829d398805 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:30.112503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d1dc-f918-4d2f-9183-4b95ab313fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:30.113884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d1dc-f918-4d2f-9183-4b95ab313fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:30.114128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d1dc-f918-4d2f-9183-4b95ab313fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:30.114252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d1dc-f918-4d2f-9183-4b95ab313fd3 admin admin] PATH_INFO: `/v3/projects/87b948672a314aa6abd9d83d7350c796/users/f66bdbd90aa1449eacb79a18905cee59/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:30.158828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79d1dc-f918-4d2f-9183-4b95ab313fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b948672a314aa6abd9d83d7350c796, user_id=f66bdbd90aa1449eacb79a18905cee59, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:30.162583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79d1dc-f918-4d2f-9183-4b95ab313fd3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:30.284773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1213/2386] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:30 2022] PUT /identity/v3/projects/87b948672a314aa6abd9d83d7350c796/users/f66bdbd90aa1449eacb79a18905cee59/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:30.289927 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bf078-2a5d-44b8-a67a-1e3b547648ad admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:30.306201 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bf078-2a5d-44b8-a67a-1e3b547648ad admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:30.371326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298d955-72b1-4d50-954e-8516e446fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:30.372056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298d955-72b1-4d50-954e-8516e446fdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:30.372406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298d955-72b1-4d50-954e-8516e446fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:30.372767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298d955-72b1-4d50-954e-8516e446fdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:30.373498 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298d955-72b1-4d50-954e-8516e446fdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:30.375332 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298d955-72b1-4d50-954e-8516e446fdc2 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:30.390647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1174/2387] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:30.392003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d1dc-f918-4d2f-9183-4b95ab313fd3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:30.403171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d1dc-f918-4d2f-9183-4b95ab313fd3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:30.408912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cc267-1ccc-42ff-81b1-b10cbe7adaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:30.409603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cc267-1ccc-42ff-81b1-b10cbe7adaee admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:30.409887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cc267-1ccc-42ff-81b1-b10cbe7adaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:30.410742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cc267-1ccc-42ff-81b1-b10cbe7adaee admin admin] PATH_INFO: `/v3/projects/87b948672a314aa6abd9d83d7350c796/users/f66bdbd90aa1449eacb79a18905cee59/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:30.413932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cc267-1ccc-42ff-81b1-b10cbe7adaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b948672a314aa6abd9d83d7350c796, user_id=f66bdbd90aa1449eacb79a18905cee59, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:30.415486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cc267-1ccc-42ff-81b1-b10cbe7adaee admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:30.428503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1214/2388] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:30 2022] PUT /identity/v3/projects/87b948672a314aa6abd9d83d7350c796/users/f66bdbd90aa1449eacb79a18905cee59/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:31.250037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:31.851841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:34.014946 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298d955-72b1-4d50-954e-8516e446fdc2 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:34.020973 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2298d955-72b1-4d50-954e-8516e446fdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:34.044560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cc267-1ccc-42ff-81b1-b10cbe7adaee admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:34.077267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298d955-72b1-4d50-954e-8516e446fdc2 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:34.165249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cc267-1ccc-42ff-81b1-b10cbe7adaee admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:34.176545 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:34.177286 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:34.177592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:34.177847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] PATH_INFO: `/v3/users/0acf2c8982654c99a276f3b4515b9b69` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:34.179809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0acf2c8982654c99a276f3b4515b9b69)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:34.181936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:34.232191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:34.239153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:34.239153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:34.239153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] PATH_INFO: `/v3/users/3b01d47ddfd64e8d82f55ab24a126ddc` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:34.239153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b01d47ddfd64e8d82f55ab24a126ddc)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:34.239153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:34.440480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0acf2c8982654c99a276f3b4515b9b69'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:34.441435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0acf2c8982654c99a276f3b4515b9b69'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:34.458813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0acf2c8982654c99a276f3b4515b9b69'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:34.479287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0acf2c8982654c99a276f3b4515b9b69'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:34.480188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-8f10958a-ef99-4028-bb97-f4b452f88869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0acf2c8982654c99a276f3b4515b9b69'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:34.528378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b01d47ddfd64e8d82f55ab24a126ddc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:34.567659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b01d47ddfd64e8d82f55ab24a126ddc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:34.622697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1215/2389] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:34 2022] DELETE /identity/v3/users/0acf2c8982654c99a276f3b4515b9b69 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:34.627742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0770c-3364-45f7-af98-bdeec8cc5ab4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:34.628153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0770c-3364-45f7-af98-bdeec8cc5ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:34.628497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0770c-3364-45f7-af98-bdeec8cc5ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:34.685469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-28b0770c-3364-45f7-af98-bdeec8cc5ab4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:34.689234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b01d47ddfd64e8d82f55ab24a126ddc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:34.692598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-28b0770c-3364-45f7-af98-bdeec8cc5ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:34.814335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b01d47ddfd64e8d82f55ab24a126ddc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:34.815102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-28be56dc-c17a-4df5-9c49-54a107df02b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b01d47ddfd64e8d82f55ab24a126ddc'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:34.831597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1175/2390] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:34 2022] DELETE /identity/v3/users/3b01d47ddfd64e8d82f55ab24a126ddc => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:34.835020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c8728-871c-4269-8b7c-d1eb8347b44a None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:34.835540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c8728-871c-4269-8b7c-d1eb8347b44a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:34.839469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1216/2391] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:34.840903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c8728-871c-4269-8b7c-d1eb8347b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:34.850067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0770c-3364-45f7-af98-bdeec8cc5ab4 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:34.851550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-28b0770c-3364-45f7-af98-bdeec8cc5ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:34.869685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-093c8728-871c-4269-8b7c-d1eb8347b44a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:34.871030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-093c8728-871c-4269-8b7c-d1eb8347b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:34.955721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0770c-3364-45f7-af98-bdeec8cc5ab4 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:35.023513 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1176/2392] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:35.031775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c8728-871c-4269-8b7c-d1eb8347b44a None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:35.033532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-093c8728-871c-4269-8b7c-d1eb8347b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:35.039641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:35.093399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d08d9-5b65-4747-8ed7-821cae1d23c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:35.094059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d08d9-5b65-4747-8ed7-821cae1d23c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:35.094327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d08d9-5b65-4747-8ed7-821cae1d23c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:35.094597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d08d9-5b65-4747-8ed7-821cae1d23c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:35.118538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d08d9-5b65-4747-8ed7-821cae1d23c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:35.122621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d08d9-5b65-4747-8ed7-821cae1d23c8 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:35.135543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c8728-871c-4269-8b7c-d1eb8347b44a None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:35.141352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a139f-1d4e-4d22-9c5c-9d5c948b7e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:35.146507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a139f-1d4e-4d22-9c5c-9d5c948b7e4a service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:35.146507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a139f-1d4e-4d22-9c5c-9d5c948b7e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:35.146507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a139f-1d4e-4d22-9c5c-9d5c948b7e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:35.148908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1217/2393] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:35.158544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a139f-1d4e-4d22-9c5c-9d5c948b7e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:35.160870 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a139f-1d4e-4d22-9c5c-9d5c948b7e4a service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:35.174050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1177/2394] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:35.956828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d08d9-5b65-4747-8ed7-821cae1d23c8 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:35.958329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f28d08d9-5b65-4747-8ed7-821cae1d23c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:35.964391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a139f-1d4e-4d22-9c5c-9d5c948b7e4a service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:35.966666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d48a139f-1d4e-4d22-9c5c-9d5c948b7e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:35.992921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d08d9-5b65-4747-8ed7-821cae1d23c8 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:36.001403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a139f-1d4e-4d22-9c5c-9d5c948b7e4a service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:36.012046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:36.014088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:36.014910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:36.017142 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:36.017337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:36.017865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] PATH_INFO: `/v3/projects/c9c7f4245fa348458c566b5f3b7bba35` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:36.021949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:36.021949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] PATH_INFO: `/v3/projects/864944bdfb8a4f1db6fe606f8d32f8cb` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:36.022140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c7f4245fa348458c566b5f3b7bba35)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:36.025581 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=864944bdfb8a4f1db6fe606f8d32f8cb)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:36.029902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:36.030773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:36.230120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864944bdfb8a4f1db6fe606f8d32f8cb', 'request_id': 'req-4ba932e9-b7b8-48c4-99f9-89e6777740b1'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.242389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:36.246485 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864944bdfb8a4f1db6fe606f8d32f8cb', 'request_id': 'req-4ba932e9-b7b8-48c4-99f9-89e6777740b1'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.258262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864944bdfb8a4f1db6fe606f8d32f8cb', 'request_id': 'req-4ba932e9-b7b8-48c4-99f9-89e6777740b1'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.266029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c7f4245fa348458c566b5f3b7bba35', 'request_id': 'req-2f54ac9b-8340-4a56-99e9-35e4ced908a1'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.441889 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] The token cache is being invalidate because project 864944bdfb8a4f1db6fe606f8d32f8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:36.444933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.445721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4ba932e9-b7b8-48c4-99f9-89e6777740b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.447382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1178/2395] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:35 2022] DELETE /identity/v3/projects/864944bdfb8a4f1db6fe606f8d32f8cb => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:36.456907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087c9b3-a1b2-4305-bb1b-411ff9c40e4b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:36.457198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087c9b3-a1b2-4305-bb1b-411ff9c40e4b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:36.460542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087c9b3-a1b2-4305-bb1b-411ff9c40e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:36.526440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-e087c9b3-a1b2-4305-bb1b-411ff9c40e4b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:36.527976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e087c9b3-a1b2-4305-bb1b-411ff9c40e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:36.531210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c7f4245fa348458c566b5f3b7bba35', 'request_id': 'req-2f54ac9b-8340-4a56-99e9-35e4ced908a1'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.540170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c7f4245fa348458c566b5f3b7bba35', 'request_id': 'req-2f54ac9b-8340-4a56-99e9-35e4ced908a1'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.552431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] The token cache is being invalidate because project c9c7f4245fa348458c566b5f3b7bba35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:36.553023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.553937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.557257 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1218/2396] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:35 2022] DELETE /identity/v3/projects/c9c7f4245fa348458c566b5f3b7bba35 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:36.561586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:36.567301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:36.634905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1179/2397] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:36.643608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41eea-df73-4aa2-bb45-a46e7512319b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:36.644178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41eea-df73-4aa2-bb45-a46e7512319b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:36.644853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41eea-df73-4aa2-bb45-a46e7512319b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:36.677112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-09e41eea-df73-4aa2-bb45-a46e7512319b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:36.678671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-09e41eea-df73-4aa2-bb45-a46e7512319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:36.680585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54ac9b-8340-4a56-99e9-35e4ced908a1 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:36.686363 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:36.688465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:36.689104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:36.689576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] PATH_INFO: `/v3/users/b1a5072da134452d974bd18352765b12` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:36.691617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a5072da134452d974bd18352765b12)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:36.693176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1180/2398] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:36.695244 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e41eea-df73-4aa2-bb45-a46e7512319b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:36.695368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:36.720081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e41eea-df73-4aa2-bb45-a46e7512319b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:36.735746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb8f98-409a-4e6b-bcb8-038d60177fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:36.736480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb8f98-409a-4e6b-bcb8-038d60177fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:36.736836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb8f98-409a-4e6b-bcb8-038d60177fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:36.737218 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb8f98-409a-4e6b-bcb8-038d60177fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:36.738367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb8f98-409a-4e6b-bcb8-038d60177fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:36.738773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb8f98-409a-4e6b-bcb8-038d60177fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:36.740992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb8f98-409a-4e6b-bcb8-038d60177fc2 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:36.757306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1181/2399] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:36.761651 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb8f98-409a-4e6b-bcb8-038d60177fc2 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:36.774895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb8f98-409a-4e6b-bcb8-038d60177fc2 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:36.791313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e2e2f-cef5-4c57-b951-bbab24cbfa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:36.794346 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e2e2f-cef5-4c57-b951-bbab24cbfa29 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:36.794828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e2e2f-cef5-4c57-b951-bbab24cbfa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:36.795289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e2e2f-cef5-4c57-b951-bbab24cbfa29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:36.813879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e2e2f-cef5-4c57-b951-bbab24cbfa29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:36.833370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e2e2f-cef5-4c57-b951-bbab24cbfa29 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:36.908067 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a5072da134452d974bd18352765b12'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.909117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a5072da134452d974bd18352765b12'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.921353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a5072da134452d974bd18352765b12'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.976298 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a5072da134452d974bd18352765b12'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.977095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a5072da134452d974bd18352765b12'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:36.982508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1182/2400] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:36 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:36.984074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e2e2f-cef5-4c57-b951-bbab24cbfa29 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:36.986020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ae5e2e2f-cef5-4c57-b951-bbab24cbfa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:37.067718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1219/2401] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:36 2022] DELETE /identity/v3/users/b1a5072da134452d974bd18352765b12 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:37.078343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e2e2f-cef5-4c57-b951-bbab24cbfa29 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:37.198186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af293727-b000-4b09-98d7-e6947047dcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:37.198186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af293727-b000-4b09-98d7-e6947047dcff admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:37.198186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af293727-b000-4b09-98d7-e6947047dcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:37.198186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af293727-b000-4b09-98d7-e6947047dcff admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:37.204217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af293727-b000-4b09-98d7-e6947047dcff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:37.204217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af293727-b000-4b09-98d7-e6947047dcff admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:37.304827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1183/2402] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:36 2022] POST /identity/v3/users => generated 292 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:37.309002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:37.323464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed09e05-7a23-4627-a64d-e222c1150bd3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:37.339917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54231622-cc22-44e6-8ec6-003214a852d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:37.341966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231622-cc22-44e6-8ec6-003214a852d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:37.346907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231622-cc22-44e6-8ec6-003214a852d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:37.346907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231622-cc22-44e6-8ec6-003214a852d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:37.346907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54231622-cc22-44e6-8ec6-003214a852d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:37.348366 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54231622-cc22-44e6-8ec6-003214a852d1 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:37.375202 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1220/2403] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:37.380062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af293727-b000-4b09-98d7-e6947047dcff admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:37.422271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af293727-b000-4b09-98d7-e6947047dcff admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:37.431613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48811ae6-d6a3-416b-a6f8-9d2523084caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:37.433115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48811ae6-d6a3-416b-a6f8-9d2523084caa admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:37.434090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48811ae6-d6a3-416b-a6f8-9d2523084caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:37.435216 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48811ae6-d6a3-416b-a6f8-9d2523084caa admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:37.435925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48811ae6-d6a3-416b-a6f8-9d2523084caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:37.438267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48811ae6-d6a3-416b-a6f8-9d2523084caa admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:37.456370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1184/2404] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:10:37.458009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54231622-cc22-44e6-8ec6-003214a852d1 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:37.489074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54231622-cc22-44e6-8ec6-003214a852d1 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:37.496602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbbd2f-cc6f-4529-9632-e8ca77dc10d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:37.497422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbbd2f-cc6f-4529-9632-e8ca77dc10d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:37.497883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbbd2f-cc6f-4529-9632-e8ca77dc10d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:37.498173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbbd2f-cc6f-4529-9632-e8ca77dc10d7 admin admin] PATH_INFO: `/v3/projects/78da5566eac242b2b21634d78dffae39/users/560a4fc7d17547ce87cd8b82c6230b3b/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:37.530364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbbd2f-cc6f-4529-9632-e8ca77dc10d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78da5566eac242b2b21634d78dffae39, user_id=560a4fc7d17547ce87cd8b82c6230b3b, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:37.533221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbbd2f-cc6f-4529-9632-e8ca77dc10d7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:37.674488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1221/2405] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:37 2022] PUT /identity/v3/projects/78da5566eac242b2b21634d78dffae39/users/560a4fc7d17547ce87cd8b82c6230b3b/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:37.684940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5d52-eada-4976-918a-1495700e7a80 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:37.685312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5d52-eada-4976-918a-1495700e7a80 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:37.685731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5d52-eada-4976-918a-1495700e7a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:37.721133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbbd2f-cc6f-4529-9632-e8ca77dc10d7 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:37.723487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-38bbbd2f-cc6f-4529-9632-e8ca77dc10d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:37.736083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-20dd5d52-eada-4976-918a-1495700e7a80 None None] MFA Rules not processed for user `560a4fc7d17547ce87cd8b82c6230b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:37.737531 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-20dd5d52-eada-4976-918a-1495700e7a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:37.809684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbbd2f-cc6f-4529-9632-e8ca77dc10d7 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:37.822108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:37.822108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:37.822108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:37.822108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] PATH_INFO: `/v3/projects/b499723e8fcf4017ae0797b0437e3ca3` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:37.822503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b499723e8fcf4017ae0797b0437e3ca3)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:37.823155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:37.830289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1185/2406] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:37.846180 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd5d52-eada-4976-918a-1495700e7a80 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:37.848047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-20dd5d52-eada-4976-918a-1495700e7a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:37.937088 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd5d52-eada-4976-918a-1495700e7a80 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:37.941690 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309239cb-574e-4679-abc1-003d8194b382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:37.942566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309239cb-574e-4679-abc1-003d8194b382 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:37.942970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309239cb-574e-4679-abc1-003d8194b382 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:37.943349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309239cb-574e-4679-abc1-003d8194b382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:37.954462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309239cb-574e-4679-abc1-003d8194b382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:37.956148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309239cb-574e-4679-abc1-003d8194b382 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:37.990379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1186/2407] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:38.031766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b499723e8fcf4017ae0797b0437e3ca3', 'request_id': 'req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:38.134615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b499723e8fcf4017ae0797b0437e3ca3', 'request_id': 'req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:38.137519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:38.146079 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b499723e8fcf4017ae0797b0437e3ca3', 'request_id': 'req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:38.190734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] The token cache is being invalidate because project b499723e8fcf4017ae0797b0437e3ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:38.191610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:38.194253 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:38.201626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309239cb-574e-4679-abc1-003d8194b382 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:38.214291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1222/2408] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:37 2022] DELETE /identity/v3/projects/b499723e8fcf4017ae0797b0437e3ca3 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:38.217223 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309239cb-574e-4679-abc1-003d8194b382 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:38.366286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:38.366286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:38.366286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:38.366286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] PATH_INFO: `/v3/users/2410c1303318400f989d806973872728` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:38.366846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2410c1303318400f989d806973872728)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:38.367568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:38.702140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2410c1303318400f989d806973872728'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:38.711424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2410c1303318400f989d806973872728'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:38.724846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2410c1303318400f989d806973872728'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:38.813828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2410c1303318400f989d806973872728'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:38.814722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-22f9ca29-bd6e-4d00-8b68-e4caab70b638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2410c1303318400f989d806973872728'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:38.826066 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1187/2409] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:38 2022] DELETE /identity/v3/users/2410c1303318400f989d806973872728 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:39.226592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:39.726673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:39.728388 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:39.759090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9b47d-6928-43e0-a86f-891a1fd1a4ce admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:39.911163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:39.912150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:39.913494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:39.914343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] PATH_INFO: `/v3/projects/8042bdef00244122a8be8adc002a65f8` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:39.916651 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8042bdef00244122a8be8adc002a65f8)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:39.918848 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:40.068524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8042bdef00244122a8be8adc002a65f8', 'request_id': 'req-532c6e7a-786a-408f-973d-7afa39054c39'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:40.150974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49922c37-cbe1-40d7-8dd7-c24ad88027b1 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.151349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49922c37-cbe1-40d7-8dd7-c24ad88027b1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.151683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49922c37-cbe1-40d7-8dd7-c24ad88027b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.201775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-49922c37-cbe1-40d7-8dd7-c24ad88027b1 None None] MFA Rules not processed for user `f66bdbd90aa1449eacb79a18905cee59`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:40.202516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8042bdef00244122a8be8adc002a65f8', 'request_id': 'req-532c6e7a-786a-408f-973d-7afa39054c39'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:40.202774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-49922c37-cbe1-40d7-8dd7-c24ad88027b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:40.211931 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8042bdef00244122a8be8adc002a65f8', 'request_id': 'req-532c6e7a-786a-408f-973d-7afa39054c39'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:40.227970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] The token cache is being invalidate because project 8042bdef00244122a8be8adc002a65f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:40.227970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:40.227970 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-532c6e7a-786a-408f-973d-7afa39054c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:40.232324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1223/2410] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:39 2022] DELETE /identity/v3/projects/8042bdef00244122a8be8adc002a65f8 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:40.235880 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954e53a-6c95-4f4a-a312-9e61c1359bb3 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.236475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954e53a-6c95-4f4a-a312-9e61c1359bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.236939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954e53a-6c95-4f4a-a312-9e61c1359bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.262792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2954e53a-6c95-4f4a-a312-9e61c1359bb3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:40.264421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2954e53a-6c95-4f4a-a312-9e61c1359bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:40.305649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1188/2411] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:40.322930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49922c37-cbe1-40d7-8dd7-c24ad88027b1 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:40.324492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-49922c37-cbe1-40d7-8dd7-c24ad88027b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:40.339986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1224/2412] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:40.341419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66398948-71ef-4613-acf2-b53bba26a835 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.341694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66398948-71ef-4613-acf2-b53bba26a835 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.341969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66398948-71ef-4613-acf2-b53bba26a835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.364597 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-66398948-71ef-4613-acf2-b53bba26a835 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:40.365915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-66398948-71ef-4613-acf2-b53bba26a835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:40.374273 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1225/2413] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:40.378567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66398948-71ef-4613-acf2-b53bba26a835 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:40.387988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66398948-71ef-4613-acf2-b53bba26a835 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:40.388942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49922c37-cbe1-40d7-8dd7-c24ad88027b1 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:40.392741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5fb45-0b56-450f-bf56-611b67fd7fe1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bdd5f0b3bc4c099c0d34b3b7c3f3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:40.392983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7375d-4049-4a77-8bcd-fa2d46280982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:40.393354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5fb45-0b56-450f-bf56-611b67fd7fe1 service glance] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.393634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5fb45-0b56-450f-bf56-611b67fd7fe1 service glance] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.393780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7375d-4049-4a77-8bcd-fa2d46280982 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.393906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5fb45-0b56-450f-bf56-611b67fd7fe1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.394329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7375d-4049-4a77-8bcd-fa2d46280982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.394617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7375d-4049-4a77-8bcd-fa2d46280982 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.395275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7375d-4049-4a77-8bcd-fa2d46280982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:40.395582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7375d-4049-4a77-8bcd-fa2d46280982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:40.395890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a1d5fb45-0b56-450f-bf56-611b67fd7fe1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:40.397430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7375d-4049-4a77-8bcd-fa2d46280982 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:40.409329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1226/2414] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:10:40.414348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7375d-4049-4a77-8bcd-fa2d46280982 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:40.424830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7375d-4049-4a77-8bcd-fa2d46280982 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:40.430455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307eda7-583b-4b91-8a46-f0354009734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:40.431277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307eda7-583b-4b91-8a46-f0354009734a admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.431727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307eda7-583b-4b91-8a46-f0354009734a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.432029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307eda7-583b-4b91-8a46-f0354009734a admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.433497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307eda7-583b-4b91-8a46-f0354009734a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:40.435471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307eda7-583b-4b91-8a46-f0354009734a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:40.459767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5fb45-0b56-450f-bf56-611b67fd7fe1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:40.461315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5fb45-0b56-450f-bf56-611b67fd7fe1 service glance] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:40.470767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1189/2415] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:40.627760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1227/2416] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:40 2022] POST /identity/v3/projects => generated 363 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:40.632170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5fb45-0b56-450f-bf56-611b67fd7fe1 service glance] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:40.644552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5fb45-0b56-450f-bf56-611b67fd7fe1 service glance] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:40.728464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf178-b54e-436f-88c8-e9a828c0fc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:40.728464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf178-b54e-436f-88c8-e9a828c0fc11 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.728464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf178-b54e-436f-88c8-e9a828c0fc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.728464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf178-b54e-436f-88c8-e9a828c0fc11 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.728841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cf178-b54e-436f-88c8-e9a828c0fc11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:40.730303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cf178-b54e-436f-88c8-e9a828c0fc11 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:40.843616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1190/2417] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:40 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:40.849309 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307eda7-583b-4b91-8a46-f0354009734a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:40.858807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:40.863707 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307eda7-583b-4b91-8a46-f0354009734a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:40.869133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b9b49-5348-454d-8c23-c7be8a5ed29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:40.869835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b9b49-5348-454d-8c23-c7be8a5ed29a admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.870110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b9b49-5348-454d-8c23-c7be8a5ed29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.870771 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b9b49-5348-454d-8c23-c7be8a5ed29a admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.871709 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b9b49-5348-454d-8c23-c7be8a5ed29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:40.874085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b9b49-5348-454d-8c23-c7be8a5ed29a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:40.876739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8131bd5-c17f-4b85-8156-6217bb09ec71 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.876739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8131bd5-c17f-4b85-8156-6217bb09ec71 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.876739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8131bd5-c17f-4b85-8156-6217bb09ec71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.889301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1228/2418] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:40.890490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b9b49-5348-454d-8c23-c7be8a5ed29a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:40.899941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b8131bd5-c17f-4b85-8156-6217bb09ec71 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:40.901245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b8131bd5-c17f-4b85-8156-6217bb09ec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:40.917074 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b9b49-5348-454d-8c23-c7be8a5ed29a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:40.921908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095d16c-5023-44b1-abb1-12f5c9bce276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:40.922712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095d16c-5023-44b1-abb1-12f5c9bce276 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.922997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095d16c-5023-44b1-abb1-12f5c9bce276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.923276 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095d16c-5023-44b1-abb1-12f5c9bce276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.923922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095d16c-5023-44b1-abb1-12f5c9bce276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:40.925590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095d16c-5023-44b1-abb1-12f5c9bce276 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:40.941751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1229/2419] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:40.943054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095d16c-5023-44b1-abb1-12f5c9bce276 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:40.957351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095d16c-5023-44b1-abb1-12f5c9bce276 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:40.963763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6bae2-1f89-4e2a-a869-4af169b97a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:40.964524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6bae2-1f89-4e2a-a869-4af169b97a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:40.964808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6bae2-1f89-4e2a-a869-4af169b97a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:40.965088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6bae2-1f89-4e2a-a869-4af169b97a4f admin admin] PATH_INFO: `/v3/projects/2c48ced2c67647f683562e9973a76244/users/f7a6cfe029514957862789f4c8096006/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:40.969050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1191/2420] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:40.982573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6bae2-1f89-4e2a-a869-4af169b97a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c48ced2c67647f683562e9973a76244, user_id=f7a6cfe029514957862789f4c8096006, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:40.985455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6bae2-1f89-4e2a-a869-4af169b97a4f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:41.015646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8131bd5-c17f-4b85-8156-6217bb09ec71 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:41.017078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b8131bd5-c17f-4b85-8156-6217bb09ec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:41.064698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1230/2421] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:40 2022] PUT /identity/v3/projects/2c48ced2c67647f683562e9973a76244/users/f7a6cfe029514957862789f4c8096006/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:41.077032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f834c-c384-4951-8a50-7b7847693f1d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:41.077426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f834c-c384-4951-8a50-7b7847693f1d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:41.077712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f834c-c384-4951-8a50-7b7847693f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:41.093254 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8131bd5-c17f-4b85-8156-6217bb09ec71 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:41.133160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-1b4f834c-c384-4951-8a50-7b7847693f1d None None] MFA Rules not processed for user `f7a6cfe029514957862789f4c8096006`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:41.135049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1b4f834c-c384-4951-8a50-7b7847693f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:41.211501 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7542-b234-4df5-9e4c-95136c2e8efe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:41.212300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7542-b234-4df5-9e4c-95136c2e8efe service swift] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:41.212671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7542-b234-4df5-9e4c-95136c2e8efe service swift] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:41.213176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7542-b234-4df5-9e4c-95136c2e8efe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:41.234152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1231/2422] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:41.247033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f834c-c384-4951-8a50-7b7847693f1d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:41.249487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1b4f834c-c384-4951-8a50-7b7847693f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:41.322166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a7542-b234-4df5-9e4c-95136c2e8efe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:41.324610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a7542-b234-4df5-9e4c-95136c2e8efe service swift] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:41.338726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1192/2423] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 12:10:41.355343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f834c-c384-4951-8a50-7b7847693f1d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:41.360750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c89f0-9577-4ea8-b547-c8596abb4ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:41.361437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c89f0-9577-4ea8-b547-c8596abb4ccb service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:41.362200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c89f0-9577-4ea8-b547-c8596abb4ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:41.362200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c89f0-9577-4ea8-b547-c8596abb4ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:41.382189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c89f0-9577-4ea8-b547-c8596abb4ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:41.387335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c89f0-9577-4ea8-b547-c8596abb4ccb service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:41.402376 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1232/2424] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:41.437605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:43.671394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7542-b234-4df5-9e4c-95136c2e8efe service swift] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:43.671394 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5a0a7542-b234-4df5-9e4c-95136c2e8efe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:43.874542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7542-b234-4df5-9e4c-95136c2e8efe service swift] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:43.884128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:43.888015 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:43.889445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:43.890717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] PATH_INFO: `/v3/users/560a4fc7d17547ce87cd8b82c6230b3b` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:43.899900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560a4fc7d17547ce87cd8b82c6230b3b)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:43.909325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:44.203610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560a4fc7d17547ce87cd8b82c6230b3b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:44.239290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560a4fc7d17547ce87cd8b82c6230b3b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:44.264547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560a4fc7d17547ce87cd8b82c6230b3b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:44.422777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560a4fc7d17547ce87cd8b82c6230b3b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:44.423682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560a4fc7d17547ce87cd8b82c6230b3b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:44.432439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1193/2425] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:43 2022] DELETE /identity/v3/users/560a4fc7d17547ce87cd8b82c6230b3b => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:44.439873 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3965dbd-5c2d-4733-b318-35234eb9c944 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:44.440337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3965dbd-5c2d-4733-b318-35234eb9c944 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:44.440435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3965dbd-5c2d-4733-b318-35234eb9c944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:44.476413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-a3965dbd-5c2d-4733-b318-35234eb9c944 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:44.478031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a3965dbd-5c2d-4733-b318-35234eb9c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:44.577170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1233/2426] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:44.596929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:44.598663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:44.679235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24627ed8-a230-47a3-87c1-21d28bade9d5 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:44.685043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282929-1ed3-404e-bbe4-151ab18365c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:44.685813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282929-1ed3-404e-bbe4-151ab18365c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:44.689477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282929-1ed3-404e-bbe4-151ab18365c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:44.689477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08282929-1ed3-404e-bbe4-151ab18365c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:44.698039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08282929-1ed3-404e-bbe4-151ab18365c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:44.699796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08282929-1ed3-404e-bbe4-151ab18365c7 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:44.716207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1194/2427] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:45.255509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3965dbd-5c2d-4733-b318-35234eb9c944 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:45.274773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a3965dbd-5c2d-4733-b318-35234eb9c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:45.298795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3965dbd-5c2d-4733-b318-35234eb9c944 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:45.323227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:45.327384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:45.327384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:45.327384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] PATH_INFO: `/v3/users/166dc228445248aca173b2e5ee72c5d0` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:45.327384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] RBAC: Authorizing `identity:delete_user(user_id=166dc228445248aca173b2e5ee72c5d0)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:45.328284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:45.443946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:46.068346 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282929-1ed3-404e-bbe4-151ab18365c7 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:46.069778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-08282929-1ed3-404e-bbe4-151ab18365c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:46.092240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08282929-1ed3-404e-bbe4-151ab18365c7 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:46.094759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166dc228445248aca173b2e5ee72c5d0'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:46.095729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166dc228445248aca173b2e5ee72c5d0'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:46.109799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:46.111867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:46.113462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:46.113899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] PATH_INFO: `/v3/projects/78da5566eac242b2b21634d78dffae39` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:46.116245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78da5566eac242b2b21634d78dffae39)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:46.117540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166dc228445248aca173b2e5ee72c5d0'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:46.122069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:46.146588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166dc228445248aca173b2e5ee72c5d0'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:46.148108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-222d8654-4c75-44ed-a796-5ef7d4fdd73c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166dc228445248aca173b2e5ee72c5d0'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:46.259244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1234/2428] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:45 2022] DELETE /identity/v3/users/166dc228445248aca173b2e5ee72c5d0 => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:46.263652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3f23b-9ba2-4b28-9d3e-d77783397294 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:46.264217 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3f23b-9ba2-4b28-9d3e-d77783397294 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:46.264702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3f23b-9ba2-4b28-9d3e-d77783397294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:46.293317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78da5566eac242b2b21634d78dffae39', 'request_id': 'req-4b8b1e2b-3ec5-4297-8233-99a67748e939'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:46.303758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-bbe3f23b-9ba2-4b28-9d3e-d77783397294 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:46.305421 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-bbe3f23b-9ba2-4b28-9d3e-d77783397294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:46.317265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78da5566eac242b2b21634d78dffae39', 'request_id': 'req-4b8b1e2b-3ec5-4297-8233-99a67748e939'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:46.339352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78da5566eac242b2b21634d78dffae39', 'request_id': 'req-4b8b1e2b-3ec5-4297-8233-99a67748e939'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:46.403196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1235/2429] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:46.417713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3f23b-9ba2-4b28-9d3e-d77783397294 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:46.419478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-bbe3f23b-9ba2-4b28-9d3e-d77783397294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:46.464816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] The token cache is being invalidate because project 78da5566eac242b2b21634d78dffae39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:46.465126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:46.466337 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:46.468794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1195/2430] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:46 2022] DELETE /identity/v3/projects/78da5566eac242b2b21634d78dffae39 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:46.557710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3f23b-9ba2-4b28-9d3e-d77783397294 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:46.563281 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c5018-6ea0-462d-9af5-f99d9b87ede4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:46.564617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c5018-6ea0-462d-9af5-f99d9b87ede4 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:46.565125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c5018-6ea0-462d-9af5-f99d9b87ede4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:46.565688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c5018-6ea0-462d-9af5-f99d9b87ede4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:46.568950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-432c5018-6ea0-462d-9af5-f99d9b87ede4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:46.613980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c5018-6ea0-462d-9af5-f99d9b87ede4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:46.613980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c5018-6ea0-462d-9af5-f99d9b87ede4 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:46.686675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1236/2431] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:10:46.734917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:47.425097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:47.425097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:47.518714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b1e2b-3ec5-4297-8233-99a67748e939 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:47.525244 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:47.526014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:47.526338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:47.526666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] PATH_INFO: `/v3/projects/d7a1dc4384f2490b8489517ea72fead9` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:47.528090 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a1dc4384f2490b8489517ea72fead9)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:47.530175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:47.745588 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a1dc4384f2490b8489517ea72fead9', 'request_id': 'req-13d4f164-4165-4e39-b7ad-1a1be8722de7'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:47.767529 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2fa5d-026b-4d92-b052-8bc6ea9e97b9 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:47.768414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2fa5d-026b-4d92-b052-8bc6ea9e97b9 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:47.769017 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2fa5d-026b-4d92-b052-8bc6ea9e97b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:47.793729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a1dc4384f2490b8489517ea72fead9', 'request_id': 'req-13d4f164-4165-4e39-b7ad-1a1be8722de7'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:47.803438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-85c2fa5d-026b-4d92-b052-8bc6ea9e97b9 None None] MFA Rules not processed for user `88c79e3d1b6e46d6aa15f5f6e2b5498e`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:47.805044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-85c2fa5d-026b-4d92-b052-8bc6ea9e97b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:47.808423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a1dc4384f2490b8489517ea72fead9', 'request_id': 'req-13d4f164-4165-4e39-b7ad-1a1be8722de7'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:47.886418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] The token cache is being invalidate because project d7a1dc4384f2490b8489517ea72fead9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:47.886835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:47.887621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-13d4f164-4165-4e39-b7ad-1a1be8722de7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:47.891941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1237/2433] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:47.892830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1196/2433] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:47 2022] DELETE /identity/v3/projects/d7a1dc4384f2490b8489517ea72fead9 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:47.894316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d6ba8-d029-443c-89b5-3a2ee9ded228 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:47.894676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d6ba8-d029-443c-89b5-3a2ee9ded228 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:47.895021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d6ba8-d029-443c-89b5-3a2ee9ded228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:47.919269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-352d6ba8-d029-443c-89b5-3a2ee9ded228 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:47.920583 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-352d6ba8-d029-443c-89b5-3a2ee9ded228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:47.998418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1238/2434] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:48.011092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2470ce-30a6-4a01-a90f-e5c5df7a7765 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:48.011092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2470ce-30a6-4a01-a90f-e5c5df7a7765 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:48.011092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2470ce-30a6-4a01-a90f-e5c5df7a7765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:48.052083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2e2470ce-30a6-4a01-a90f-e5c5df7a7765 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:48.056016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2e2470ce-30a6-4a01-a90f-e5c5df7a7765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:48.070127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1197/2435] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:48.071674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d6ba8-d029-443c-89b5-3a2ee9ded228 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:48.084196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d6ba8-d029-443c-89b5-3a2ee9ded228 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:48.093860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d343b38-9876-40d8-b2e2-a3c4def86dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:48.095476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343b38-9876-40d8-b2e2-a3c4def86dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:48.096697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343b38-9876-40d8-b2e2-a3c4def86dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:48.098013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343b38-9876-40d8-b2e2-a3c4def86dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:48.099869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d343b38-9876-40d8-b2e2-a3c4def86dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:48.100420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d343b38-9876-40d8-b2e2-a3c4def86dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:48.102564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d343b38-9876-40d8-b2e2-a3c4def86dc0 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:48.119606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1239/2436] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:48.125448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2470ce-30a6-4a01-a90f-e5c5df7a7765 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:48.141733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2470ce-30a6-4a01-a90f-e5c5df7a7765 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:48.149872 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac472c3-e8ff-41a1-a8a9-8009cbd57c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:48.154184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac472c3-e8ff-41a1-a8a9-8009cbd57c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:48.154184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac472c3-e8ff-41a1-a8a9-8009cbd57c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:48.154184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac472c3-e8ff-41a1-a8a9-8009cbd57c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:48.154184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac472c3-e8ff-41a1-a8a9-8009cbd57c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:48.154841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac472c3-e8ff-41a1-a8a9-8009cbd57c11 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:48.330789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1198/2437] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:48 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:48.332914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d343b38-9876-40d8-b2e2-a3c4def86dc0 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:48.343666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d343b38-9876-40d8-b2e2-a3c4def86dc0 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:48.426936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2410d-ac23-42b1-a172-78d289b637ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:48.427656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2410d-ac23-42b1-a172-78d289b637ac admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:48.427965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2410d-ac23-42b1-a172-78d289b637ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:48.428240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2410d-ac23-42b1-a172-78d289b637ac admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:48.429283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2410d-ac23-42b1-a172-78d289b637ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:48.432162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2410d-ac23-42b1-a172-78d289b637ac admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:48.579457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1240/2438] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:48 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:48.581137 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac472c3-e8ff-41a1-a8a9-8009cbd57c11 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:48.607529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac472c3-e8ff-41a1-a8a9-8009cbd57c11 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:48.620036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0a933-6468-44cf-aa55-82d9f0f2627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:48.620674 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0a933-6468-44cf-aa55-82d9f0f2627a admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:48.620949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0a933-6468-44cf-aa55-82d9f0f2627a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:48.621324 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0a933-6468-44cf-aa55-82d9f0f2627a admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:48.622658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0a933-6468-44cf-aa55-82d9f0f2627a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:48.623834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0a933-6468-44cf-aa55-82d9f0f2627a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:48.643669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1199/2439] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:48.645222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2410d-ac23-42b1-a172-78d289b637ac admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:48.658655 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2410d-ac23-42b1-a172-78d289b637ac admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:48.676779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c39e5c-7d4d-4f03-8bf2-010693429eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:48.677499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39e5c-7d4d-4f03-8bf2-010693429eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:48.677801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39e5c-7d4d-4f03-8bf2-010693429eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:48.678175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39e5c-7d4d-4f03-8bf2-010693429eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:48.679042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c39e5c-7d4d-4f03-8bf2-010693429eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:48.682000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c39e5c-7d4d-4f03-8bf2-010693429eb9 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:48.699072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1241/2440] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:10:48.702250 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0a933-6468-44cf-aa55-82d9f0f2627a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:48.714139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0a933-6468-44cf-aa55-82d9f0f2627a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:48.719158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5668a2f-b177-425b-bd16-00b241be95fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:48.720928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5668a2f-b177-425b-bd16-00b241be95fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:48.720928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5668a2f-b177-425b-bd16-00b241be95fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:48.720928 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5668a2f-b177-425b-bd16-00b241be95fb admin admin] PATH_INFO: `/v3/projects/3add1b90bb0c411e8da4c18338c3e2d5/users/0563d78b8dcf49b5ad591444c7a3490f/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:48.743595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5668a2f-b177-425b-bd16-00b241be95fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3add1b90bb0c411e8da4c18338c3e2d5, user_id=0563d78b8dcf49b5ad591444c7a3490f, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:48.746296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5668a2f-b177-425b-bd16-00b241be95fb admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:48.813151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1200/2441] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:48 2022] PUT /identity/v3/projects/3add1b90bb0c411e8da4c18338c3e2d5/users/0563d78b8dcf49b5ad591444c7a3490f/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:48.819085 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2406e01-b58f-4e74-b57c-c77ab086d4a1 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:48.819610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2406e01-b58f-4e74-b57c-c77ab086d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:48.819610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2406e01-b58f-4e74-b57c-c77ab086d4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:48.861551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e2406e01-b58f-4e74-b57c-c77ab086d4a1 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:48.866392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e2406e01-b58f-4e74-b57c-c77ab086d4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:48.969027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1242/2442] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:48.980254 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5668a2f-b177-425b-bd16-00b241be95fb admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:48.984583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d5668a2f-b177-425b-bd16-00b241be95fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:49.013661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c219c-8155-40be-9ece-9b05a0d133ca None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:49.014244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c219c-8155-40be-9ece-9b05a0d133ca None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:49.014680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c219c-8155-40be-9ece-9b05a0d133ca None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:49.016249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1243/2443] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:10:49.071784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66933ee-470d-4d75-bc0e-0fa8a6993c2d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:49.072227 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66933ee-470d-4d75-bc0e-0fa8a6993c2d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:49.074325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:49.076177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66933ee-470d-4d75-bc0e-0fa8a6993c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:49.116976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d66933ee-470d-4d75-bc0e-0fa8a6993c2d None None] MFA Rules not processed for user `877b59ec265f42e4bf8edbd9767e3319`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:49.120048 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d66933ee-470d-4d75-bc0e-0fa8a6993c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:49.143353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5668a2f-b177-425b-bd16-00b241be95fb admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:49.171993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e88aed-308a-4b78-a8c9-35fb6e5bcdc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:49.172652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88aed-308a-4b78-a8c9-35fb6e5bcdc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:49.173044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88aed-308a-4b78-a8c9-35fb6e5bcdc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:49.173275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88aed-308a-4b78-a8c9-35fb6e5bcdc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:49.185547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e88aed-308a-4b78-a8c9-35fb6e5bcdc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:49.188236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e88aed-308a-4b78-a8c9-35fb6e5bcdc5 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:49.209813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1201/2444] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:49.229709 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1244/2445] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:10:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:49.263725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e88aed-308a-4b78-a8c9-35fb6e5bcdc5 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:49.265347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a9e88aed-308a-4b78-a8c9-35fb6e5bcdc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:49.287422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e88aed-308a-4b78-a8c9-35fb6e5bcdc5 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:49.314157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6d7c5-fdd9-424a-b9b3-6c13b1d76b6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:49.314959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6d7c5-fdd9-424a-b9b3-6c13b1d76b6f service placement] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:49.315482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6d7c5-fdd9-424a-b9b3-6c13b1d76b6f service placement] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:49.315816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6d7c5-fdd9-424a-b9b3-6c13b1d76b6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:49.337901 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6d7c5-fdd9-424a-b9b3-6c13b1d76b6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:49.343283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6d7c5-fdd9-424a-b9b3-6c13b1d76b6f service placement] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:49.366109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1202/2446] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:49.815758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:50.984851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66933ee-470d-4d75-bc0e-0fa8a6993c2d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:50.986332 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d66933ee-470d-4d75-bc0e-0fa8a6993c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:51.007797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66933ee-470d-4d75-bc0e-0fa8a6993c2d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:51.018934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:51.018934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:51.018934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:51.018934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] PATH_INFO: `/v3/users/4a7f41fb3eb649d8948d595000434759` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:51.019359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7f41fb3eb649d8948d595000434759)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:51.020759 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:51.357397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7f41fb3eb649d8948d595000434759'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:51.375828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7f41fb3eb649d8948d595000434759'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:51.404977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7f41fb3eb649d8948d595000434759'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:51.437381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7f41fb3eb649d8948d595000434759'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:51.438420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7f41fb3eb649d8948d595000434759'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:51.543876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1245/2447] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:50 2022] DELETE /identity/v3/users/4a7f41fb3eb649d8948d595000434759 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:51.959632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6d7c5-fdd9-424a-b9b3-6c13b1d76b6f service placement] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:51.991625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6d7c5-fdd9-424a-b9b3-6c13b1d76b6f service placement] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:52.127867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:52.129172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:52.129425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:52.129796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] PATH_INFO: `/v3/projects/2072268d884b4e1a99ac64dc80453193` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:52.131217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2072268d884b4e1a99ac64dc80453193)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:52.134317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:52.279906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2072268d884b4e1a99ac64dc80453193', 'request_id': 'req-ea062036-0ea5-4929-a890-d97a73d92024'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:52.292050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2072268d884b4e1a99ac64dc80453193', 'request_id': 'req-ea062036-0ea5-4929-a890-d97a73d92024'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:52.303776 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2072268d884b4e1a99ac64dc80453193', 'request_id': 'req-ea062036-0ea5-4929-a890-d97a73d92024'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:52.415047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] The token cache is being invalidate because project 2072268d884b4e1a99ac64dc80453193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:52.415047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:52.415047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ea062036-0ea5-4929-a890-d97a73d92024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:52.420400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1203/2448] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:51 2022] DELETE /identity/v3/projects/2072268d884b4e1a99ac64dc80453193 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:52.421912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:52.424177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:52.450377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed195c8-2bf2-4f9d-8b59-6c559affa7a2 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:52.576695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:52.576695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:52.576695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:52.576695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] PATH_INFO: `/v3/users/cdba5ce2b53a46a2ab613209b2d782ff` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:52.577986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdba5ce2b53a46a2ab613209b2d782ff)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:52.579795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3cdb1-3274-428e-bf86-b91fb313851f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:52.580301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3cdb1-3274-428e-bf86-b91fb313851f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:52.580784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3cdb1-3274-428e-bf86-b91fb313851f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:52.580977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:52.633771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5fb3cdb1-3274-428e-bf86-b91fb313851f None None] MFA Rules not processed for user `0563d78b8dcf49b5ad591444c7a3490f`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:52.636452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5fb3cdb1-3274-428e-bf86-b91fb313851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:52.729551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1204/2449] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:52.742085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3cdb1-3274-428e-bf86-b91fb313851f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:52.744881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5fb3cdb1-3274-428e-bf86-b91fb313851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:52.861853 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3cdb1-3274-428e-bf86-b91fb313851f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:52.874052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1cb41-08ba-41f5-ac38-0560a97b621b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:52.874749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1cb41-08ba-41f5-ac38-0560a97b621b service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:52.875040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1cb41-08ba-41f5-ac38-0560a97b621b service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:52.875315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1cb41-08ba-41f5-ac38-0560a97b621b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:52.883477 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdba5ce2b53a46a2ab613209b2d782ff'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:52.884457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdba5ce2b53a46a2ab613209b2d782ff'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:52.889787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1cb41-08ba-41f5-ac38-0560a97b621b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:52.891477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1cb41-08ba-41f5-ac38-0560a97b621b service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:52.893541 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdba5ce2b53a46a2ab613209b2d782ff'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:52.902045 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1205/2450] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:52.914733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdba5ce2b53a46a2ab613209b2d782ff'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:52.916091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-0c573e28-76df-4fb7-9de4-15608b4bb0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdba5ce2b53a46a2ab613209b2d782ff'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:53.073566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1246/2451] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:10:52 2022] DELETE /identity/v3/users/cdba5ce2b53a46a2ab613209b2d782ff => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:53.381934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1cb41-08ba-41f5-ac38-0560a97b621b service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:53.384085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f7f1cb41-08ba-41f5-ac38-0560a97b621b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:53.414847 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1cb41-08ba-41f5-ac38-0560a97b621b service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:53.542534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:53.545366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:53.545866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:53.546958 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] PATH_INFO: `/v3/projects/aac6055aa8a04374a2689f35c1004324` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:53.551131 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac6055aa8a04374a2689f35c1004324)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:53.554748 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:53.676816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:53.733628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac6055aa8a04374a2689f35c1004324', 'request_id': 'req-42fe8612-f549-484e-b406-c8bccd8c24e3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:53.743494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac6055aa8a04374a2689f35c1004324', 'request_id': 'req-42fe8612-f549-484e-b406-c8bccd8c24e3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:53.750167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac6055aa8a04374a2689f35c1004324', 'request_id': 'req-42fe8612-f549-484e-b406-c8bccd8c24e3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:53.866462 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] The token cache is being invalidate because project aac6055aa8a04374a2689f35c1004324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:10:53.867061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:53.869978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-42fe8612-f549-484e-b406-c8bccd8c24e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:10:53.871789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1206/2452] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:10:53 2022] DELETE /identity/v3/projects/aac6055aa8a04374a2689f35c1004324 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:53.880537 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b112c-672e-4b15-a8b8-10e790f3ef34 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:53.880831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b112c-672e-4b15-a8b8-10e790f3ef34 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:53.881262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b112c-672e-4b15-a8b8-10e790f3ef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:53.918665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-221b112c-672e-4b15-a8b8-10e790f3ef34 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:53.919954 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-221b112c-672e-4b15-a8b8-10e790f3ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:54.040846 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1247/2453] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:54.048898 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d36f-dbb9-4f24-92bb-a4c6fd1bdec3 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:54.049286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d36f-dbb9-4f24-92bb-a4c6fd1bdec3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:54.049693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d36f-dbb9-4f24-92bb-a4c6fd1bdec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:54.093710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c9d1d36f-dbb9-4f24-92bb-a4c6fd1bdec3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:54.097413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c9d1d36f-dbb9-4f24-92bb-a4c6fd1bdec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:54.119786 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1207/2454] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:54.123804 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b112c-672e-4b15-a8b8-10e790f3ef34 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:54.135595 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b112c-672e-4b15-a8b8-10e790f3ef34 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:54.143196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43759f-ea96-426b-a2b8-1c5c733458e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:54.144106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43759f-ea96-426b-a2b8-1c5c733458e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:54.144553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43759f-ea96-426b-a2b8-1c5c733458e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:54.144976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43759f-ea96-426b-a2b8-1c5c733458e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:54.145795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43759f-ea96-426b-a2b8-1c5c733458e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:10:54.146097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43759f-ea96-426b-a2b8-1c5c733458e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:54.147947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43759f-ea96-426b-a2b8-1c5c733458e3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:54.161882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1248/2455] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:10:54.166896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d36f-dbb9-4f24-92bb-a4c6fd1bdec3 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:54.182290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d36f-dbb9-4f24-92bb-a4c6fd1bdec3 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:54.201576 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a417640-4352-45c5-94a2-5991d4d8d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:54.202122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417640-4352-45c5-94a2-5991d4d8d138 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:54.202431 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417640-4352-45c5-94a2-5991d4d8d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:54.202707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a417640-4352-45c5-94a2-5991d4d8d138 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:54.203545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a417640-4352-45c5-94a2-5991d4d8d138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:54.205619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a417640-4352-45c5-94a2-5991d4d8d138 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:54.331371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1208/2456] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:54 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:54.336380 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43759f-ea96-426b-a2b8-1c5c733458e3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:54.353947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43759f-ea96-426b-a2b8-1c5c733458e3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:54.451926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb4fd-10a8-466f-a7cf-c72f1ad3086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:54.452696 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb4fd-10a8-466f-a7cf-c72f1ad3086c admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:54.452976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb4fd-10a8-466f-a7cf-c72f1ad3086c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:54.453412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb4fd-10a8-466f-a7cf-c72f1ad3086c admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:54.454246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fb4fd-10a8-466f-a7cf-c72f1ad3086c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:54.456971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fb4fd-10a8-466f-a7cf-c72f1ad3086c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:54.526449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:54.589630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1249/2457] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:54 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:54.600648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a417640-4352-45c5-94a2-5991d4d8d138 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:54.632599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a417640-4352-45c5-94a2-5991d4d8d138 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:54.632599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99f36b-a686-4dfe-ba3a-27338959059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:54.632599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99f36b-a686-4dfe-ba3a-27338959059f admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:54.632599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99f36b-a686-4dfe-ba3a-27338959059f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:54.633382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99f36b-a686-4dfe-ba3a-27338959059f admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:54.633382 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99f36b-a686-4dfe-ba3a-27338959059f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:54.635263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99f36b-a686-4dfe-ba3a-27338959059f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:54.650598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1209/2458] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:54.652966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb4fd-10a8-466f-a7cf-c72f1ad3086c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:54.672462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb4fd-10a8-466f-a7cf-c72f1ad3086c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:54.678004 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060c682-ccec-4636-9adb-812b46085c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:54.679315 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060c682-ccec-4636-9adb-812b46085c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:54.679606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060c682-ccec-4636-9adb-812b46085c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:54.679886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060c682-ccec-4636-9adb-812b46085c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:54.680569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060c682-ccec-4636-9adb-812b46085c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:54.682162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060c682-ccec-4636-9adb-812b46085c83 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:54.702025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1250/2459] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:54.708247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99f36b-a686-4dfe-ba3a-27338959059f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:54.724171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99f36b-a686-4dfe-ba3a-27338959059f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:54.734341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e087-8405-4fe1-b165-f961f22e37f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:54.734341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e087-8405-4fe1-b165-f961f22e37f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:54.734341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e087-8405-4fe1-b165-f961f22e37f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:54.734341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5e087-8405-4fe1-b165-f961f22e37f4 admin admin] PATH_INFO: `/v3/projects/a390aaf2d80b46359d06e96983c59b77/users/edf97f65a29f476db51a5143ca1424a0/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:54.750750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5e087-8405-4fe1-b165-f961f22e37f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a390aaf2d80b46359d06e96983c59b77, user_id=edf97f65a29f476db51a5143ca1424a0, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:54.753516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5e087-8405-4fe1-b165-f961f22e37f4 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:54.966630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1210/2460] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:54 2022] PUT /identity/v3/projects/a390aaf2d80b46359d06e96983c59b77/users/edf97f65a29f476db51a5143ca1424a0/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:54.980563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2c761-8f6e-48c2-ab11-eee9c077018b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:54.980761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2c761-8f6e-48c2-ab11-eee9c077018b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:54.981004 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2c761-8f6e-48c2-ab11-eee9c077018b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:55.045473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-68b2c761-8f6e-48c2-ab11-eee9c077018b None None] MFA Rules not processed for user `edf97f65a29f476db51a5143ca1424a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:55.045473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-68b2c761-8f6e-48c2-ab11-eee9c077018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:55.082605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1251/2461] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:55.093880 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e087-8405-4fe1-b165-f961f22e37f4 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:55.164084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5e087-8405-4fe1-b165-f961f22e37f4 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:55.168780 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170822e-6a66-458b-8f20-d98ef813e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:55.169389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170822e-6a66-458b-8f20-d98ef813e45a admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:55.169670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170822e-6a66-458b-8f20-d98ef813e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:55.169946 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170822e-6a66-458b-8f20-d98ef813e45a admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:55.170698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170822e-6a66-458b-8f20-d98ef813e45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:55.172600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170822e-6a66-458b-8f20-d98ef813e45a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:55.634841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1211/2462] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:55 2022] POST /identity/v3/projects => generated 385 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:55.636418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2c761-8f6e-48c2-ab11-eee9c077018b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:55.647723 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2c761-8f6e-48c2-ab11-eee9c077018b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:55.702851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d246064-bcf3-4dd3-8026-a43343fc6106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:55.703546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d246064-bcf3-4dd3-8026-a43343fc6106 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:55.703723 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d246064-bcf3-4dd3-8026-a43343fc6106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:55.703991 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d246064-bcf3-4dd3-8026-a43343fc6106 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:55.704622 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d246064-bcf3-4dd3-8026-a43343fc6106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:55.707375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d246064-bcf3-4dd3-8026-a43343fc6106 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:55.897194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1252/2463] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:55 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:10:55.897929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170822e-6a66-458b-8f20-d98ef813e45a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:55.909240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170822e-6a66-458b-8f20-d98ef813e45a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:55.916322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c82d67-3c60-4013-8b56-15e59bfc9745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:55.917783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c82d67-3c60-4013-8b56-15e59bfc9745 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:55.918325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c82d67-3c60-4013-8b56-15e59bfc9745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:55.918859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c82d67-3c60-4013-8b56-15e59bfc9745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:55.920244 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c82d67-3c60-4013-8b56-15e59bfc9745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:55.922667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c82d67-3c60-4013-8b56-15e59bfc9745 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:55.937503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1212/2464] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:55.942532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d246064-bcf3-4dd3-8026-a43343fc6106 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:55.953705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d246064-bcf3-4dd3-8026-a43343fc6106 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:55.962075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946202-0ba2-4e65-b1fd-d936c2d86482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:55.962869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946202-0ba2-4e65-b1fd-d936c2d86482 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:55.963248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946202-0ba2-4e65-b1fd-d936c2d86482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:55.963629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946202-0ba2-4e65-b1fd-d936c2d86482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:55.964400 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60946202-0ba2-4e65-b1fd-d936c2d86482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:55.966098 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60946202-0ba2-4e65-b1fd-d936c2d86482 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:55.978841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1253/2465] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:55.985934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c82d67-3c60-4013-8b56-15e59bfc9745 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:55.999468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c82d67-3c60-4013-8b56-15e59bfc9745 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:56.006101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e1e5b-58a4-404d-8d50-291b01a047e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:56.007161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e1e5b-58a4-404d-8d50-291b01a047e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:56.007663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e1e5b-58a4-404d-8d50-291b01a047e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:56.008372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e1e5b-58a4-404d-8d50-291b01a047e0 admin admin] PATH_INFO: `/v3/projects/f9ad1a7e241e4a808b651a8fd2372b72/users/b2f7e9875b3b46b4a994d9f2ed4accc4/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:56.028341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e1e5b-58a4-404d-8d50-291b01a047e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ad1a7e241e4a808b651a8fd2372b72, user_id=b2f7e9875b3b46b4a994d9f2ed4accc4, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:56.031775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e1e5b-58a4-404d-8d50-291b01a047e0 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:56.137083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32ec2-7924-4103-9cd3-f95e75496539 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:56.137083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32ec2-7924-4103-9cd3-f95e75496539 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:56.137083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf32ec2-7924-4103-9cd3-f95e75496539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:56.157800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2bf32ec2-7924-4103-9cd3-f95e75496539 None None] MFA Rules not processed for user `0563d78b8dcf49b5ad591444c7a3490f`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:56.159107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2bf32ec2-7924-4103-9cd3-f95e75496539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:56.207510 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1213/2466] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:55 2022] PUT /identity/v3/projects/f9ad1a7e241e4a808b651a8fd2372b72/users/b2f7e9875b3b46b4a994d9f2ed4accc4/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:56.211483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e4089-eedb-4955-af78-fb5fca8b727b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:56.211989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e4089-eedb-4955-af78-fb5fca8b727b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:56.213830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e4089-eedb-4955-af78-fb5fca8b727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:56.263457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-f33e4089-eedb-4955-af78-fb5fca8b727b None None] MFA Rules not processed for user `b2f7e9875b3b46b4a994d9f2ed4accc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:56.264829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f33e4089-eedb-4955-af78-fb5fca8b727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:56.274133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1254/2467] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:56.349903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1214/2468] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:56.397174 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf32ec2-7924-4103-9cd3-f95e75496539 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:56.410237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf32ec2-7924-4103-9cd3-f95e75496539 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:56.484190 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062061c-1433-49ad-bba7-829e56350b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:56.484818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062061c-1433-49ad-bba7-829e56350b70 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:56.485098 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062061c-1433-49ad-bba7-829e56350b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:56.485365 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062061c-1433-49ad-bba7-829e56350b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:56.486011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062061c-1433-49ad-bba7-829e56350b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:56.488801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062061c-1433-49ad-bba7-829e56350b70 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:56.713656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1255/2469] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:10:56 2022] POST /identity/v3/projects => generated 385 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:56.717868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e4089-eedb-4955-af78-fb5fca8b727b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:56.729305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e4089-eedb-4955-af78-fb5fca8b727b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:56.790704 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3faa57-d764-4743-a6c0-9ce0f20be147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:56.791329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3faa57-d764-4743-a6c0-9ce0f20be147 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:56.791617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3faa57-d764-4743-a6c0-9ce0f20be147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:56.792076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3faa57-d764-4743-a6c0-9ce0f20be147 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:56.793121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3faa57-d764-4743-a6c0-9ce0f20be147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:56.795000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3faa57-d764-4743-a6c0-9ce0f20be147 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:56.933406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1215/2470] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:10:56 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:10:56.941006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062061c-1433-49ad-bba7-829e56350b70 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:56.957219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062061c-1433-49ad-bba7-829e56350b70 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:56.968675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29437a7b-5a37-40d6-a40a-b31f2621d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:56.969316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29437a7b-5a37-40d6-a40a-b31f2621d27c admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:56.969742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29437a7b-5a37-40d6-a40a-b31f2621d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:56.970024 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29437a7b-5a37-40d6-a40a-b31f2621d27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:56.970821 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29437a7b-5a37-40d6-a40a-b31f2621d27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:56.974757 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29437a7b-5a37-40d6-a40a-b31f2621d27c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:56.996525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1256/2471] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:57.000627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3faa57-d764-4743-a6c0-9ce0f20be147 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:57.012099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3faa57-d764-4743-a6c0-9ce0f20be147 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:57.046910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577217-80c2-41b8-adc2-d37166eec049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:57.047580 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577217-80c2-41b8-adc2-d37166eec049 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:57.047860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577217-80c2-41b8-adc2-d37166eec049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:57.048134 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577217-80c2-41b8-adc2-d37166eec049 admin admin] PATH_INFO: `/v3/projects/c31157e301404b31a7c64910b5dbcb4f/users/5eb8acfea55f482989462c9f505c8e5a/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:57.087081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e577217-80c2-41b8-adc2-d37166eec049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31157e301404b31a7c64910b5dbcb4f, user_id=5eb8acfea55f482989462c9f505c8e5a, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:57.098101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e577217-80c2-41b8-adc2-d37166eec049 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:57.213014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c3e6-f49b-4ada-a1c5-180501f79785 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:57.213014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c3e6-f49b-4ada-a1c5-180501f79785 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:57.213014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c3e6-f49b-4ada-a1c5-180501f79785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:57.218590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1216/2472] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:56 2022] PUT /identity/v3/projects/c31157e301404b31a7c64910b5dbcb4f/users/5eb8acfea55f482989462c9f505c8e5a/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:10:57.219504 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577217-80c2-41b8-adc2-d37166eec049 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:57.234091 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e762c3e6-f49b-4ada-a1c5-180501f79785 None None] MFA Rules not processed for user `fbb73389ac774916afaa996c87fdc010`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:57.235718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e762c3e6-f49b-4ada-a1c5-180501f79785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:57.302878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1257/2473] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:10:57.325104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577217-80c2-41b8-adc2-d37166eec049 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:57.330062 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b52b4e-128b-4000-b9de-c751e1cdc587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:57.330951 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52b4e-128b-4000-b9de-c751e1cdc587 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:57.331515 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52b4e-128b-4000-b9de-c751e1cdc587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:57.331795 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52b4e-128b-4000-b9de-c751e1cdc587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:57.332575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b52b4e-128b-4000-b9de-c751e1cdc587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:57.334168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b52b4e-128b-4000-b9de-c751e1cdc587 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:57.346002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1217/2474] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:10:57.350787 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762c3e6-f49b-4ada-a1c5-180501f79785 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:57.364652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762c3e6-f49b-4ada-a1c5-180501f79785 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:57.377926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0e14e-fc83-405f-a144-ec591d6aa2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:57.379901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0e14e-fc83-405f-a144-ec591d6aa2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:57.380289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0e14e-fc83-405f-a144-ec591d6aa2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:57.380669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0e14e-fc83-405f-a144-ec591d6aa2b3 admin admin] PATH_INFO: `/v3/projects/c31157e301404b31a7c64910b5dbcb4f/users/5eb8acfea55f482989462c9f505c8e5a/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:57.382904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0e14e-fc83-405f-a144-ec591d6aa2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31157e301404b31a7c64910b5dbcb4f, user_id=5eb8acfea55f482989462c9f505c8e5a, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:57.385798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0e14e-fc83-405f-a144-ec591d6aa2b3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:57.404205 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1258/2475] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:10:57 2022] PUT /identity/v3/projects/c31157e301404b31a7c64910b5dbcb4f/users/5eb8acfea55f482989462c9f505c8e5a/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:10:57.417646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e09e-ad1c-4b53-9386-c6db6b2272ae None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:57.417646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e09e-ad1c-4b53-9386-c6db6b2272ae None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:57.417646 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e09e-ad1c-4b53-9386-c6db6b2272ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:57.453271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-d160e09e-ad1c-4b53-9386-c6db6b2272ae None None] MFA Rules not processed for user `5eb8acfea55f482989462c9f505c8e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:10:57.454559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d160e09e-ad1c-4b53-9386-c6db6b2272ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:57.544083 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1218/2476] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:10:57.547643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0e14e-fc83-405f-a144-ec591d6aa2b3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:10:57.550623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2be0e14e-fc83-405f-a144-ec591d6aa2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:10:57.632881 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0e14e-fc83-405f-a144-ec591d6aa2b3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:10:57.639302 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2f984-8648-40ee-ba1b-d0b3dfa7eff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:10:57.640195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2f984-8648-40ee-ba1b-d0b3dfa7eff8 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:10:57.640576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2f984-8648-40ee-ba1b-d0b3dfa7eff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:10:57.640950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2f984-8648-40ee-ba1b-d0b3dfa7eff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:10:57.722353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2f984-8648-40ee-ba1b-d0b3dfa7eff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:10:57.725614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2f984-8648-40ee-ba1b-d0b3dfa7eff8 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:10:57.743056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1259/2477] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:10:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:10:57.860631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:10:58.903621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:00.520703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:00.788691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:01.230808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e09e-ad1c-4b53-9386-c6db6b2272ae None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:01.235712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e09e-ad1c-4b53-9386-c6db6b2272ae None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:01.240271 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d188-a53e-4f43-a15d-0cf79324866d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:01.241153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d188-a53e-4f43-a15d-0cf79324866d service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:01.241439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d188-a53e-4f43-a15d-0cf79324866d service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:01.241714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d188-a53e-4f43-a15d-0cf79324866d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:01.302277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4d188-a53e-4f43-a15d-0cf79324866d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:01.303643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4d188-a53e-4f43-a15d-0cf79324866d service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:01.313108 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1219/2478] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:02.724079 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:03.180911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:03.305783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2f984-8648-40ee-ba1b-d0b3dfa7eff8 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:03.317674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2f984-8648-40ee-ba1b-d0b3dfa7eff8 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:03.328769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714587d0-e10d-43b4-b92a-fb322216bfce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:03.329402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714587d0-e10d-43b4-b92a-fb322216bfce service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:03.329685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714587d0-e10d-43b4-b92a-fb322216bfce service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:03.329940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714587d0-e10d-43b4-b92a-fb322216bfce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:03.360952 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714587d0-e10d-43b4-b92a-fb322216bfce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:03.363049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714587d0-e10d-43b4-b92a-fb322216bfce service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:03.376228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1260/2479] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:04.645644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91228f-1281-45a2-bb4f-3b3912928dd1 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:04.646187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91228f-1281-45a2-bb4f-3b3912928dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:04.646187 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91228f-1281-45a2-bb4f-3b3912928dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:04.674686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-8d91228f-1281-45a2-bb4f-3b3912928dd1 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:04.674962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8d91228f-1281-45a2-bb4f-3b3912928dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:04.752600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1220/2480] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:11:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:04.766866 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714587d0-e10d-43b4-b92a-fb322216bfce service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:04.768404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-714587d0-e10d-43b4-b92a-fb322216bfce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:04.837698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714587d0-e10d-43b4-b92a-fb322216bfce service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:04.842780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48816fd-9f5e-4b89-86e0-4e9eea1baddd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:04.843407 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48816fd-9f5e-4b89-86e0-4e9eea1baddd service swift] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:04.843718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48816fd-9f5e-4b89-86e0-4e9eea1baddd service swift] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:04.843998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48816fd-9f5e-4b89-86e0-4e9eea1baddd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:04.853812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf2d3-f316-48f0-83e0-4f9da86b0184 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:04.854021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48816fd-9f5e-4b89-86e0-4e9eea1baddd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:04.854130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf2d3-f316-48f0-83e0-4f9da86b0184 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:04.854545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cf2d3-f316-48f0-83e0-4f9da86b0184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:04.855518 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48816fd-9f5e-4b89-86e0-4e9eea1baddd service swift] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:04.863969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1261/2481] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:11:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:11:04.875579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b62cf2d3-f316-48f0-83e0-4f9da86b0184 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:04.877556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b62cf2d3-f316-48f0-83e0-4f9da86b0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:05.012459 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1221/2482] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:11:05.042158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48816fd-9f5e-4b89-86e0-4e9eea1baddd service swift] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:05.043634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d48816fd-9f5e-4b89-86e0-4e9eea1baddd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:05.222168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48816fd-9f5e-4b89-86e0-4e9eea1baddd service swift] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:05.249929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6205ca-a400-40de-873c-ee238911eee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:05.251023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6205ca-a400-40de-873c-ee238911eee7 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:05.251456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6205ca-a400-40de-873c-ee238911eee7 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:05.251895 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6205ca-a400-40de-873c-ee238911eee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:05.281852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6205ca-a400-40de-873c-ee238911eee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:05.283629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6205ca-a400-40de-873c-ee238911eee7 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:05.311658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1262/2483] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:05.731541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:06.067540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:08.615404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:08.996825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:09.165093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cf2d3-f316-48f0-83e0-4f9da86b0184 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:09.174922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cf2d3-f316-48f0-83e0-4f9da86b0184 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:09.184047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:09.184705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:09.184985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:09.185420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] PATH_INFO: `/v3/users/edf97f65a29f476db51a5143ca1424a0` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:09.186458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf97f65a29f476db51a5143ca1424a0)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:09.188779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:09.412925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf97f65a29f476db51a5143ca1424a0'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:09.420614 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf97f65a29f476db51a5143ca1424a0'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:09.434550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf97f65a29f476db51a5143ca1424a0'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:09.520026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf97f65a29f476db51a5143ca1424a0'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:09.522604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf97f65a29f476db51a5143ca1424a0'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:09.530426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1222/2484] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:11:09 2022] DELETE /identity/v3/users/edf97f65a29f476db51a5143ca1424a0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:09.535295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3cd9e-2c93-41c8-83df-ee03c4c8f678 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:09.535852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3cd9e-2c93-41c8-83df-ee03c4c8f678 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:09.536418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3cd9e-2c93-41c8-83df-ee03c4c8f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:09.561516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9aa3cd9e-2c93-41c8-83df-ee03c4c8f678 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:09.563094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9aa3cd9e-2c93-41c8-83df-ee03c4c8f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:09.685241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1263/2485] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:11:09.697237 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:09.698703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:09.779100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f39fa-e3bf-46d3-abf9-6686d6bb6394 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:09.782775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ab05c-6350-42e7-825d-566ccf5ad033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:09.783397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ab05c-6350-42e7-825d-566ccf5ad033 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:09.783679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ab05c-6350-42e7-825d-566ccf5ad033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:09.783960 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ab05c-6350-42e7-825d-566ccf5ad033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:09.794230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ab05c-6350-42e7-825d-566ccf5ad033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:09.795690 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ab05c-6350-42e7-825d-566ccf5ad033 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:09.806005 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1223/2486] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:11:10.381501 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3cd9e-2c93-41c8-83df-ee03c4c8f678 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:10.382934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9aa3cd9e-2c93-41c8-83df-ee03c4c8f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:10.401458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3cd9e-2c93-41c8-83df-ee03c4c8f678 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:10.407181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:10.409552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:10.409552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:10.409552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] PATH_INFO: `/v3/projects/a390aaf2d80b46359d06e96983c59b77` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:10.410885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a390aaf2d80b46359d06e96983c59b77)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:10.413153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:11.032021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a390aaf2d80b46359d06e96983c59b77', 'request_id': 'req-a294c316-2ccc-468b-a60f-f122f2bd906e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:11.310993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a390aaf2d80b46359d06e96983c59b77', 'request_id': 'req-a294c316-2ccc-468b-a60f-f122f2bd906e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:11.318676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a390aaf2d80b46359d06e96983c59b77', 'request_id': 'req-a294c316-2ccc-468b-a60f-f122f2bd906e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:11.330016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] The token cache is being invalidate because project a390aaf2d80b46359d06e96983c59b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:11:11.330349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:11.331027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:11.332590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1264/2487] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:11:10 2022] DELETE /identity/v3/projects/a390aaf2d80b46359d06e96983c59b77 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:11.336793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ab05c-6350-42e7-825d-566ccf5ad033 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:11.347301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ab05c-6350-42e7-825d-566ccf5ad033 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:11.428518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:11.429587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:11.429780 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:11.430061 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] PATH_INFO: `/v3/users/b2f7e9875b3b46b4a994d9f2ed4accc4` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:11.431433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f7e9875b3b46b4a994d9f2ed4accc4)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:11.433371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:11.504210 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:11.664304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f7e9875b3b46b4a994d9f2ed4accc4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:11.671441 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f7e9875b3b46b4a994d9f2ed4accc4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:11.685875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f7e9875b3b46b4a994d9f2ed4accc4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:11.750822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f7e9875b3b46b4a994d9f2ed4accc4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:11.751446 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f7e9875b3b46b4a994d9f2ed4accc4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:11.759076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1224/2488] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:11:11 2022] DELETE /identity/v3/users/b2f7e9875b3b46b4a994d9f2ed4accc4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:11.932149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:12.431925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:12.432516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:12.448867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294c316-2ccc-468b-a60f-f122f2bd906e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:12.515704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:12.517050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:12.517338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:12.517639 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] PATH_INFO: `/v3/projects/f9ad1a7e241e4a808b651a8fd2372b72` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:12.519889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ad1a7e241e4a808b651a8fd2372b72)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:12.522295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:12.705680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ad1a7e241e4a808b651a8fd2372b72', 'request_id': 'req-43c4149a-9553-430f-81b8-d65914038e97'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:12.774436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ad1a7e241e4a808b651a8fd2372b72', 'request_id': 'req-43c4149a-9553-430f-81b8-d65914038e97'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:12.782072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ad1a7e241e4a808b651a8fd2372b72', 'request_id': 'req-43c4149a-9553-430f-81b8-d65914038e97'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:12.794760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] The token cache is being invalidate because project f9ad1a7e241e4a808b651a8fd2372b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:11:12.795053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:12.795811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:12.797339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1265/2489] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:11:12 2022] DELETE /identity/v3/projects/f9ad1a7e241e4a808b651a8fd2372b72 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:12.802160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:12.803605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:12.816642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a27aa-2897-4df2-93fe-cb6cc96bf9ce admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:12.879486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:12.880671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:12.880978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:12.881255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] PATH_INFO: `/v3/users/5eb8acfea55f482989462c9f505c8e5a` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:12.882461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb8acfea55f482989462c9f505c8e5a)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:12.884404 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:13.082480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb8acfea55f482989462c9f505c8e5a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:13.091447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb8acfea55f482989462c9f505c8e5a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:13.131344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb8acfea55f482989462c9f505c8e5a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:13.239784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb8acfea55f482989462c9f505c8e5a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:13.248766 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61c27263-6cdb-417c-923d-a195955478ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb8acfea55f482989462c9f505c8e5a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:13.248766 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1225/2490] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:11:12 2022] DELETE /identity/v3/users/5eb8acfea55f482989462c9f505c8e5a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:13.329689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:13.781511 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:13.781511 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:13.801285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4149a-9553-430f-81b8-d65914038e97 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:13.877249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:13.878044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:13.878356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:13.878635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] PATH_INFO: `/v3/projects/c31157e301404b31a7c64910b5dbcb4f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:13.880056 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31157e301404b31a7c64910b5dbcb4f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:13.881955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:14.016894 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31157e301404b31a7c64910b5dbcb4f', 'request_id': 'req-db68137b-fd34-4238-9eb4-c074c98e9f06'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:14.091648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31157e301404b31a7c64910b5dbcb4f', 'request_id': 'req-db68137b-fd34-4238-9eb4-c074c98e9f06'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:14.101151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31157e301404b31a7c64910b5dbcb4f', 'request_id': 'req-db68137b-fd34-4238-9eb4-c074c98e9f06'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:14.114605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] The token cache is being invalidate because project c31157e301404b31a7c64910b5dbcb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:11:14.114920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:14.115692 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db68137b-fd34-4238-9eb4-c074c98e9f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:14.121328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1266/2491] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:11:13 2022] DELETE /identity/v3/projects/c31157e301404b31a7c64910b5dbcb4f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:14.125607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4a33-196b-42f6-9784-818e384631b6 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:14.125607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4a33-196b-42f6-9784-818e384631b6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:14.125607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4a33-196b-42f6-9784-818e384631b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:14.147619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-524d4a33-196b-42f6-9784-818e384631b6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:14.149080 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-524d4a33-196b-42f6-9784-818e384631b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:14.185893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:14.220922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1226/2492] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:14.230961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd262b-851e-46fb-86bf-51cbd283415a None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:14.231402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd262b-851e-46fb-86bf-51cbd283415a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:14.231751 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd262b-851e-46fb-86bf-51cbd283415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:14.255136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-34bd262b-851e-46fb-86bf-51cbd283415a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:14.256373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-34bd262b-851e-46fb-86bf-51cbd283415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:14.265924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1267/2493] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:14.271760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4a33-196b-42f6-9784-818e384631b6 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:14.286737 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4a33-196b-42f6-9784-818e384631b6 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:14.291633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46981bb9-928e-454e-96fc-2e5d96d9562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:14.292544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46981bb9-928e-454e-96fc-2e5d96d9562a admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:14.292837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46981bb9-928e-454e-96fc-2e5d96d9562a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:14.293279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46981bb9-928e-454e-96fc-2e5d96d9562a admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:14.293983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46981bb9-928e-454e-96fc-2e5d96d9562a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:11:14.294330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46981bb9-928e-454e-96fc-2e5d96d9562a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:14.295950 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46981bb9-928e-454e-96fc-2e5d96d9562a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:14.310695 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1227/2494] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:11:14.316058 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd262b-851e-46fb-86bf-51cbd283415a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:14.334923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd262b-851e-46fb-86bf-51cbd283415a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:14.349411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1d5fd-516f-46f3-9a54-669cf88a7b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:14.350037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d5fd-516f-46f3-9a54-669cf88a7b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:14.350359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d5fd-516f-46f3-9a54-669cf88a7b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:14.353334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d5fd-516f-46f3-9a54-669cf88a7b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:14.353334 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1d5fd-516f-46f3-9a54-669cf88a7b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:14.353515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1d5fd-516f-46f3-9a54-669cf88a7b1e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:14.512117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1268/2495] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:11:14 2022] POST /identity/v3/projects => generated 397 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:11:14.516402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46981bb9-928e-454e-96fc-2e5d96d9562a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:14.528592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46981bb9-928e-454e-96fc-2e5d96d9562a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:14.608300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f887f7-6d76-4c92-a6a2-11b22fc5ed44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:14.609538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f887f7-6d76-4c92-a6a2-11b22fc5ed44 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:14.609538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f887f7-6d76-4c92-a6a2-11b22fc5ed44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:14.609803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f887f7-6d76-4c92-a6a2-11b22fc5ed44 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:14.610826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f887f7-6d76-4c92-a6a2-11b22fc5ed44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:14.614953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f887f7-6d76-4c92-a6a2-11b22fc5ed44 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:15.316211 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1228/2496] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:11:14 2022] POST /identity/v3/users => generated 299 bytes in 792 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:11:15.319458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1d5fd-516f-46f3-9a54-669cf88a7b1e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:15.331691 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1d5fd-516f-46f3-9a54-669cf88a7b1e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:15.337079 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82199c2b-2698-4a60-9e4d-e7d315a9a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:15.337953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199c2b-2698-4a60-9e4d-e7d315a9a059 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:15.338686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199c2b-2698-4a60-9e4d-e7d315a9a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:15.339177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82199c2b-2698-4a60-9e4d-e7d315a9a059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:15.340025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82199c2b-2698-4a60-9e4d-e7d315a9a059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:15.342057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82199c2b-2698-4a60-9e4d-e7d315a9a059 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:15.357497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1269/2497] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:11:15.361230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f887f7-6d76-4c92-a6a2-11b22fc5ed44 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:15.375768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f887f7-6d76-4c92-a6a2-11b22fc5ed44 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:15.383894 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ebb3b-3828-47e5-b24f-d75edf3d2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:15.384952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ebb3b-3828-47e5-b24f-d75edf3d2ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:15.385464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ebb3b-3828-47e5-b24f-d75edf3d2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:15.385967 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ebb3b-3828-47e5-b24f-d75edf3d2ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:15.387248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ebb3b-3828-47e5-b24f-d75edf3d2ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:15.389866 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ebb3b-3828-47e5-b24f-d75edf3d2ef0 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:15.406092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1229/2498] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:11:15.411299 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82199c2b-2698-4a60-9e4d-e7d315a9a059 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:15.423143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82199c2b-2698-4a60-9e4d-e7d315a9a059 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:15.430878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ed1b1-3abd-411f-80fc-8d9a4fcffc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:15.430878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ed1b1-3abd-411f-80fc-8d9a4fcffc0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:15.430878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ed1b1-3abd-411f-80fc-8d9a4fcffc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:15.430878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ed1b1-3abd-411f-80fc-8d9a4fcffc0c admin admin] PATH_INFO: `/v3/projects/113c9e225c1e4d319505a66eb20f6ba4/users/7a0496fe85934eab88de889007259b85/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:15.479226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ed1b1-3abd-411f-80fc-8d9a4fcffc0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=113c9e225c1e4d319505a66eb20f6ba4, user_id=7a0496fe85934eab88de889007259b85, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:15.481923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ed1b1-3abd-411f-80fc-8d9a4fcffc0c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:15.594359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1270/2499] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:11:15 2022] PUT /identity/v3/projects/113c9e225c1e4d319505a66eb20f6ba4/users/7a0496fe85934eab88de889007259b85/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:15.663800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974cb98-a4cb-4bb0-b05e-43ac2054ccc3 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:15.664081 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974cb98-a4cb-4bb0-b05e-43ac2054ccc3 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:15.664360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974cb98-a4cb-4bb0-b05e-43ac2054ccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:15.694029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-d974cb98-a4cb-4bb0-b05e-43ac2054ccc3 None None] MFA Rules not processed for user `7a0496fe85934eab88de889007259b85`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:15.695559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d974cb98-a4cb-4bb0-b05e-43ac2054ccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:15.773621 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1230/2500] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:11:15.785163 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ed1b1-3abd-411f-80fc-8d9a4fcffc0c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:15.787039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c76ed1b1-3abd-411f-80fc-8d9a4fcffc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:15.791297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:15.857162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ed1b1-3abd-411f-80fc-8d9a4fcffc0c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:15.861940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1a94-f7dc-46c4-ba91-7c69ab5df284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:15.863718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1a94-f7dc-46c4-ba91-7c69ab5df284 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:15.864081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1a94-f7dc-46c4-ba91-7c69ab5df284 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:15.864444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1a94-f7dc-46c4-ba91-7c69ab5df284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:15.879033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a1a94-f7dc-46c4-ba91-7c69ab5df284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:15.880613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a1a94-f7dc-46c4-ba91-7c69ab5df284 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:15.890671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1271/2501] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:16.788638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:17.396159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:19.788784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:20.325799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:20.797606 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf94c53-353f-475b-8bdb-e69c35ec20db None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:20.797894 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf94c53-353f-475b-8bdb-e69c35ec20db None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:20.798172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf94c53-353f-475b-8bdb-e69c35ec20db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:20.825794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-8bf94c53-353f-475b-8bdb-e69c35ec20db None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:20.825794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8bf94c53-353f-475b-8bdb-e69c35ec20db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:20.901150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1231/2502] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:20.926101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1a94-f7dc-46c4-ba91-7c69ab5df284 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:20.928268 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ef3a1a94-f7dc-46c4-ba91-7c69ab5df284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:21.004470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1a94-f7dc-46c4-ba91-7c69ab5df284 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:21.010151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b05ec4-6d6c-4254-b284-c56f8e2243d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:21.010816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05ec4-6d6c-4254-b284-c56f8e2243d0 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:21.011100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05ec4-6d6c-4254-b284-c56f8e2243d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:21.011375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05ec4-6d6c-4254-b284-c56f8e2243d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:21.023741 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b05ec4-6d6c-4254-b284-c56f8e2243d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:21.025703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b05ec4-6d6c-4254-b284-c56f8e2243d0 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:21.037401 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1272/2503] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:11:21.280157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:21.415680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:22.046060 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:22.563469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf94c53-353f-475b-8bdb-e69c35ec20db None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:22.577715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf94c53-353f-475b-8bdb-e69c35ec20db None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:22.579309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:22.579946 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:22.580230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:22.580498 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] PATH_INFO: `/v3/users/7a0496fe85934eab88de889007259b85` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:22.582538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0496fe85934eab88de889007259b85)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:22.584538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:22.777534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0496fe85934eab88de889007259b85'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:22.786991 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0496fe85934eab88de889007259b85'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:22.801393 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0496fe85934eab88de889007259b85'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:22.879596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0496fe85934eab88de889007259b85'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:22.880345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0496fe85934eab88de889007259b85'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:22.892099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1232/2504] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:11:22 2022] DELETE /identity/v3/users/7a0496fe85934eab88de889007259b85 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:22.892378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11319c9a-7927-4378-b8ed-2278461601de None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:22.892378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11319c9a-7927-4378-b8ed-2278461601de None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:22.892378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11319c9a-7927-4378-b8ed-2278461601de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:22.914677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-11319c9a-7927-4378-b8ed-2278461601de None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:22.915955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-11319c9a-7927-4378-b8ed-2278461601de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:22.981394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:22.982982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1273/2505] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:22.992883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:22.994347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:23.056103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e034f-d332-4298-b25d-6cbda43950c8 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:23.061303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b2852-d4a3-49fc-9587-36daf0b62c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:23.061303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b2852-d4a3-49fc-9587-36daf0b62c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:23.061303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b2852-d4a3-49fc-9587-36daf0b62c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:23.061303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b2852-d4a3-49fc-9587-36daf0b62c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:23.073009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b2852-d4a3-49fc-9587-36daf0b62c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:23.074592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b2852-d4a3-49fc-9587-36daf0b62c5c service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:23.086649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1233/2506] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:23.600198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11319c9a-7927-4378-b8ed-2278461601de None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:23.601634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-11319c9a-7927-4378-b8ed-2278461601de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:23.633920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11319c9a-7927-4378-b8ed-2278461601de None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:23.652913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:23.653845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:23.654414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:23.661642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] PATH_INFO: `/v3/projects/113c9e225c1e4d319505a66eb20f6ba4` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:23.661642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113c9e225c1e4d319505a66eb20f6ba4)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:23.661642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:23.686989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:23.780546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113c9e225c1e4d319505a66eb20f6ba4', 'request_id': 'req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:23.845790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113c9e225c1e4d319505a66eb20f6ba4', 'request_id': 'req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:23.853564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113c9e225c1e4d319505a66eb20f6ba4', 'request_id': 'req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:23.866435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] The token cache is being invalidate because project 113c9e225c1e4d319505a66eb20f6ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:11:23.866730 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:23.867401 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:23.868929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1274/2507] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:11:23 2022] DELETE /identity/v3/projects/113c9e225c1e4d319505a66eb20f6ba4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:23.911871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:24.725480 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:24.822648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:25.334298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:25.974727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:27.077168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:27.435702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:28.757225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd5b70-88f1-4b9c-89f0-a5a7d798f9c7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:28.757767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd5b70-88f1-4b9c-89f0-a5a7d798f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:28.757767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd5b70-88f1-4b9c-89f0-a5a7d798f9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:28.777336 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-13bd5b70-88f1-4b9c-89f0-a5a7d798f9c7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:28.778578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-13bd5b70-88f1-4b9c-89f0-a5a7d798f9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:28.838714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1234/2508] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:28.895927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:28.897339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:28.971730 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3fd3d-ee8d-4f10-aad8-d3e7a79df5a9 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:28.973981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:28.979018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18347a25-8f69-4e62-b396-163b15546e3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:28.979612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18347a25-8f69-4e62-b396-163b15546e3c service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:28.979921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18347a25-8f69-4e62-b396-163b15546e3c service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:28.980193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18347a25-8f69-4e62-b396-163b15546e3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:28.988906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18347a25-8f69-4e62-b396-163b15546e3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:28.990496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18347a25-8f69-4e62-b396-163b15546e3c service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:28.999747 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1275/2509] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:29.351209 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:30.697306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:31.045570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:31.514361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:32.437291 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:33.117061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:33.316892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:33.639912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:34.111269 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:34.940496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:35.037060 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:35.426491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:35.459960 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:35.481724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd5b70-88f1-4b9c-89f0-a5a7d798f9c7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:35.483207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-13bd5b70-88f1-4b9c-89f0-a5a7d798f9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:35.495828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd5b70-88f1-4b9c-89f0-a5a7d798f9c7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:35.500458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:35.501103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:35.504974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:35.504974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] PATH_INFO: `/v3/users/f7a6cfe029514957862789f4c8096006` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:35.504974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a6cfe029514957862789f4c8096006)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:35.504974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:35.730562 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a6cfe029514957862789f4c8096006'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:35.739268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a6cfe029514957862789f4c8096006'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:35.751409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a6cfe029514957862789f4c8096006'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:35.828495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=73,keystone:DELETE=24,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:35.862635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a6cfe029514957862789f4c8096006'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:35.863257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a6cfe029514957862789f4c8096006'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:35.869587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1235/2510] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:11:35 2022] DELETE /identity/v3/users/f7a6cfe029514957862789f4c8096006 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:35.874282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacda83-d1c0-42bf-ab34-5788c8176b73 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:35.874498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacda83-d1c0-42bf-ab34-5788c8176b73 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:35.874774 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacda83-d1c0-42bf-ab34-5788c8176b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:35.895182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-faacda83-d1c0-42bf-ab34-5788c8176b73 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:35.896432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-faacda83-d1c0-42bf-ab34-5788c8176b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:35.954322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1276/2511] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:35.964929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:35.966335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:36.024140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3014688-ffeb-4c60-a8df-effa3b12df73 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:36.028094 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51f98b-c6d2-4591-ba42-564efa04ff83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:36.028727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51f98b-c6d2-4591-ba42-564efa04ff83 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:36.029008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51f98b-c6d2-4591-ba42-564efa04ff83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:36.029280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51f98b-c6d2-4591-ba42-564efa04ff83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:36.039503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51f98b-c6d2-4591-ba42-564efa04ff83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:36.041028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51f98b-c6d2-4591-ba42-564efa04ff83 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:36.051022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1236/2512] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:11:36.242867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:36.475935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacda83-d1c0-42bf-ab34-5788c8176b73 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:36.477521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-faacda83-d1c0-42bf-ab34-5788c8176b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:36.501357 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacda83-d1c0-42bf-ab34-5788c8176b73 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:36.509248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:36.510157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:36.510657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:36.510943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] PATH_INFO: `/v3/projects/2c48ced2c67647f683562e9973a76244` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:36.512674 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c48ced2c67647f683562e9973a76244)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:36.514756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:36.568710 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:36.676521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c48ced2c67647f683562e9973a76244', 'request_id': 'req-1799c647-48a5-462a-b85c-0d32614f5b30'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:36.771301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c48ced2c67647f683562e9973a76244', 'request_id': 'req-1799c647-48a5-462a-b85c-0d32614f5b30'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:36.777865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c48ced2c67647f683562e9973a76244', 'request_id': 'req-1799c647-48a5-462a-b85c-0d32614f5b30'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:36.788612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] The token cache is being invalidate because project 2c48ced2c67647f683562e9973a76244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:11:36.788900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:36.789521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1799c647-48a5-462a-b85c-0d32614f5b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:36.791035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1277/2513] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:11:36 2022] DELETE /identity/v3/projects/2c48ced2c67647f683562e9973a76244 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:36.796171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcffae1-097d-418b-8d4d-3e613c9f99ab None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:36.796474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcffae1-097d-418b-8d4d-3e613c9f99ab None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:36.796775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcffae1-097d-418b-8d4d-3e613c9f99ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:36.819704 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-7fcffae1-097d-418b-8d4d-3e613c9f99ab None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:36.820890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7fcffae1-097d-418b-8d4d-3e613c9f99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:36.854449 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:36.891964 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124cf5-91bf-48bd-a503-3e6e88f0521f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:36.892320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124cf5-91bf-48bd-a503-3e6e88f0521f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:36.892580 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124cf5-91bf-48bd-a503-3e6e88f0521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:36.894452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1237/2514] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:36.915980 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-77124cf5-91bf-48bd-a503-3e6e88f0521f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:36.917196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-77124cf5-91bf-48bd-a503-3e6e88f0521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:36.925715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1278/2515] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:36.930123 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcffae1-097d-418b-8d4d-3e613c9f99ab None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:36.940517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcffae1-097d-418b-8d4d-3e613c9f99ab None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:36.945139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f457-a30e-4361-b6ce-ba442a02fa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:36.945741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f457-a30e-4361-b6ce-ba442a02fa02 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:36.946023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f457-a30e-4361-b6ce-ba442a02fa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:36.946327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f457-a30e-4361-b6ce-ba442a02fa02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:36.947011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5f457-a30e-4361-b6ce-ba442a02fa02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:11:36.947312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5f457-a30e-4361-b6ce-ba442a02fa02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:36.948906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5f457-a30e-4361-b6ce-ba442a02fa02 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:36.961207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1238/2516] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:11:36.965514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77124cf5-91bf-48bd-a503-3e6e88f0521f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:36.975488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77124cf5-91bf-48bd-a503-3e6e88f0521f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:36.980220 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a2476-1463-4364-91b7-e1c8268676e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:36.980820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a2476-1463-4364-91b7-e1c8268676e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:36.981104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a2476-1463-4364-91b7-e1c8268676e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:36.981378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a2476-1463-4364-91b7-e1c8268676e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:36.982040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a2476-1463-4364-91b7-e1c8268676e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:36.983958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a2476-1463-4364-91b7-e1c8268676e9 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:37.054298 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:37.078028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1279/2517] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:11:36 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:11:37.085717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f457-a30e-4361-b6ce-ba442a02fa02 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:37.093001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f457-a30e-4361-b6ce-ba442a02fa02 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:37.151208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec3453-ffc7-4b29-b1ed-66253aff3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:37.151825 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec3453-ffc7-4b29-b1ed-66253aff3bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:37.152101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec3453-ffc7-4b29-b1ed-66253aff3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:37.152368 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec3453-ffc7-4b29-b1ed-66253aff3bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:37.152992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec3453-ffc7-4b29-b1ed-66253aff3bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:37.154981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec3453-ffc7-4b29-b1ed-66253aff3bc9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:37.160992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:37.247615 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1239/2518] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:11:37 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:11:37.251631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a2476-1463-4364-91b7-e1c8268676e9 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:37.262064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a2476-1463-4364-91b7-e1c8268676e9 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:37.266600 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa089-a7a8-4192-95db-ddcd32ecff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:37.267192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa089-a7a8-4192-95db-ddcd32ecff8f admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:37.267470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa089-a7a8-4192-95db-ddcd32ecff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:37.267738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa089-a7a8-4192-95db-ddcd32ecff8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:37.269326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaa089-a7a8-4192-95db-ddcd32ecff8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:37.270988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaa089-a7a8-4192-95db-ddcd32ecff8f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:37.281140 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1280/2519] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:11:37.290232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec3453-ffc7-4b29-b1ed-66253aff3bc9 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:37.300315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec3453-ffc7-4b29-b1ed-66253aff3bc9 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:37.304983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40483ec3-9e33-4dc9-980c-c10b3a421b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:37.305556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40483ec3-9e33-4dc9-980c-c10b3a421b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:37.305830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40483ec3-9e33-4dc9-980c-c10b3a421b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:37.306101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40483ec3-9e33-4dc9-980c-c10b3a421b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:37.306791 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40483ec3-9e33-4dc9-980c-c10b3a421b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:37.308375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40483ec3-9e33-4dc9-980c-c10b3a421b22 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:37.319809 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1240/2520] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:11:37.325979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa089-a7a8-4192-95db-ddcd32ecff8f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:37.337700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa089-a7a8-4192-95db-ddcd32ecff8f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:37.342555 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd3001-219e-4d33-9aaa-dbfe91115737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:37.343215 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd3001-219e-4d33-9aaa-dbfe91115737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:37.343613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd3001-219e-4d33-9aaa-dbfe91115737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:37.343918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd3001-219e-4d33-9aaa-dbfe91115737 admin admin] PATH_INFO: `/v3/projects/3e4adf9ef52e4c1e9ce2f5fb33c1f595/users/6240ab82bbf24ebc8f7c0c93c978bd84/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:37.364149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd3001-219e-4d33-9aaa-dbfe91115737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4adf9ef52e4c1e9ce2f5fb33c1f595, user_id=6240ab82bbf24ebc8f7c0c93c978bd84, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:37.367127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd3001-219e-4d33-9aaa-dbfe91115737 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:37.394235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:37.487602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1281/2521] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:11:37 2022] PUT /identity/v3/projects/3e4adf9ef52e4c1e9ce2f5fb33c1f595/users/6240ab82bbf24ebc8f7c0c93c978bd84/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:37.498883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cab2a-d8ac-40c3-a9a8-2d905f794d46 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:37.499170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cab2a-d8ac-40c3-a9a8-2d905f794d46 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:37.499447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cab2a-d8ac-40c3-a9a8-2d905f794d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:37.520195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:37.532286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-fc8cab2a-d8ac-40c3-a9a8-2d905f794d46 None None] MFA Rules not processed for user `6240ab82bbf24ebc8f7c0c93c978bd84`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:37.532286 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-fc8cab2a-d8ac-40c3-a9a8-2d905f794d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:37.608622 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1241/2522] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:37.622667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbd492-84cc-4698-ad6e-4c8f6d604bd6 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:37.622796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cab2a-d8ac-40c3-a9a8-2d905f794d46 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:37.622882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbd492-84cc-4698-ad6e-4c8f6d604bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:37.623047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbd492-84cc-4698-ad6e-4c8f6d604bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:37.623787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-fc8cab2a-d8ac-40c3-a9a8-2d905f794d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:37.645243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f8dbd492-84cc-4698-ad6e-4c8f6d604bd6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:37.645243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f8dbd492-84cc-4698-ad6e-4c8f6d604bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:37.690301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cab2a-d8ac-40c3-a9a8-2d905f794d46 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:37.695277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2388b4-ec23-4138-a1fd-4819def40e87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:37.696012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2388b4-ec23-4138-a1fd-4819def40e87 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:37.696383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2388b4-ec23-4138-a1fd-4819def40e87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:37.696761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2388b4-ec23-4138-a1fd-4819def40e87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:37.717044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2388b4-ec23-4138-a1fd-4819def40e87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:37.717044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2388b4-ec23-4138-a1fd-4819def40e87 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:37.728258 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1242/2523] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:11:37.742152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1282/2524] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:37.887684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2388b4-ec23-4138-a1fd-4819def40e87 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:37.889846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5d2388b4-ec23-4138-a1fd-4819def40e87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:37.971828 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2388b4-ec23-4138-a1fd-4819def40e87 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:37.978117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0abc8d-d4a2-4c67-970f-e839c675f183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:37.978798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0abc8d-d4a2-4c67-970f-e839c675f183 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:37.979106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0abc8d-d4a2-4c67-970f-e839c675f183 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:37.979390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0abc8d-d4a2-4c67-970f-e839c675f183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:37.988570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0abc8d-d4a2-4c67-970f-e839c675f183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:37.990184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0abc8d-d4a2-4c67-970f-e839c675f183 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:38.006401 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1243/2525] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:38.011409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:38.117188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:38.577909 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:39.360065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:39.743181 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:40.140450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:40.311151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:40.410018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce96f1-dbc3-4809-a58a-d204d9f73d77 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:40.410018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce96f1-dbc3-4809-a58a-d204d9f73d77 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:40.410018 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce96f1-dbc3-4809-a58a-d204d9f73d77 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:40.411538 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1283/2526] 10.222.0.77 () {54 vars in 961 bytes} [Wed Sep 14 12:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:11:40.417514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf417-e1ec-40cc-bc64-20efbebc9dd7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:40.418028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf417-e1ec-40cc-bc64-20efbebc9dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:40.418114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acf417-e1ec-40cc-bc64-20efbebc9dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:40.443186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-90acf417-e1ec-40cc-bc64-20efbebc9dd7 None None] MFA Rules not processed for user `877b59ec265f42e4bf8edbd9767e3319`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:40.444426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-90acf417-e1ec-40cc-bc64-20efbebc9dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:40.510988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1244/2527] 10.222.0.77 () {58 vars in 1058 bytes} [Wed Sep 14 12:11:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:40.518683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce96f1-dbc3-4809-a58a-d204d9f73d77 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:40.531790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce96f1-dbc3-4809-a58a-d204d9f73d77 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:40.537562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6af52-a906-41c5-8116-69830df5be95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:40.538159 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6af52-a906-41c5-8116-69830df5be95 service placement] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:40.538473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6af52-a906-41c5-8116-69830df5be95 service placement] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:40.538749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6af52-a906-41c5-8116-69830df5be95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:40.540489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-84d6af52-a906-41c5-8116-69830df5be95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:40.552584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6af52-a906-41c5-8116-69830df5be95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:40.554152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6af52-a906-41c5-8116-69830df5be95 service placement] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:40.564930 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1284/2528] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:40.651199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:40.861383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:41.020096 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:41.122711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:41.643166 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:41.837502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:42.000037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:42.257327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:42.485830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:42.584590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f648609-b750-4d62-a9fb-1acd05e9ccd4 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:42.584875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f648609-b750-4d62-a9fb-1acd05e9ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:42.586427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f648609-b750-4d62-a9fb-1acd05e9ccd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:42.612105 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-4f648609-b750-4d62-a9fb-1acd05e9ccd4 None None] MFA Rules not processed for user `0563d78b8dcf49b5ad591444c7a3490f`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:42.614952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4f648609-b750-4d62-a9fb-1acd05e9ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:42.668789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1245/2529] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:42.819673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:43.100364 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:43.116590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb0a6d-da9d-41c0-b5ae-77d68c8f938a None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:43.116958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb0a6d-da9d-41c0-b5ae-77d68c8f938a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:43.117307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb0a6d-da9d-41c0-b5ae-77d68c8f938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:43.143285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-97bb0a6d-da9d-41c0-b5ae-77d68c8f938a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:43.143285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-97bb0a6d-da9d-41c0-b5ae-77d68c8f938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:43.149455 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1285/2530] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:43.183054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f648609-b750-4d62-a9fb-1acd05e9ccd4 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:43.184456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4f648609-b750-4d62-a9fb-1acd05e9ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:43.201071 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f648609-b750-4d62-a9fb-1acd05e9ccd4 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:43.207582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c27c9-55f4-4d20-9cf3-cdf47d4d9855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:43.208192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c27c9-55f4-4d20-9cf3-cdf47d4d9855 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:43.208474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c27c9-55f4-4d20-9cf3-cdf47d4d9855 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:43.208747 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c27c9-55f4-4d20-9cf3-cdf47d4d9855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:43.216860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c27c9-55f4-4d20-9cf3-cdf47d4d9855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:43.218519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c27c9-55f4-4d20-9cf3-cdf47d4d9855 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:43.228839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1246/2531] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:43.317471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:43.692038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:43.914159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=88,keystone:DELETE=5,keystone:INSERT=7 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:44.039830 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:44.702744 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:44.800334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:45.340581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:45.463065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:45.508859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:45.650147 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:46.331334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:46.440397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:46.894053 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:47.039665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:47.282412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:47.518918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:48.000609 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb0a6d-da9d-41c0-b5ae-77d68c8f938a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:48.002979 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-97bb0a6d-da9d-41c0-b5ae-77d68c8f938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:48.070569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb0a6d-da9d-41c0-b5ae-77d68c8f938a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:48.074196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded08630-6d8e-468b-a115-612e0acd2f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:48.074832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded08630-6d8e-468b-a115-612e0acd2f4c service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:48.075112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded08630-6d8e-468b-a115-612e0acd2f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:48.075384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded08630-6d8e-468b-a115-612e0acd2f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:48.077206 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ded08630-6d8e-468b-a115-612e0acd2f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:48.089266 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:48.141350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded08630-6d8e-468b-a115-612e0acd2f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:48.143218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded08630-6d8e-468b-a115-612e0acd2f4c service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:48.153077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1286/2532] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:48.422926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:48.788685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc631-99d4-49d4-82d0-331a53f3bf86 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:48.789106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc631-99d4-49d4-82d0-331a53f3bf86 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:48.789478 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc631-99d4-49d4-82d0-331a53f3bf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:48.811361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-73bcc631-99d4-49d4-82d0-331a53f3bf86 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:48.813415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-73bcc631-99d4-49d4-82d0-331a53f3bf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:48.825320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1247/2533] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:48.852816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded08630-6d8e-468b-a115-612e0acd2f4c service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:48.877647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded08630-6d8e-468b-a115-612e0acd2f4c service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:48.887654 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87556a-cc14-40b0-8298-564a1a9e707e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:48.888282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87556a-cc14-40b0-8298-564a1a9e707e service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:48.888563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87556a-cc14-40b0-8298-564a1a9e707e service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:48.889671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87556a-cc14-40b0-8298-564a1a9e707e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:48.905041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87556a-cc14-40b0-8298-564a1a9e707e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:48.908360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:48.908539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87556a-cc14-40b0-8298-564a1a9e707e service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:48.921914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1287/2534] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:49.697039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:50.340164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:50.609859 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:51.412819 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcc631-99d4-49d4-82d0-331a53f3bf86 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:51.424468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcc631-99d4-49d4-82d0-331a53f3bf86 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:51.431339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:51.432212 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:51.432687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:51.433117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] PATH_INFO: `/v3/users/6240ab82bbf24ebc8f7c0c93c978bd84` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:51.434489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6240ab82bbf24ebc8f7c0c93c978bd84)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:51.436691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:51.537375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:51.697004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6240ab82bbf24ebc8f7c0c93c978bd84'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:51.710874 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6240ab82bbf24ebc8f7c0c93c978bd84'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:51.726435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6240ab82bbf24ebc8f7c0c93c978bd84'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:51.809996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6240ab82bbf24ebc8f7c0c93c978bd84'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:51.810787 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6240ab82bbf24ebc8f7c0c93c978bd84'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:51.822822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1248/2535] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:11:51 2022] DELETE /identity/v3/users/6240ab82bbf24ebc8f7c0c93c978bd84 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:51.827407 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ef24e-f08a-493e-a350-44791a5d74b3 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:51.827872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ef24e-f08a-493e-a350-44791a5d74b3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:51.828081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ef24e-f08a-493e-a350-44791a5d74b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:51.864002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b63ef24e-f08a-493e-a350-44791a5d74b3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:11:51.864002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b63ef24e-f08a-493e-a350-44791a5d74b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:51.931353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1288/2536] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:11:51.941934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:51.944170 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:52.005970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672826b-d51d-4ccf-bd83-83ad2146821a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:52.009736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b928b-4e34-4e9e-b5a2-9dc671ba3661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:52.010384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b928b-4e34-4e9e-b5a2-9dc671ba3661 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:52.010668 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b928b-4e34-4e9e-b5a2-9dc671ba3661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:52.010941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b928b-4e34-4e9e-b5a2-9dc671ba3661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:52.020915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b928b-4e34-4e9e-b5a2-9dc671ba3661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:52.022406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b928b-4e34-4e9e-b5a2-9dc671ba3661 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:52.032219 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1249/2537] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:11:52.576207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ef24e-f08a-493e-a350-44791a5d74b3 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:11:52.579280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b63ef24e-f08a-493e-a350-44791a5d74b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:11:52.597566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ef24e-f08a-493e-a350-44791a5d74b3 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:11:52.602337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:11:52.608925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:11:52.608925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:11:52.608925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] PATH_INFO: `/v3/projects/3e4adf9ef52e4c1e9ce2f5fb33c1f595` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:11:52.608925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4adf9ef52e4c1e9ce2f5fb33c1f595)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:11:52.608925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:52.608925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:11:52.734037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4adf9ef52e4c1e9ce2f5fb33c1f595', 'request_id': 'req-496c011b-2494-4c78-9a31-76382a49ce8a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:52.825666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:52.826226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4adf9ef52e4c1e9ce2f5fb33c1f595', 'request_id': 'req-496c011b-2494-4c78-9a31-76382a49ce8a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:52.833329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4adf9ef52e4c1e9ce2f5fb33c1f595', 'request_id': 'req-496c011b-2494-4c78-9a31-76382a49ce8a'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:52.843560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] The token cache is being invalidate because project 3e4adf9ef52e4c1e9ce2f5fb33c1f595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:11:52.843844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:52.844480 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-496c011b-2494-4c78-9a31-76382a49ce8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:11:52.846549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1289/2538] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:11:52 2022] DELETE /identity/v3/projects/3e4adf9ef52e4c1e9ce2f5fb33c1f595 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:11:53.234319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:54.017158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:54.557386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:54.745726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:54.888502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:54.976726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:55.692592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:56.031392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:56.434093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:56.711036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:56.802599 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:56.968241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:57.179508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:57.422900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:57.682460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:57.817032 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.022591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.057408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.334507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.374417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.602934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.637027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.719890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.739844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.765213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.808149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.945290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:58.997127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:59.147806 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:59.199527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:59.354169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:59.536995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:59.633821 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:59.737703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:59.825539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:11:59.902411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:00.042647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:00.085456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:09.936096 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:10.290117 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:12.326182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf455-4342-4218-9833-2d5f3ed698d7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:12.326800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf455-4342-4218-9833-2d5f3ed698d7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:12.326800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cf455-4342-4218-9833-2d5f3ed698d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:12.348490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-d70cf455-4342-4218-9833-2d5f3ed698d7 None None] MFA Rules not processed for user `414816fb225245cea22ef98d4aa47814`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:12.349735 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d70cf455-4342-4218-9833-2d5f3ed698d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:12.406586 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1250/2539] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:12:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:16.260474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dff446-9c23-4b26-b608-148071e76450 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:16.260985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dff446-9c23-4b26-b608-148071e76450 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:16.261099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dff446-9c23-4b26-b608-148071e76450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:16.284014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-32dff446-9c23-4b26-b608-148071e76450 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:16.285252 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-32dff446-9c23-4b26-b608-148071e76450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:16.345030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1290/2540] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:12:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:16.394769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cf455-4342-4218-9833-2d5f3ed698d7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:16.396895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-d70cf455-4342-4218-9833-2d5f3ed698d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:16.485659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cf455-4342-4218-9833-2d5f3ed698d7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:16.491082 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42be6-8ef8-4987-ab05-1cf3c448095e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:16.491701 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42be6-8ef8-4987-ab05-1cf3c448095e service swift] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:16.491983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42be6-8ef8-4987-ab05-1cf3c448095e service swift] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:16.492255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42be6-8ef8-4987-ab05-1cf3c448095e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:16.500909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42be6-8ef8-4987-ab05-1cf3c448095e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:16.503425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42be6-8ef8-4987-ab05-1cf3c448095e service swift] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:16.511638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1251/2541] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:12:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:12:26.338341 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=25 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:26.508415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=57 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:32.892990 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b240-4927-4cf4-803d-b681e2998ff7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:32.893630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b240-4927-4cf4-803d-b681e2998ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:32.893630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b240-4927-4cf4-803d-b681e2998ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:32.913686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-33b7b240-4927-4cf4-803d-b681e2998ff7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:32.914942 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-33b7b240-4927-4cf4-803d-b681e2998ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:32.974655 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1291/2542] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:33.000276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42be6-8ef8-4987-ab05-1cf3c448095e service swift] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:33.000276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-86b42be6-8ef8-4987-ab05-1cf3c448095e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:33.075000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42be6-8ef8-4987-ab05-1cf3c448095e service swift] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:33.081206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e2db8-10b8-4ef7-800f-066f6327b32a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:33.081815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e2db8-10b8-4ef7-800f-066f6327b32a service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:33.082095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e2db8-10b8-4ef7-800f-066f6327b32a service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:33.082400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e2db8-10b8-4ef7-800f-066f6327b32a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:33.090559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e2db8-10b8-4ef7-800f-066f6327b32a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:33.092118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e2db8-10b8-4ef7-800f-066f6327b32a service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:33.101536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1252/2543] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:12:33.893328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58e2e1-6d3e-4d6b-846e-5aa8cf9ac671 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:33.893825 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58e2e1-6d3e-4d6b-846e-5aa8cf9ac671 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:33.893932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58e2e1-6d3e-4d6b-846e-5aa8cf9ac671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:33.915050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-dc58e2e1-6d3e-4d6b-846e-5aa8cf9ac671 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:33.916248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-dc58e2e1-6d3e-4d6b-846e-5aa8cf9ac671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:33.924641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1292/2544] 10.222.0.77 () {58 vars in 967 bytes} [Wed Sep 14 12:12:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:12:33.937948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e2db8-10b8-4ef7-800f-066f6327b32a service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:33.949283 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e2db8-10b8-4ef7-800f-066f6327b32a service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:33.960016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003cb69-2981-4347-abff-dc1d1d009f08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:33.960625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003cb69-2981-4347-abff-dc1d1d009f08 service swift] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:33.960926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003cb69-2981-4347-abff-dc1d1d009f08 service swift] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:33.961200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003cb69-2981-4347-abff-dc1d1d009f08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:33.970351 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003cb69-2981-4347-abff-dc1d1d009f08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:33.971924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003cb69-2981-4347-abff-dc1d1d009f08 service swift] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:33.979924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1253/2545] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:12:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:12:37.383084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58e2e1-6d3e-4d6b-846e-5aa8cf9ac671 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:37.384849 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-dc58e2e1-6d3e-4d6b-846e-5aa8cf9ac671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:37.405142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58e2e1-6d3e-4d6b-846e-5aa8cf9ac671 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:37.421676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:37.422362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:37.422713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:37.423503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] PATH_INFO: `/v3/users/0563d78b8dcf49b5ad591444c7a3490f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:37.424698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0563d78b8dcf49b5ad591444c7a3490f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:37.426888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:37.595379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09a2f-afd7-4c57-be2f-ebe7f1b1542c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:37.595885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09a2f-afd7-4c57-be2f-ebe7f1b1542c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:37.596051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d09a2f-afd7-4c57-be2f-ebe7f1b1542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:37.618267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-45d09a2f-afd7-4c57-be2f-ebe7f1b1542c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:37.619496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-45d09a2f-afd7-4c57-be2f-ebe7f1b1542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:37.627827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1254/2546] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:12:37.652089 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d09a2f-afd7-4c57-be2f-ebe7f1b1542c None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:37.653518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-45d09a2f-afd7-4c57-be2f-ebe7f1b1542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:37.670268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d09a2f-afd7-4c57-be2f-ebe7f1b1542c None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:37.676275 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab595b4-4bc5-443c-bbed-805b8ce0d46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:37.676880 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab595b4-4bc5-443c-bbed-805b8ce0d46a service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:37.677159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab595b4-4bc5-443c-bbed-805b8ce0d46a service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:37.677431 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab595b4-4bc5-443c-bbed-805b8ce0d46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:37.686120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab595b4-4bc5-443c-bbed-805b8ce0d46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:37.687858 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab595b4-4bc5-443c-bbed-805b8ce0d46a service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:37.698386 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1255/2547] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:12:37.712967 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0563d78b8dcf49b5ad591444c7a3490f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:12:37.714426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0563d78b8dcf49b5ad591444c7a3490f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:12:37.723991 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0563d78b8dcf49b5ad591444c7a3490f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:12:37.740076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0563d78b8dcf49b5ad591444c7a3490f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:12:37.740811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-bb43b6d2-d48d-4eb9-88ad-ad860b124561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0563d78b8dcf49b5ad591444c7a3490f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:12:37.865452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1293/2548] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:12:37 2022] DELETE /identity/v3/users/0563d78b8dcf49b5ad591444c7a3490f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:12:38.146772 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab595b4-4bc5-443c-bbed-805b8ce0d46a service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:38.162790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab595b4-4bc5-443c-bbed-805b8ce0d46a service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:38.222464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:38.223098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:38.223378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:38.223649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] PATH_INFO: `/v3/projects/3add1b90bb0c411e8da4c18338c3e2d5` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:38.224769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3add1b90bb0c411e8da4c18338c3e2d5)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:38.226737 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:38.380253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3add1b90bb0c411e8da4c18338c3e2d5', 'request_id': 'req-78b5a463-6121-4fd5-bab0-9e9e39a36410'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:12:38.386465 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3add1b90bb0c411e8da4c18338c3e2d5', 'request_id': 'req-78b5a463-6121-4fd5-bab0-9e9e39a36410'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:12:38.387655 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:38.392579 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3add1b90bb0c411e8da4c18338c3e2d5', 'request_id': 'req-78b5a463-6121-4fd5-bab0-9e9e39a36410'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:12:38.507191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] The token cache is being invalidate because project 3add1b90bb0c411e8da4c18338c3e2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:12:38.507497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:12:38.508142 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-78b5a463-6121-4fd5-bab0-9e9e39a36410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:12:38.509633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1256/2549] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:12:38 2022] DELETE /identity/v3/projects/3add1b90bb0c411e8da4c18338c3e2d5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:12:38.514871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306b9d9-31d2-4e59-b9f0-dd7394ee1c65 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:38.515315 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306b9d9-31d2-4e59-b9f0-dd7394ee1c65 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:38.515491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306b9d9-31d2-4e59-b9f0-dd7394ee1c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:38.537102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d306b9d9-31d2-4e59-b9f0-dd7394ee1c65 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:38.538358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d306b9d9-31d2-4e59-b9f0-dd7394ee1c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:38.617256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1294/2550] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:38.625901 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3509e1-01c7-448b-92d8-b78aeea4fc44 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:38.626421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3509e1-01c7-448b-92d8-b78aeea4fc44 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:38.626761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3509e1-01c7-448b-92d8-b78aeea4fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:38.647801 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ba3509e1-01c7-448b-92d8-b78aeea4fc44 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:38.648955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ba3509e1-01c7-448b-92d8-b78aeea4fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:38.658594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1257/2551] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:38.662537 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306b9d9-31d2-4e59-b9f0-dd7394ee1c65 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:38.672558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306b9d9-31d2-4e59-b9f0-dd7394ee1c65 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:38.677292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581598e-f954-453e-8df7-f3060332c3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:38.677937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581598e-f954-453e-8df7-f3060332c3da admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:38.678244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581598e-f954-453e-8df7-f3060332c3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:38.678534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581598e-f954-453e-8df7-f3060332c3da admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:38.679194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581598e-f954-453e-8df7-f3060332c3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:12:38.679498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581598e-f954-453e-8df7-f3060332c3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:38.681310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581598e-f954-453e-8df7-f3060332c3da admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:38.683386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:38.695965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1295/2552] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:12:38.700485 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3509e1-01c7-448b-92d8-b78aeea4fc44 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:38.712969 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3509e1-01c7-448b-92d8-b78aeea4fc44 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:38.720452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ecd73-683a-4502-aea9-38abe53f137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:38.720452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ecd73-683a-4502-aea9-38abe53f137f admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:38.720452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ecd73-683a-4502-aea9-38abe53f137f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:38.720452 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ecd73-683a-4502-aea9-38abe53f137f admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:38.720823 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ecd73-683a-4502-aea9-38abe53f137f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:38.722297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ecd73-683a-4502-aea9-38abe53f137f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:38.812140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1258/2553] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:12:38 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:12:38.817410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581598e-f954-453e-8df7-f3060332c3da admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:38.827445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581598e-f954-453e-8df7-f3060332c3da admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:38.886135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddcfe5-eda6-4fc7-8d74-4f1f99d8cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:38.886788 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddcfe5-eda6-4fc7-8d74-4f1f99d8cc5c admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:38.887070 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddcfe5-eda6-4fc7-8d74-4f1f99d8cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:38.887344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddcfe5-eda6-4fc7-8d74-4f1f99d8cc5c admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:38.888062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddcfe5-eda6-4fc7-8d74-4f1f99d8cc5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:38.889955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddcfe5-eda6-4fc7-8d74-4f1f99d8cc5c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:38.985832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1296/2554] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:12:38 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:12:38.990270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ecd73-683a-4502-aea9-38abe53f137f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:39.005569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ecd73-683a-4502-aea9-38abe53f137f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:39.011059 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c8b7-af25-4e50-8b3b-9db02d3382fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:39.011680 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c8b7-af25-4e50-8b3b-9db02d3382fb admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:39.011956 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c8b7-af25-4e50-8b3b-9db02d3382fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:39.012225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c8b7-af25-4e50-8b3b-9db02d3382fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:39.012862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417c8b7-af25-4e50-8b3b-9db02d3382fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:39.014495 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417c8b7-af25-4e50-8b3b-9db02d3382fb admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:39.025827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1259/2555] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:12:39.035988 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddcfe5-eda6-4fc7-8d74-4f1f99d8cc5c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:39.046065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddcfe5-eda6-4fc7-8d74-4f1f99d8cc5c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:39.051003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fa4c7-78dd-4fa3-98df-14a6e6773528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:39.051621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa4c7-78dd-4fa3-98df-14a6e6773528 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:39.052027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa4c7-78dd-4fa3-98df-14a6e6773528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:39.052322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa4c7-78dd-4fa3-98df-14a6e6773528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:39.052948 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fa4c7-78dd-4fa3-98df-14a6e6773528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:39.054653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fa4c7-78dd-4fa3-98df-14a6e6773528 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:39.066378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1297/2556] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:12:39.071841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c8b7-af25-4e50-8b3b-9db02d3382fb admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:39.082749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c8b7-af25-4e50-8b3b-9db02d3382fb admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:39.087514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72413866-8c42-4dcf-95a5-954ad423afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:39.088172 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72413866-8c42-4dcf-95a5-954ad423afdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:39.088460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72413866-8c42-4dcf-95a5-954ad423afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:39.088737 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72413866-8c42-4dcf-95a5-954ad423afdb admin admin] PATH_INFO: `/v3/projects/b7c6a0bbf9a34f99a037533e5f6965de/users/a800d16e85b044288be508715d1ad977/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:39.103847 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72413866-8c42-4dcf-95a5-954ad423afdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c6a0bbf9a34f99a037533e5f6965de, user_id=a800d16e85b044288be508715d1ad977, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:39.106629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72413866-8c42-4dcf-95a5-954ad423afdb admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:39.184902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1260/2557] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:12:39 2022] PUT /identity/v3/projects/b7c6a0bbf9a34f99a037533e5f6965de/users/a800d16e85b044288be508715d1ad977/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:12:39.191155 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806505b-bf03-4ebc-a401-d552ddc925cf None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:39.191442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806505b-bf03-4ebc-a401-d552ddc925cf None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:39.191713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806505b-bf03-4ebc-a401-d552ddc925cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:39.211407 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9806505b-bf03-4ebc-a401-d552ddc925cf None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:39.212650 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9806505b-bf03-4ebc-a401-d552ddc925cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:39.271765 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1298/2558] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:39.281220 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72413866-8c42-4dcf-95a5-954ad423afdb admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:39.283111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-72413866-8c42-4dcf-95a5-954ad423afdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:39.339600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72413866-8c42-4dcf-95a5-954ad423afdb admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:39.343256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3fda-9090-4d43-a041-fbeb66b317a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:39.343823 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3fda-9090-4d43-a041-fbeb66b317a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:39.344100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3fda-9090-4d43-a041-fbeb66b317a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:39.344421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3fda-9090-4d43-a041-fbeb66b317a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:39.354862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3fda-9090-4d43-a041-fbeb66b317a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:39.356293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3fda-9090-4d43-a041-fbeb66b317a2 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:39.367509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1261/2559] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:12:41.462189 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ee87-7281-4823-9eb7-263578f526e4 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:41.462758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ee87-7281-4823-9eb7-263578f526e4 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:41.462758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ee87-7281-4823-9eb7-263578f526e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:41.488945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-4f93ee87-7281-4823-9eb7-263578f526e4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:41.490902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4f93ee87-7281-4823-9eb7-263578f526e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:41.499869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1299/2560] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:12:41.526448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3fda-9090-4d43-a041-fbeb66b317a2 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:41.528056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-02bc3fda-9090-4d43-a041-fbeb66b317a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:41.614850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3fda-9090-4d43-a041-fbeb66b317a2 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:41.622424 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c415621-d876-4ff4-9413-4b07cccbadf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:41.623143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c415621-d876-4ff4-9413-4b07cccbadf3 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:41.624639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c415621-d876-4ff4-9413-4b07cccbadf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:41.624639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c415621-d876-4ff4-9413-4b07cccbadf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:41.633471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c415621-d876-4ff4-9413-4b07cccbadf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:41.635377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c415621-d876-4ff4-9413-4b07cccbadf3 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:41.646818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1262/2561] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:12:45.621027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273991-5df4-4f60-88ca-ac8a40586455 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:45.622725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273991-5df4-4f60-88ca-ac8a40586455 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:45.622725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273991-5df4-4f60-88ca-ac8a40586455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:45.652795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c3273991-5df4-4f60-88ca-ac8a40586455 None None] MFA Rules not processed for user `a800d16e85b044288be508715d1ad977`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:45.654222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c3273991-5df4-4f60-88ca-ac8a40586455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:45.744244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:45.750287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496f251-5a1c-4a90-a332-6bc60ac186ad None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:45.751303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496f251-5a1c-4a90-a332-6bc60ac186ad None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:45.755929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1300/2562] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:12:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:45.756445 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496f251-5a1c-4a90-a332-6bc60ac186ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:45.760766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3273991-5df4-4f60-88ca-ac8a40586455 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:45.773115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3273991-5df4-4f60-88ca-ac8a40586455 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:45.780425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d552c-4bbe-46e8-a802-51e320361878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:45.781133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d552c-4bbe-46e8-a802-51e320361878 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:45.781489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d552c-4bbe-46e8-a802-51e320361878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:45.782467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d552c-4bbe-46e8-a802-51e320361878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:45.783738 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d552c-4bbe-46e8-a802-51e320361878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:45.785285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:45.787044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d552c-4bbe-46e8-a802-51e320361878 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:45.799540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5496f251-5a1c-4a90-a332-6bc60ac186ad None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:45.826340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5496f251-5a1c-4a90-a332-6bc60ac186ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:45.842020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1263/2563] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:45.875058 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496f251-5a1c-4a90-a332-6bc60ac186ad None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:45.892159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496f251-5a1c-4a90-a332-6bc60ac186ad None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:45.898054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e28860-5436-4fd0-b44a-1f0e94f9e934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:45.898726 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e28860-5436-4fd0-b44a-1f0e94f9e934 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:45.899006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e28860-5436-4fd0-b44a-1f0e94f9e934 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:45.899280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e28860-5436-4fd0-b44a-1f0e94f9e934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:45.910261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e28860-5436-4fd0-b44a-1f0e94f9e934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:45.911591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e28860-5436-4fd0-b44a-1f0e94f9e934 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:45.926406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1264/2564] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:12:46.042527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1301/2565] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:12:45 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:12:46.046634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e28860-5436-4fd0-b44a-1f0e94f9e934 service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:46.056611 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e28860-5436-4fd0-b44a-1f0e94f9e934 service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:46.120761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f674a-72e3-420b-9a72-36448699c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:46.121454 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f674a-72e3-420b-9a72-36448699c513 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:46.121926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f674a-72e3-420b-9a72-36448699c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:46.122300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f674a-72e3-420b-9a72-36448699c513 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:46.123181 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f674a-72e3-420b-9a72-36448699c513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:46.126012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f674a-72e3-420b-9a72-36448699c513 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:46.259648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1265/2566] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:12:46 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:12:46.263848 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d552c-4bbe-46e8-a802-51e320361878 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:46.274592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d552c-4bbe-46e8-a802-51e320361878 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:46.280174 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43c676-a622-4ce1-b725-4c1ca4f45cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:46.280857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43c676-a622-4ce1-b725-4c1ca4f45cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:46.281209 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43c676-a622-4ce1-b725-4c1ca4f45cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:46.281559 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43c676-a622-4ce1-b725-4c1ca4f45cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:46.282454 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43c676-a622-4ce1-b725-4c1ca4f45cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:46.284290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43c676-a622-4ce1-b725-4c1ca4f45cc2 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:46.295840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1302/2567] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:12:46.306241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f674a-72e3-420b-9a72-36448699c513 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:46.320351 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f674a-72e3-420b-9a72-36448699c513 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:46.326043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726d14-c62a-4905-ad52-a0b4cbdef71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:46.326753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726d14-c62a-4905-ad52-a0b4cbdef71b admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:46.327036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726d14-c62a-4905-ad52-a0b4cbdef71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:46.327311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726d14-c62a-4905-ad52-a0b4cbdef71b admin admin] PATH_INFO: `/v3/projects/7eae6e25db1c4a66850943866d3abbf2/users/643e09ef646f42188fd834c84b194a6f/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:46.348715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da726d14-c62a-4905-ad52-a0b4cbdef71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eae6e25db1c4a66850943866d3abbf2, user_id=643e09ef646f42188fd834c84b194a6f, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:46.351451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da726d14-c62a-4905-ad52-a0b4cbdef71b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:46.447439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1266/2568] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:12:46 2022] PUT /identity/v3/projects/7eae6e25db1c4a66850943866d3abbf2/users/643e09ef646f42188fd834c84b194a6f/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:12:46.449746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43c676-a622-4ce1-b725-4c1ca4f45cc2 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:46.460116 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43c676-a622-4ce1-b725-4c1ca4f45cc2 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:46.527420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba200d-e55b-477b-9d53-72a755f296b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:46.528037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba200d-e55b-477b-9d53-72a755f296b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:46.528316 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba200d-e55b-477b-9d53-72a755f296b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:46.528590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba200d-e55b-477b-9d53-72a755f296b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:46.529235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba200d-e55b-477b-9d53-72a755f296b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:46.530861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba200d-e55b-477b-9d53-72a755f296b4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:46.543142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1303/2569] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:12:46.547188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726d14-c62a-4905-ad52-a0b4cbdef71b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:46.558843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726d14-c62a-4905-ad52-a0b4cbdef71b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:46.564148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef0387-ba87-46ce-bd40-fa7ffd8bcb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:46.564808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0387-ba87-46ce-bd40-fa7ffd8bcb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:46.565086 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0387-ba87-46ce-bd40-fa7ffd8bcb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:46.565359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0387-ba87-46ce-bd40-fa7ffd8bcb36 admin admin] PATH_INFO: `/v3/projects/7eae6e25db1c4a66850943866d3abbf2/users/643e09ef646f42188fd834c84b194a6f/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:46.567327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef0387-ba87-46ce-bd40-fa7ffd8bcb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eae6e25db1c4a66850943866d3abbf2, user_id=643e09ef646f42188fd834c84b194a6f, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:46.569961 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef0387-ba87-46ce-bd40-fa7ffd8bcb36 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:46.581399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1267/2570] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:12:46 2022] PUT /identity/v3/projects/7eae6e25db1c4a66850943866d3abbf2/users/643e09ef646f42188fd834c84b194a6f/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:12:51.193359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340a45d-af50-42e7-8c46-5c9619fc5557 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:51.194487 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340a45d-af50-42e7-8c46-5c9619fc5557 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:51.194895 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340a45d-af50-42e7-8c46-5c9619fc5557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:51.217141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-4340a45d-af50-42e7-8c46-5c9619fc5557 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:51.218599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-4340a45d-af50-42e7-8c46-5c9619fc5557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:51.321652 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1304/2571] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Sep 14 12:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:51.350724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef0387-ba87-46ce-bd40-fa7ffd8bcb36 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:51.436222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef0387-ba87-46ce-bd40-fa7ffd8bcb36 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:51.444421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef1af2-74f0-459e-98b5-bbe900b1f5cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:51.444421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef1af2-74f0-459e-98b5-bbe900b1f5cf service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:51.446203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef1af2-74f0-459e-98b5-bbe900b1f5cf service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:51.446203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef1af2-74f0-459e-98b5-bbe900b1f5cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:51.455194 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef1af2-74f0-459e-98b5-bbe900b1f5cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:51.456932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef1af2-74f0-459e-98b5-bbe900b1f5cf service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:51.468738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1268/2572] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:12:51.980264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58757-82ea-446c-a11e-709bf9738388 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:51.980940 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58757-82ea-446c-a11e-709bf9738388 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:51.981403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58757-82ea-446c-a11e-709bf9738388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:52.015249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b6f58757-82ea-446c-a11e-709bf9738388 None None] MFA Rules not processed for user `88c79e3d1b6e46d6aa15f5f6e2b5498e`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:52.017733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b6f58757-82ea-446c-a11e-709bf9738388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:52.114434 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1305/2573] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:12:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:53.073023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6864078-268e-42c8-8444-79a4130db56f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:53.073575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6864078-268e-42c8-8444-79a4130db56f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:53.073575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6864078-268e-42c8-8444-79a4130db56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:53.103304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-a6864078-268e-42c8-8444-79a4130db56f None None] MFA Rules not processed for user `643e09ef646f42188fd834c84b194a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:53.104582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a6864078-268e-42c8-8444-79a4130db56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:53.117745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:53.180733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1269/2574] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:12:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:12:53.195949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f58757-82ea-446c-a11e-709bf9738388 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:12:53.197570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b6f58757-82ea-446c-a11e-709bf9738388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:53.210422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:12:53.214945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f58757-82ea-446c-a11e-709bf9738388 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:12:53.221278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ec07e-931d-4e3f-83b0-ac167f877154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:12:53.221888 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ec07e-931d-4e3f-83b0-ac167f877154 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:53.222166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ec07e-931d-4e3f-83b0-ac167f877154 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:53.222472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ec07e-931d-4e3f-83b0-ac167f877154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:53.291306 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ec07e-931d-4e3f-83b0-ac167f877154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:12:53.295187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ec07e-931d-4e3f-83b0-ac167f877154 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:12:53.306578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1306/2575] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:12:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:12:57.107949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603d2ce-e49d-496a-90b8-65398a83f3c6 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:12:57.107949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603d2ce-e49d-496a-90b8-65398a83f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:12:57.108556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603d2ce-e49d-496a-90b8-65398a83f3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:12:57.130247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-8603d2ce-e49d-496a-90b8-65398a83f3c6 None None] MFA Rules not processed for user `a800d16e85b044288be508715d1ad977`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:12:57.132130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8603d2ce-e49d-496a-90b8-65398a83f3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:12:57.143120 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1270/2576] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:12:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:13:03.380868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=26 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:07.123692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=26 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:18.196120 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a177-24b6-4a2e-be9a-295f5116aec0 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:13:18.196712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a177-24b6-4a2e-be9a-295f5116aec0 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:13:18.196712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a177-24b6-4a2e-be9a-295f5116aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:13:18.220687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9962a177-24b6-4a2e-be9a-295f5116aec0 None None] MFA Rules not processed for user `912f4c5dd82a493ba2ea38244a6a8f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:13:18.220687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9962a177-24b6-4a2e-be9a-295f5116aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:13:18.280118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1307/2577] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:13:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:13:28.272647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=25 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:32.374713 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603d2ce-e49d-496a-90b8-65398a83f3c6 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:13:32.434039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603d2ce-e49d-496a-90b8-65398a83f3c6 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:13:32.439266 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12496a-d245-4757-92aa-4f069206f6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:13:32.439860 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12496a-d245-4757-92aa-4f069206f6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:13:32.440189 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12496a-d245-4757-92aa-4f069206f6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:13:32.440523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12496a-d245-4757-92aa-4f069206f6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:13:32.450460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12496a-d245-4757-92aa-4f069206f6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:13:32.454112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12496a-d245-4757-92aa-4f069206f6b5 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:13:32.464091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1271/2578] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:13:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:13:34.308599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962a177-24b6-4a2e-be9a-295f5116aec0 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:13:34.320808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962a177-24b6-4a2e-be9a-295f5116aec0 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:13:34.325864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14c5d-6962-4f34-b0d9-d46a7974070f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:13:34.326899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14c5d-6962-4f34-b0d9-d46a7974070f service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:13:34.327101 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14c5d-6962-4f34-b0d9-d46a7974070f service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:13:34.327432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14c5d-6962-4f34-b0d9-d46a7974070f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:13:34.329605 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3be14c5d-6962-4f34-b0d9-d46a7974070f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:13:34.346810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be14c5d-6962-4f34-b0d9-d46a7974070f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:13:34.348241 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be14c5d-6962-4f34-b0d9-d46a7974070f service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:13:34.360137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1308/2579] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:13:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:13:35.948648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12496a-d245-4757-92aa-4f069206f6b5 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:13:35.950261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6b12496a-d245-4757-92aa-4f069206f6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:13:35.962849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12496a-d245-4757-92aa-4f069206f6b5 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:13:35.966969 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b754878-8afa-49c3-929e-88f10ab0d916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:13:35.968802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b754878-8afa-49c3-929e-88f10ab0d916 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:13:35.968802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b754878-8afa-49c3-929e-88f10ab0d916 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:13:35.968802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b754878-8afa-49c3-929e-88f10ab0d916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:13:35.970522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4b754878-8afa-49c3-929e-88f10ab0d916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:13:35.984895 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b754878-8afa-49c3-929e-88f10ab0d916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:13:35.986362 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b754878-8afa-49c3-929e-88f10ab0d916 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:13:35.998249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1272/2580] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:13:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:13:39.092015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14c5d-6962-4f34-b0d9-d46a7974070f service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:13:39.093929 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3be14c5d-6962-4f34-b0d9-d46a7974070f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:13:39.107575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14c5d-6962-4f34-b0d9-d46a7974070f service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:13:39.112370 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:13:39.113004 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:13:39.113286 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:13:39.113556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] PATH_INFO: `/v3/users/414816fb225245cea22ef98d4aa47814` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:13:39.114706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=414816fb225245cea22ef98d4aa47814)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:13:39.116606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:13:39.315405 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414816fb225245cea22ef98d4aa47814'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:13:39.316070 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414816fb225245cea22ef98d4aa47814'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:13:39.323380 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414816fb225245cea22ef98d4aa47814'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:13:39.335322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414816fb225245cea22ef98d4aa47814'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:13:39.335981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414816fb225245cea22ef98d4aa47814'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:13:39.403798 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1309/2581] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:13:39 2022] DELETE /identity/v3/users/414816fb225245cea22ef98d4aa47814 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:13:39.668074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b754878-8afa-49c3-929e-88f10ab0d916 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:13:39.682354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b754878-8afa-49c3-929e-88f10ab0d916 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:13:39.744629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:13:39.745303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:13:39.745603 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:13:39.745879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] PATH_INFO: `/v3/projects/62fd8492eeae4c23a42f810acba83a31` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:13:39.747114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62fd8492eeae4c23a42f810acba83a31)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:13:39.749767 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:13:39.884279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62fd8492eeae4c23a42f810acba83a31', 'request_id': 'req-659f64df-7ae0-491e-8d98-76021d5a4769'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:13:39.890389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62fd8492eeae4c23a42f810acba83a31', 'request_id': 'req-659f64df-7ae0-491e-8d98-76021d5a4769'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:13:39.896270 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62fd8492eeae4c23a42f810acba83a31', 'request_id': 'req-659f64df-7ae0-491e-8d98-76021d5a4769'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:13:39.986387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] The token cache is being invalidate because project 62fd8492eeae4c23a42f810acba83a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:13:39.986716 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:13:39.987359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:13:39.988855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1273/2582] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:13:39 2022] DELETE /identity/v3/projects/62fd8492eeae4c23a42f810acba83a31 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:13:48.997976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:13:48.999974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:13:49.055750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b47c3-0a8d-401c-a79d-44c810eede31 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:13:49.104349 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa4347-71d1-4896-a954-1bc55be4c69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:13:49.105008 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa4347-71d1-4896-a954-1bc55be4c69c service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:13:49.105293 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa4347-71d1-4896-a954-1bc55be4c69c service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:13:49.105572 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa4347-71d1-4896-a954-1bc55be4c69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:13:49.107402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8ffa4347-71d1-4896-a954-1bc55be4c69c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:13:49.138614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:49.167666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa4347-71d1-4896-a954-1bc55be4c69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:13:49.169083 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa4347-71d1-4896-a954-1bc55be4c69c service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:13:49.178660 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1310/2583] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:13:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:13:49.983533 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:13:59.397917 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=14 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:06.113127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:06.115102 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:06.198371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f64df-7ae0-491e-8d98-76021d5a4769 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:06.205980 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dfb32-d974-4d6f-9a10-88d55f60f949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:06.206785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dfb32-d974-4d6f-9a10-88d55f60f949 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:06.207068 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dfb32-d974-4d6f-9a10-88d55f60f949 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:06.207341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dfb32-d974-4d6f-9a10-88d55f60f949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:06.209153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-559dfb32-d974-4d6f-9a10-88d55f60f949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:06.222314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dfb32-d974-4d6f-9a10-88d55f60f949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:06.223894 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dfb32-d974-4d6f-9a10-88d55f60f949 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:06.238145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1274/2584] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:07.455915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa4347-71d1-4896-a954-1bc55be4c69c service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:07.457491 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-8ffa4347-71d1-4896-a954-1bc55be4c69c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:07.517397 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa4347-71d1-4896-a954-1bc55be4c69c service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:07.521098 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce208c7-3574-45c3-a726-1064f6eaa4b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:07.521710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce208c7-3574-45c3-a726-1064f6eaa4b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:07.521978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce208c7-3574-45c3-a726-1064f6eaa4b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:07.522357 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce208c7-3574-45c3-a726-1064f6eaa4b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:07.524149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6ce208c7-3574-45c3-a726-1064f6eaa4b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:07.536402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce208c7-3574-45c3-a726-1064f6eaa4b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:07.537876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce208c7-3574-45c3-a726-1064f6eaa4b9 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:07.547856 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1311/2585] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:16.233360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=34 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:17.148688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dfb32-d974-4d6f-9a10-88d55f60f949 service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:17.150311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-559dfb32-d974-4d6f-9a10-88d55f60f949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:17.165482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dfb32-d974-4d6f-9a10-88d55f60f949 service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:17.172023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a7ba7-0157-42db-abe4-5ad07ec2c269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:17.172642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a7ba7-0157-42db-abe4-5ad07ec2c269 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:17.172924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a7ba7-0157-42db-abe4-5ad07ec2c269 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:17.173290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a7ba7-0157-42db-abe4-5ad07ec2c269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:17.175124 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c52a7ba7-0157-42db-abe4-5ad07ec2c269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:17.188074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a7ba7-0157-42db-abe4-5ad07ec2c269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:17.189922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a7ba7-0157-42db-abe4-5ad07ec2c269 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:17.200583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1275/2586] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:17.543368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=26 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:19.193360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce208c7-3574-45c3-a726-1064f6eaa4b9 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:19.202537 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce208c7-3574-45c3-a726-1064f6eaa4b9 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:19.206104 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c945f9-0f14-4fc9-9aeb-5d4a7e34fe31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:19.206811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c945f9-0f14-4fc9-9aeb-5d4a7e34fe31 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:19.207072 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c945f9-0f14-4fc9-9aeb-5d4a7e34fe31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:19.207351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c945f9-0f14-4fc9-9aeb-5d4a7e34fe31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:19.209174 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e8c945f9-0f14-4fc9-9aeb-5d4a7e34fe31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:19.273514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c945f9-0f14-4fc9-9aeb-5d4a7e34fe31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:19.274985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c945f9-0f14-4fc9-9aeb-5d4a7e34fe31 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:19.284826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1312/2587] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:19.937387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4749e-7bdc-4bab-bd3d-33246799a57b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:19.937875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4749e-7bdc-4bab-bd3d-33246799a57b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:19.938139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4749e-7bdc-4bab-bd3d-33246799a57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:19.960619 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6fc4749e-7bdc-4bab-bd3d-33246799a57b None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:14:19.961983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6fc4749e-7bdc-4bab-bd3d-33246799a57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:20.022344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1276/2588] 10.222.0.77 () {58 vars in 967 bytes} [Wed Sep 14 12:14:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:14:20.162147 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c945f9-0f14-4fc9-9aeb-5d4a7e34fe31 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:20.163672 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e8c945f9-0f14-4fc9-9aeb-5d4a7e34fe31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:20.244089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c945f9-0f14-4fc9-9aeb-5d4a7e34fe31 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:20.250514 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347af9e-7753-4a3b-a258-f96fb1db143d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:20.251325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347af9e-7753-4a3b-a258-f96fb1db143d service swift] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:20.251601 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347af9e-7753-4a3b-a258-f96fb1db143d service swift] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:20.251868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347af9e-7753-4a3b-a258-f96fb1db143d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:20.260731 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347af9e-7753-4a3b-a258-f96fb1db143d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:20.262367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347af9e-7753-4a3b-a258-f96fb1db143d service swift] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:20.272340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1313/2589] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:14:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:14:21.603665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4749e-7bdc-4bab-bd3d-33246799a57b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:21.621330 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4749e-7bdc-4bab-bd3d-33246799a57b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:21.628527 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db15ff-d254-425a-a810-6e99d896a3e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:21.629276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db15ff-d254-425a-a810-6e99d896a3e2 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:21.629783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db15ff-d254-425a-a810-6e99d896a3e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:21.630438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db15ff-d254-425a-a810-6e99d896a3e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:21.633173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-86db15ff-d254-425a-a810-6e99d896a3e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:21.708690 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db15ff-d254-425a-a810-6e99d896a3e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:21.710502 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db15ff-d254-425a-a810-6e99d896a3e2 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:21.720370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1277/2590] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:23.736812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347af9e-7753-4a3b-a258-f96fb1db143d service swift] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:23.738813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2347af9e-7753-4a3b-a258-f96fb1db143d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:23.760331 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347af9e-7753-4a3b-a258-f96fb1db143d service swift] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:23.767105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:23.768968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:23.768968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:23.768968 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] PATH_INFO: `/v3/users/88c79e3d1b6e46d6aa15f5f6e2b5498e` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:23.769453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c79e3d1b6e46d6aa15f5f6e2b5498e)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:23.771755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:24.106868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c79e3d1b6e46d6aa15f5f6e2b5498e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:24.108720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c79e3d1b6e46d6aa15f5f6e2b5498e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:24.118839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c79e3d1b6e46d6aa15f5f6e2b5498e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:24.134193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c79e3d1b6e46d6aa15f5f6e2b5498e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:24.135090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-7f61dcbb-cbfd-46cc-8b18-eb51281f176a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c79e3d1b6e46d6aa15f5f6e2b5498e'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:24.140347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:24.243820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1314/2591] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:14:23 2022] DELETE /identity/v3/users/88c79e3d1b6e46d6aa15f5f6e2b5498e => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:14:24.556222 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db15ff-d254-425a-a810-6e99d896a3e2 service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:24.569158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db15ff-d254-425a-a810-6e99d896a3e2 service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:24.656914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:24.657652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:24.658101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:24.658425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] PATH_INFO: `/v3/projects/55904d87c35146e28a942d845d9db5c3` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:24.660159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55904d87c35146e28a942d845d9db5c3)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:24.662156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:24.817006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:24.831578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55904d87c35146e28a942d845d9db5c3', 'request_id': 'req-8d48d589-bb63-41e7-abbf-776e7364b1c2'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:24.844136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55904d87c35146e28a942d845d9db5c3', 'request_id': 'req-8d48d589-bb63-41e7-abbf-776e7364b1c2'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:24.855035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55904d87c35146e28a942d845d9db5c3', 'request_id': 'req-8d48d589-bb63-41e7-abbf-776e7364b1c2'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:24.986604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] The token cache is being invalidate because project 55904d87c35146e28a942d845d9db5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:14:24.987017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:24.997788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-8d48d589-bb63-41e7-abbf-776e7364b1c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:24.997788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1278/2592] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:14:24 2022] DELETE /identity/v3/projects/55904d87c35146e28a942d845d9db5c3 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:14:24.998171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b6515-b0c2-4099-8484-1d9e9ad20815 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:24.998171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b6515-b0c2-4099-8484-1d9e9ad20815 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:24.998171 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b6515-b0c2-4099-8484-1d9e9ad20815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:25.017613 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-5d3b6515-b0c2-4099-8484-1d9e9ad20815 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:14:25.018975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-5d3b6515-b0c2-4099-8484-1d9e9ad20815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:25.099219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1315/2593] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:14:25.106849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e82bb-22fa-499b-8490-a34bdf4910ca None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:25.107364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e82bb-22fa-499b-8490-a34bdf4910ca None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:25.107634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e82bb-22fa-499b-8490-a34bdf4910ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:25.130197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b23e82bb-22fa-499b-8490-a34bdf4910ca None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:14:25.131523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b23e82bb-22fa-499b-8490-a34bdf4910ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:25.140485 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1279/2594] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:14:25.144920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b6515-b0c2-4099-8484-1d9e9ad20815 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:25.173987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b6515-b0c2-4099-8484-1d9e9ad20815 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:25.179322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf57c96-64ad-4765-8bea-a5c7b1928dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:25.179865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf57c96-64ad-4765-8bea-a5c7b1928dea admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:25.180145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf57c96-64ad-4765-8bea-a5c7b1928dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:25.180418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf57c96-64ad-4765-8bea-a5c7b1928dea admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:25.181092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf57c96-64ad-4765-8bea-a5c7b1928dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:14:25.181418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf57c96-64ad-4765-8bea-a5c7b1928dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:25.183062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf57c96-64ad-4765-8bea-a5c7b1928dea admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:25.196640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1316/2595] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:14:25.206433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e82bb-22fa-499b-8490-a34bdf4910ca None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:25.210959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e82bb-22fa-499b-8490-a34bdf4910ca None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:25.216042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf1f94-3fbe-472f-b3ce-039952257c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:25.216749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf1f94-3fbe-472f-b3ce-039952257c73 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:25.217077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf1f94-3fbe-472f-b3ce-039952257c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:25.217278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf1f94-3fbe-472f-b3ce-039952257c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:25.217932 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf1f94-3fbe-472f-b3ce-039952257c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:25.220946 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf1f94-3fbe-472f-b3ce-039952257c73 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:25.344466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1280/2596] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:14:25 2022] POST /identity/v3/projects => generated 389 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:14:25.350233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf57c96-64ad-4765-8bea-a5c7b1928dea admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:25.361504 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf57c96-64ad-4765-8bea-a5c7b1928dea admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:25.421509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212fbd2-8577-4095-89a9-ffd7416b0b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:25.422145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212fbd2-8577-4095-89a9-ffd7416b0b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:25.422520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212fbd2-8577-4095-89a9-ffd7416b0b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:25.422795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212fbd2-8577-4095-89a9-ffd7416b0b05 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:25.423439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212fbd2-8577-4095-89a9-ffd7416b0b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:25.425445 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212fbd2-8577-4095-89a9-ffd7416b0b05 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:25.526887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1317/2597] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:14:25 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:14:25.532688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf1f94-3fbe-472f-b3ce-039952257c73 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:25.547163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf1f94-3fbe-472f-b3ce-039952257c73 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:25.552934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd807e0-a40e-4da7-b5a9-5a610070650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:25.555830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd807e0-a40e-4da7-b5a9-5a610070650d admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:25.555830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd807e0-a40e-4da7-b5a9-5a610070650d admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:25.555830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd807e0-a40e-4da7-b5a9-5a610070650d admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:25.555830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd807e0-a40e-4da7-b5a9-5a610070650d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:25.556972 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd807e0-a40e-4da7-b5a9-5a610070650d admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:25.568564 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1281/2598] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:14:25.572790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212fbd2-8577-4095-89a9-ffd7416b0b05 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:25.585608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212fbd2-8577-4095-89a9-ffd7416b0b05 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:25.592049 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1b92f-3de9-4bb7-873c-711360225ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:25.592685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1b92f-3de9-4bb7-873c-711360225ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:25.592997 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1b92f-3de9-4bb7-873c-711360225ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:25.593229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1b92f-3de9-4bb7-873c-711360225ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:25.594367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1b92f-3de9-4bb7-873c-711360225ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:25.596218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1b92f-3de9-4bb7-873c-711360225ea1 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:25.608793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1318/2599] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:14:25.613127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd807e0-a40e-4da7-b5a9-5a610070650d admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:25.628388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd807e0-a40e-4da7-b5a9-5a610070650d admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:25.634830 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80e7f8-d76f-443e-af89-a8409914d267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:25.635613 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e7f8-d76f-443e-af89-a8409914d267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:25.636134 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e7f8-d76f-443e-af89-a8409914d267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:25.636479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e7f8-d76f-443e-af89-a8409914d267 admin admin] PATH_INFO: `/v3/projects/d1b879e4d8784a80a4e432b7b7cc3179/users/0e84875da0ff4917bd9a640e3b425244/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:25.656069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80e7f8-d76f-443e-af89-a8409914d267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b879e4d8784a80a4e432b7b7cc3179, user_id=0e84875da0ff4917bd9a640e3b425244, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:25.658918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80e7f8-d76f-443e-af89-a8409914d267 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:25.776018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1282/2600] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:14:25 2022] PUT /identity/v3/projects/d1b879e4d8784a80a4e432b7b7cc3179/users/0e84875da0ff4917bd9a640e3b425244/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:14:25.778498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee93a-2073-4ea5-a826-a55a66d2260d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:25.779020 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee93a-2073-4ea5-a826-a55a66d2260d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:25.779475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee93a-2073-4ea5-a826-a55a66d2260d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:25.805884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-701ee93a-2073-4ea5-a826-a55a66d2260d None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:14:25.807129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-701ee93a-2073-4ea5-a826-a55a66d2260d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:25.907039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1319/2601] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:14:25.922719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80e7f8-d76f-443e-af89-a8409914d267 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:25.927778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-df80e7f8-d76f-443e-af89-a8409914d267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:26.004216 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80e7f8-d76f-443e-af89-a8409914d267 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:26.007899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ac075-7a88-4f00-8892-80dbe0206278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:26.008497 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ac075-7a88-4f00-8892-80dbe0206278 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:26.008774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ac075-7a88-4f00-8892-80dbe0206278 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:26.009043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ac075-7a88-4f00-8892-80dbe0206278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:26.018548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ac075-7a88-4f00-8892-80dbe0206278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:26.019954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ac075-7a88-4f00-8892-80dbe0206278 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:26.029429 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1283/2602] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:30.638569 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee93a-2073-4ea5-a826-a55a66d2260d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:30.641077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-701ee93a-2073-4ea5-a826-a55a66d2260d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:30.646948 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:30.720552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee93a-2073-4ea5-a826-a55a66d2260d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:30.725669 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f00d9-b56e-4573-9327-e464a36d8b29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:30.726323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f00d9-b56e-4573-9327-e464a36d8b29 service placement] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:30.726606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f00d9-b56e-4573-9327-e464a36d8b29 service placement] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:30.726877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f00d9-b56e-4573-9327-e464a36d8b29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:30.728836 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-212f00d9-b56e-4573-9327-e464a36d8b29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:30.742736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f00d9-b56e-4573-9327-e464a36d8b29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:30.744347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f00d9-b56e-4573-9327-e464a36d8b29 service placement] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:30.756933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1320/2603] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:30.865881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ac075-7a88-4f00-8892-80dbe0206278 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:30.865881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e94ac075-7a88-4f00-8892-80dbe0206278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:30.880924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ac075-7a88-4f00-8892-80dbe0206278 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:30.886505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:30.887151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:30.887432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:30.887712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] PATH_INFO: `/v3/users/fbb73389ac774916afaa996c87fdc010` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:30.889131 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb73389ac774916afaa996c87fdc010)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:30.891127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:31.299072 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb73389ac774916afaa996c87fdc010'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:31.310926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:31.316984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb73389ac774916afaa996c87fdc010'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:31.333903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb73389ac774916afaa996c87fdc010'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:31.436820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb73389ac774916afaa996c87fdc010'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:31.438070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb73389ac774916afaa996c87fdc010'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:31.452409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1284/2604] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:14:30 2022] DELETE /identity/v3/users/fbb73389ac774916afaa996c87fdc010 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:14:31.752152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f00d9-b56e-4573-9327-e464a36d8b29 service placement] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:31.775635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f00d9-b56e-4573-9327-e464a36d8b29 service placement] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:31.931555 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:31.932548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:31.932835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:31.933188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] PATH_INFO: `/v3/projects/e482e4db04904a8991f6fd4d91ce3356` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:31.934489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e482e4db04904a8991f6fd4d91ce3356)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:31.937150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:32.082920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e482e4db04904a8991f6fd4d91ce3356', 'request_id': 'req-e13149a1-3724-432c-92cc-2c1a0f7faf79'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:32.190769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e482e4db04904a8991f6fd4d91ce3356', 'request_id': 'req-e13149a1-3724-432c-92cc-2c1a0f7faf79'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:32.203346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e482e4db04904a8991f6fd4d91ce3356', 'request_id': 'req-e13149a1-3724-432c-92cc-2c1a0f7faf79'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:32.239258 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] The token cache is being invalidate because project e482e4db04904a8991f6fd4d91ce3356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:14:32.239643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:32.240507 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:32.248775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:32.251045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1321/2605] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:14:31 2022] DELETE /identity/v3/projects/e482e4db04904a8991f6fd4d91ce3356 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:14:32.252632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:32.268338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18dd6c-0fa4-43b4-b079-8e6623abb1d2 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:32.384203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:32.384856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:32.385138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:32.385416 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] PATH_INFO: `/v3/users/f66bdbd90aa1449eacb79a18905cee59` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:32.386643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66bdbd90aa1449eacb79a18905cee59)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:32.388682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:32.626159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66bdbd90aa1449eacb79a18905cee59'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:32.633915 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66bdbd90aa1449eacb79a18905cee59'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:32.647580 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66bdbd90aa1449eacb79a18905cee59'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:32.751779 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66bdbd90aa1449eacb79a18905cee59'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:32.754340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-56ca9a71-60b7-42f1-a952-fc44ed9149d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66bdbd90aa1449eacb79a18905cee59'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:32.758837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1285/2606] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:14:32 2022] DELETE /identity/v3/users/f66bdbd90aa1449eacb79a18905cee59 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:14:33.163958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:33.165418 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:33.196564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13149a1-3724-432c-92cc-2c1a0f7faf79 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:33.229281 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:33.297585 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:33.298042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:33.298453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:33.298843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] PATH_INFO: `/v3/projects/87b948672a314aa6abd9d83d7350c796` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:33.300382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b948672a314aa6abd9d83d7350c796)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:33.302957 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:33.358855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7b3e-7a78-489d-b06c-1630269fdeb1 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:33.359821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7b3e-7a78-489d-b06c-1630269fdeb1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:33.360248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c7b3e-7a78-489d-b06c-1630269fdeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:33.393540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-591c7b3e-7a78-489d-b06c-1630269fdeb1 None None] MFA Rules not processed for user `0e84875da0ff4917bd9a640e3b425244`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:14:33.394917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-591c7b3e-7a78-489d-b06c-1630269fdeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:33.439777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b948672a314aa6abd9d83d7350c796', 'request_id': 'req-66f0ef44-780f-44db-b707-222580087091'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:33.442077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:33.469257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1286/2607] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:14:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:14:33.485417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c7b3e-7a78-489d-b06c-1630269fdeb1 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:33.486970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-591c7b3e-7a78-489d-b06c-1630269fdeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:33.529274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b948672a314aa6abd9d83d7350c796', 'request_id': 'req-66f0ef44-780f-44db-b707-222580087091'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:33.536479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b948672a314aa6abd9d83d7350c796', 'request_id': 'req-66f0ef44-780f-44db-b707-222580087091'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:33.549686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] The token cache is being invalidate because project 87b948672a314aa6abd9d83d7350c796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:14:33.550069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:33.550883 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-66f0ef44-780f-44db-b707-222580087091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:33.552427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1322/2608] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:14:33 2022] DELETE /identity/v3/projects/87b948672a314aa6abd9d83d7350c796 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:14:33.574140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c7b3e-7a78-489d-b06c-1630269fdeb1 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:33.651987 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cb3f4-a202-4ce5-9b57-30ba799f85b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:33.652623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb3f4-a202-4ce5-9b57-30ba799f85b9 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:33.652969 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb3f4-a202-4ce5-9b57-30ba799f85b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:33.653598 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb3f4-a202-4ce5-9b57-30ba799f85b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:33.656315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-565cb3f4-a202-4ce5-9b57-30ba799f85b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:33.732289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cb3f4-a202-4ce5-9b57-30ba799f85b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:33.734056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cb3f4-a202-4ce5-9b57-30ba799f85b9 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:33.744851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1287/2609] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:14:37.034275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb51b5-9c7a-4870-bd12-e704b3ab16a8 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:37.034795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb51b5-9c7a-4870-bd12-e704b3ab16a8 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:37.034893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb51b5-9c7a-4870-bd12-e704b3ab16a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:37.059350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-defb51b5-9c7a-4870-bd12-e704b3ab16a8 None None] MFA Rules not processed for user `0e84875da0ff4917bd9a640e3b425244`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:14:37.061333 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-defb51b5-9c7a-4870-bd12-e704b3ab16a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:37.077214 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1323/2610] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:14:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:14:37.417583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cb3f4-a202-4ce5-9b57-30ba799f85b9 service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:37.419195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-565cb3f4-a202-4ce5-9b57-30ba799f85b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:37.438400 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:37.477782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cb3f4-a202-4ce5-9b57-30ba799f85b9 service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:37.481459 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70079058-0685-4b91-bc73-4315a6dae1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:37.482806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70079058-0685-4b91-bc73-4315a6dae1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:37.483181 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70079058-0685-4b91-bc73-4315a6dae1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:37.483453 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70079058-0685-4b91-bc73-4315a6dae1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:37.485217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-70079058-0685-4b91-bc73-4315a6dae1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:37.495788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70079058-0685-4b91-bc73-4315a6dae1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:37.497205 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70079058-0685-4b91-bc73-4315a6dae1a1 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:37.505405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1288/2611] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:37.923030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb51b5-9c7a-4870-bd12-e704b3ab16a8 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:37.929470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-defb51b5-9c7a-4870-bd12-e704b3ab16a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:38.028016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb51b5-9c7a-4870-bd12-e704b3ab16a8 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:38.035395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c679120-6ab1-41bf-bc69-75cbdb112916 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:38.036105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c679120-6ab1-41bf-bc69-75cbdb112916 service placement] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:38.036631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c679120-6ab1-41bf-bc69-75cbdb112916 service placement] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:38.037088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c679120-6ab1-41bf-bc69-75cbdb112916 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:38.040073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7c679120-6ab1-41bf-bc69-75cbdb112916 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:38.055204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c679120-6ab1-41bf-bc69-75cbdb112916 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:38.057037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c679120-6ab1-41bf-bc69-75cbdb112916 service placement] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:38.069133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1324/2612] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:47.501826 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=19 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:48.064303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:51.159341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70079058-0685-4b91-bc73-4315a6dae1a1 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:51.161650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-70079058-0685-4b91-bc73-4315a6dae1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:51.226940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70079058-0685-4b91-bc73-4315a6dae1a1 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:51.230918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eaf72-35ca-45e0-809b-52ad0438313f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:51.231525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eaf72-35ca-45e0-809b-52ad0438313f service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:51.231803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eaf72-35ca-45e0-809b-52ad0438313f service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:51.232075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eaf72-35ca-45e0-809b-52ad0438313f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:51.233813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c14eaf72-35ca-45e0-809b-52ad0438313f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:51.340438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eaf72-35ca-45e0-809b-52ad0438313f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:51.342676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eaf72-35ca-45e0-809b-52ad0438313f service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:51.362658 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1289/2613] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:51.417373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c679120-6ab1-41bf-bc69-75cbdb112916 service placement] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:51.419424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7c679120-6ab1-41bf-bc69-75cbdb112916 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:51.488695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c679120-6ab1-41bf-bc69-75cbdb112916 service placement] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:51.495438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440032c-04ec-4c8f-957e-30c7dd7136b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:51.496117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440032c-04ec-4c8f-957e-30c7dd7136b9 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:51.496401 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440032c-04ec-4c8f-957e-30c7dd7136b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:51.496677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440032c-04ec-4c8f-957e-30c7dd7136b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:51.498642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6440032c-04ec-4c8f-957e-30c7dd7136b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:51.511520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440032c-04ec-4c8f-957e-30c7dd7136b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:51.513697 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440032c-04ec-4c8f-957e-30c7dd7136b9 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:51.527269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1325/2614] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:14:55.196905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eaf72-35ca-45e0-809b-52ad0438313f service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:55.198685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c14eaf72-35ca-45e0-809b-52ad0438313f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:55.212861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eaf72-35ca-45e0-809b-52ad0438313f service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:55.221165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:55.221829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:55.222112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:55.222416 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] PATH_INFO: `/v3/users/912f4c5dd82a493ba2ea38244a6a8f9e` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:55.223920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=912f4c5dd82a493ba2ea38244a6a8f9e)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:55.226887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:55.490178 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912f4c5dd82a493ba2ea38244a6a8f9e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:55.495251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:55.498841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912f4c5dd82a493ba2ea38244a6a8f9e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:55.511920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912f4c5dd82a493ba2ea38244a6a8f9e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:55.620709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912f4c5dd82a493ba2ea38244a6a8f9e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:55.621348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-61c6f0c1-ab6c-4842-b6a7-f286808da93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912f4c5dd82a493ba2ea38244a6a8f9e'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:55.628663 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1290/2615] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:14:55 2022] DELETE /identity/v3/users/912f4c5dd82a493ba2ea38244a6a8f9e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:14:56.055784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440032c-04ec-4c8f-957e-30c7dd7136b9 service nova] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:56.068666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440032c-04ec-4c8f-957e-30c7dd7136b9 service nova] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:56.143725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:56.144646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:56.144926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:56.145808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] PATH_INFO: `/v3/projects/d19b35c5d4e3437cabcfb2de67fbe6a2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:56.147045 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19b35c5d4e3437cabcfb2de67fbe6a2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:56.149508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:56.282867 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19b35c5d4e3437cabcfb2de67fbe6a2', 'request_id': 'req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:56.384539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19b35c5d4e3437cabcfb2de67fbe6a2', 'request_id': 'req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:56.392933 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19b35c5d4e3437cabcfb2de67fbe6a2', 'request_id': 'req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:56.408353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] The token cache is being invalidate because project d19b35c5d4e3437cabcfb2de67fbe6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:14:56.408793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:56.409465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-49ec6edb-b6bf-4951-aeb7-a95deeeb8c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:14:56.414439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1326/2616] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:14:56 2022] DELETE /identity/v3/projects/d19b35c5d4e3437cabcfb2de67fbe6a2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:14:56.419503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186d6bd-47ed-42c0-86df-43fc8f93c10a None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:56.420176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186d6bd-47ed-42c0-86df-43fc8f93c10a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:56.420176 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186d6bd-47ed-42c0-86df-43fc8f93c10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:56.487487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6186d6bd-47ed-42c0-86df-43fc8f93c10a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:14:56.488891 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6186d6bd-47ed-42c0-86df-43fc8f93c10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:56.559630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1291/2617] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:14:56.568090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76406aa1-0886-40b1-85e3-cee9095ffe6f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:56.568403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76406aa1-0886-40b1-85e3-cee9095ffe6f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:56.568658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76406aa1-0886-40b1-85e3-cee9095ffe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:56.598840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-76406aa1-0886-40b1-85e3-cee9095ffe6f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:14:56.600099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-76406aa1-0886-40b1-85e3-cee9095ffe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:56.608875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1327/2618] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:14:56.613121 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186d6bd-47ed-42c0-86df-43fc8f93c10a None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:56.624862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186d6bd-47ed-42c0-86df-43fc8f93c10a None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:56.630707 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f150b-96a2-4c12-b6f3-7cb1ec84291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:56.631751 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f150b-96a2-4c12-b6f3-7cb1ec84291b admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:56.632263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f150b-96a2-4c12-b6f3-7cb1ec84291b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:56.632754 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f150b-96a2-4c12-b6f3-7cb1ec84291b admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:56.633693 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f150b-96a2-4c12-b6f3-7cb1ec84291b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:14:56.634070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f150b-96a2-4c12-b6f3-7cb1ec84291b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:56.636008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f150b-96a2-4c12-b6f3-7cb1ec84291b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:56.652587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1292/2619] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:14:56.654553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76406aa1-0886-40b1-85e3-cee9095ffe6f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:56.664266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76406aa1-0886-40b1-85e3-cee9095ffe6f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:56.671526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ad929-4423-478c-ac3f-a6fc4bff0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:56.671526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ad929-4423-478c-ac3f-a6fc4bff0f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:56.671526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ad929-4423-478c-ac3f-a6fc4bff0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:56.671526 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ad929-4423-478c-ac3f-a6fc4bff0f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:56.671939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ad929-4423-478c-ac3f-a6fc4bff0f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:56.673116 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ad929-4423-478c-ac3f-a6fc4bff0f5a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:56.695923 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:56.789384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1328/2620] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:14:56 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:14:56.793417 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f150b-96a2-4c12-b6f3-7cb1ec84291b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:56.804729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f150b-96a2-4c12-b6f3-7cb1ec84291b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:56.873589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaed027-21cc-4d93-ac1c-7626606eea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:56.874238 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaed027-21cc-4d93-ac1c-7626606eea76 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:56.874536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaed027-21cc-4d93-ac1c-7626606eea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:56.874807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaed027-21cc-4d93-ac1c-7626606eea76 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:56.875485 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaed027-21cc-4d93-ac1c-7626606eea76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:56.877439 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaed027-21cc-4d93-ac1c-7626606eea76 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:56.998525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1293/2621] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:14:56 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:14:57.002745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ad929-4423-478c-ac3f-a6fc4bff0f5a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:57.013741 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ad929-4423-478c-ac3f-a6fc4bff0f5a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:57.018339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc46080-c8cc-429a-a4f9-51497b807ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:57.018971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc46080-c8cc-429a-a4f9-51497b807ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:57.019250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc46080-c8cc-429a-a4f9-51497b807ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:57.019553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc46080-c8cc-429a-a4f9-51497b807ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:57.020199 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc46080-c8cc-429a-a4f9-51497b807ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:57.021782 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc46080-c8cc-429a-a4f9-51497b807ccf admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:57.032489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1329/2622] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:14:57.036634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaed027-21cc-4d93-ac1c-7626606eea76 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:57.046731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaed027-21cc-4d93-ac1c-7626606eea76 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:57.051375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0353fa7-d38d-47f6-bbc6-de44167e9ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:57.051974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353fa7-d38d-47f6-bbc6-de44167e9ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:57.052248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353fa7-d38d-47f6-bbc6-de44167e9ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:57.052520 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353fa7-d38d-47f6-bbc6-de44167e9ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:57.053154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353fa7-d38d-47f6-bbc6-de44167e9ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:57.054851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353fa7-d38d-47f6-bbc6-de44167e9ea4 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:57.068750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1294/2623] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:14:57.070706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc46080-c8cc-429a-a4f9-51497b807ccf admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:57.081430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc46080-c8cc-429a-a4f9-51497b807ccf admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:57.086075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d99c0-f4cc-4ff7-b787-30847164d010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:57.086775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d99c0-f4cc-4ff7-b787-30847164d010 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:57.087062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d99c0-f4cc-4ff7-b787-30847164d010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:57.087342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d99c0-f4cc-4ff7-b787-30847164d010 admin admin] PATH_INFO: `/v3/projects/d665f88e1e7f487dbf069db7112df933/users/b05286dc8d75459b87db5f0cf81ba099/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:57.103474 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d99c0-f4cc-4ff7-b787-30847164d010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d665f88e1e7f487dbf069db7112df933, user_id=b05286dc8d75459b87db5f0cf81ba099, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:57.106811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d99c0-f4cc-4ff7-b787-30847164d010 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:57.221122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1330/2624] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:14:57 2022] PUT /identity/v3/projects/d665f88e1e7f487dbf069db7112df933/users/b05286dc8d75459b87db5f0cf81ba099/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:14:57.226168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc018d-bd05-447b-8af5-db2aac965f09 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:57.226492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc018d-bd05-447b-8af5-db2aac965f09 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:57.226769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc018d-bd05-447b-8af5-db2aac965f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:57.235214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:14:57.247209 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-aecc018d-bd05-447b-8af5-db2aac965f09 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:14:57.248712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-aecc018d-bd05-447b-8af5-db2aac965f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:57.311759 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1295/2625] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:14:57.321811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d99c0-f4cc-4ff7-b787-30847164d010 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:14:57.323612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-129d99c0-f4cc-4ff7-b787-30847164d010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:14:57.383007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d99c0-f4cc-4ff7-b787-30847164d010 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:14:57.386694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d549-97b4-4426-a97f-c5e85956b935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:14:57.387835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d549-97b4-4426-a97f-c5e85956b935 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:14:57.388122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d549-97b4-4426-a97f-c5e85956b935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:14:57.388441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d549-97b4-4426-a97f-c5e85956b935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:14:57.397567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07d549-97b4-4426-a97f-c5e85956b935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:14:57.399022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07d549-97b4-4426-a97f-c5e85956b935 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:14:57.409544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1331/2626] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:15:03.349578 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2386c-40f4-47b3-8f7e-dab3db0a5f09 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:15:03.350154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2386c-40f4-47b3-8f7e-dab3db0a5f09 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:15:03.350154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2386c-40f4-47b3-8f7e-dab3db0a5f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:15:03.391831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-20c2386c-40f4-47b3-8f7e-dab3db0a5f09 None None] MFA Rules not processed for user `b05286dc8d75459b87db5f0cf81ba099`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:15:03.391831 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-20c2386c-40f4-47b3-8f7e-dab3db0a5f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:15:03.445723 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1296/2627] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:15:03.460858 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d549-97b4-4426-a97f-c5e85956b935 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:15:03.462260 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7d07d549-97b4-4426-a97f-c5e85956b935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:15:03.540261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d549-97b4-4426-a97f-c5e85956b935 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:15:03.546419 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01063a9a-e43a-496d-adbf-9f3265c31ac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:15:03.547046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01063a9a-e43a-496d-adbf-9f3265c31ac4 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:15:03.547323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01063a9a-e43a-496d-adbf-9f3265c31ac4 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:15:03.547593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01063a9a-e43a-496d-adbf-9f3265c31ac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:15:03.555905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01063a9a-e43a-496d-adbf-9f3265c31ac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:15:03.557476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01063a9a-e43a-496d-adbf-9f3265c31ac4 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:15:03.567245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1332/2628] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:15:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:15:06.236685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b71f8b-36fe-4285-87bb-eda9fad4f13f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:15:06.237304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b71f8b-36fe-4285-87bb-eda9fad4f13f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:15:06.237304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b71f8b-36fe-4285-87bb-eda9fad4f13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:15:06.257940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-46b71f8b-36fe-4285-87bb-eda9fad4f13f None None] MFA Rules not processed for user `b05286dc8d75459b87db5f0cf81ba099`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:15:06.259615 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-46b71f8b-36fe-4285-87bb-eda9fad4f13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:15:06.268114 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1297/2629] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:15:13.563395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=78,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:16.252818 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=60 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:15:55.022425 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dc02f-87b6-4dad-8f2b-d28e81cf0da5 None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:15:55.023122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dc02f-87b6-4dad-8f2b-d28e81cf0da5 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:15:55.023122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dc02f-87b6-4dad-8f2b-d28e81cf0da5 None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:15:55.024437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1333/2630] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:15:55.032682 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7abe6e-3fa5-4e57-8c05-97229a1b29c7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:15:55.033188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7abe6e-3fa5-4e57-8c05-97229a1b29c7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:15:55.033381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7abe6e-3fa5-4e57-8c05-97229a1b29c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:15:55.066577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5d7abe6e-3fa5-4e57-8c05-97229a1b29c7 None None] MFA Rules not processed for user `67880641bc954088bef0b601a8410f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:15:55.067785 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5d7abe6e-3fa5-4e57-8c05-97229a1b29c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:15:55.078192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1298/2631] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:15:55.099951 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dc02f-87b6-4dad-8f2b-d28e81cf0da5 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:15:55.101784 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6c2dc02f-87b6-4dad-8f2b-d28e81cf0da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:15:55.123025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dc02f-87b6-4dad-8f2b-d28e81cf0da5 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:15:55.123025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78ebb5-f99b-4651-b697-01b60e7aee27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:15:55.123025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ebb5-f99b-4651-b697-01b60e7aee27 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:15:55.123025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ebb5-f99b-4651-b697-01b60e7aee27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:15:55.123415 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ebb5-f99b-4651-b697-01b60e7aee27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:15:55.128886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78ebb5-f99b-4651-b697-01b60e7aee27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:15:55.130327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78ebb5-f99b-4651-b697-01b60e7aee27 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:15:55.139412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1334/2632] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:15:55.227572 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d598c-9e2c-4f33-91ad-27e5f0d16b08 None None] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:15:55.227868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d598c-9e2c-4f33-91ad-27e5f0d16b08 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:15:55.228173 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d598c-9e2c-4f33-91ad-27e5f0d16b08 None None] PATH_INFO: `/` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:15:55.229602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1299/2633] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:15:55.234586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6161d1-4a8f-4793-9f40-3ac0f4da83fe None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:15:55.235031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6161d1-4a8f-4793-9f40-3ac0f4da83fe None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:15:55.235313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6161d1-4a8f-4793-9f40-3ac0f4da83fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:15:55.255685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9b6161d1-4a8f-4793-9f40-3ac0f4da83fe None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:15:55.259438 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9b6161d1-4a8f-4793-9f40-3ac0f4da83fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:15:55.268089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1335/2634] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:15:55.279409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d598c-9e2c-4f33-91ad-27e5f0d16b08 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:15:55.290507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d598c-9e2c-4f33-91ad-27e5f0d16b08 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:15:55.294628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b06fee-a03d-45e3-ba7e-f54d08377a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:15:55.295233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06fee-a03d-45e3-ba7e-f54d08377a53 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:15:55.295518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06fee-a03d-45e3-ba7e-f54d08377a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:15:55.295789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b06fee-a03d-45e3-ba7e-f54d08377a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:15:55.306854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b06fee-a03d-45e3-ba7e-f54d08377a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:15:55.309197 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b06fee-a03d-45e3-ba7e-f54d08377a53 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:15:55.320488 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1300/2635] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:16:02.819689 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4e9f-0955-47c4-8de9-c9822b0efb2d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:02.820158 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4e9f-0955-47c4-8de9-c9822b0efb2d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:02.820290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4e9f-0955-47c4-8de9-c9822b0efb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:02.841108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f20a4e9f-0955-47c4-8de9-c9822b0efb2d None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:16:02.842356 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f20a4e9f-0955-47c4-8de9-c9822b0efb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:16:02.898371 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1336/2636] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:16:03.063084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b06fee-a03d-45e3-ba7e-f54d08377a53 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:16:03.064511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-48b06fee-a03d-45e3-ba7e-f54d08377a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:16:03.133969 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b06fee-a03d-45e3-ba7e-f54d08377a53 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:16:03.139076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a823cdb-7610-4f0c-a15c-47365c476d1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:16:03.139666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a823cdb-7610-4f0c-a15c-47365c476d1e service swift] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:03.139941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a823cdb-7610-4f0c-a15c-47365c476d1e service swift] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:03.140211 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a823cdb-7610-4f0c-a15c-47365c476d1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:03.148042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a823cdb-7610-4f0c-a15c-47365c476d1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:16:03.149654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a823cdb-7610-4f0c-a15c-47365c476d1e service swift] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:16:03.158153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1301/2637] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:16:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 12:16:12.891402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=34 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:13.155044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=45 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:15.924846 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca5f62-78cd-4cfa-adb9-af4fe8851e91 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:15.925350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca5f62-78cd-4cfa-adb9-af4fe8851e91 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:15.925446 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca5f62-78cd-4cfa-adb9-af4fe8851e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:15.946495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-29ca5f62-78cd-4cfa-adb9-af4fe8851e91 None None] MFA Rules not processed for user `b05286dc8d75459b87db5f0cf81ba099`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:16:15.948661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-29ca5f62-78cd-4cfa-adb9-af4fe8851e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:16:15.955515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1337/2638] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:16:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:16:16.269091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a823cdb-7610-4f0c-a15c-47365c476d1e service swift] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:16:16.278694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a823cdb-7610-4f0c-a15c-47365c476d1e service swift] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:16:16.282380 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f11bde-5c43-407c-8d15-9dfbde5bf7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:16:16.283040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11bde-5c43-407c-8d15-9dfbde5bf7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:16.283317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11bde-5c43-407c-8d15-9dfbde5bf7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:16.283724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11bde-5c43-407c-8d15-9dfbde5bf7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:16.285413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b5f11bde-5c43-407c-8d15-9dfbde5bf7d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:16:16.295489 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f11bde-5c43-407c-8d15-9dfbde5bf7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:16:16.296897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f11bde-5c43-407c-8d15-9dfbde5bf7d6 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:16:16.304666 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1302/2639] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:16:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:16:20.048581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321bb8-3e48-4fa6-baae-e1d7741cd1ab None None] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:20.049166 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321bb8-3e48-4fa6-baae-e1d7741cd1ab None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:20.049266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321bb8-3e48-4fa6-baae-e1d7741cd1ab None None] PATH_INFO: `/` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:20.050675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1338/2640] 10.222.0.77 () {54 vars in 921 bytes} [Wed Sep 14 12:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:16:20.056018 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed561b3c-4fd1-45e1-a647-f4c170ce9874 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:20.056645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed561b3c-4fd1-45e1-a647-f4c170ce9874 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:20.057490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed561b3c-4fd1-45e1-a647-f4c170ce9874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:20.078947 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ed561b3c-4fd1-45e1-a647-f4c170ce9874 None None] MFA Rules not processed for user `8882a9f2764648be9bfe4606144660d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:16:20.080145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ed561b3c-4fd1-45e1-a647-f4c170ce9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:16:20.090339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1303/2641] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Sep 14 12:16:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:16:20.101693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321bb8-3e48-4fa6-baae-e1d7741cd1ab None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:16:20.104099 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-13321bb8-3e48-4fa6-baae-e1d7741cd1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:16:20.168872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321bb8-3e48-4fa6-baae-e1d7741cd1ab None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:16:20.172984 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682c3d0-40d6-4aa0-9929-955cb2b811b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bdd5f0b3bc4c099c0d34b3b7c3f3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:16:20.173754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682c3d0-40d6-4aa0-9929-955cb2b811b7 service glance] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:20.174100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682c3d0-40d6-4aa0-9929-955cb2b811b7 service glance] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:20.174479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682c3d0-40d6-4aa0-9929-955cb2b811b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:20.188014 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682c3d0-40d6-4aa0-9929-955cb2b811b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:16:20.190571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682c3d0-40d6-4aa0-9929-955cb2b811b7 service glance] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:16:20.221157 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1339/2642] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:16:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:16:25.554720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849626b7-6873-4916-bd6b-98d72619cb41 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:25.555190 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849626b7-6873-4916-bd6b-98d72619cb41 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:25.555297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849626b7-6873-4916-bd6b-98d72619cb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:25.574798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-849626b7-6873-4916-bd6b-98d72619cb41 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:16:25.575934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-849626b7-6873-4916-bd6b-98d72619cb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:16:25.583610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1304/2643] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:16:25.596057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682c3d0-40d6-4aa0-9929-955cb2b811b7 service glance] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:16:25.607776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682c3d0-40d6-4aa0-9929-955cb2b811b7 service glance] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:16:25.612748 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e4bd7-05e2-44c8-8a62-e8abf50a3a0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:16:25.613372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4bd7-05e2-44c8-8a62-e8abf50a3a0f service swift] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:25.613650 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4bd7-05e2-44c8-8a62-e8abf50a3a0f service swift] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:25.613920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e4bd7-05e2-44c8-8a62-e8abf50a3a0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:25.622063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e4bd7-05e2-44c8-8a62-e8abf50a3a0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:16:25.623645 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e4bd7-05e2-44c8-8a62-e8abf50a3a0f service swift] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:16:25.631505 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1340/2644] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:16:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:16:35.569930 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=12 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:35.628492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=35 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:42.106600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9824b2-8a1c-457e-9033-3964530edd44 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:42.110033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9824b2-8a1c-457e-9033-3964530edd44 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:42.110033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9824b2-8a1c-457e-9033-3964530edd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:42.127772 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-be9824b2-8a1c-457e-9033-3964530edd44 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:16:42.129002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-be9824b2-8a1c-457e-9033-3964530edd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:16:42.143576 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1305/2645] 10.222.0.77 () {58 vars in 967 bytes} [Wed Sep 14 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:16:42.156616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e4bd7-05e2-44c8-8a62-e8abf50a3a0f service swift] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:16:42.167994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e4bd7-05e2-44c8-8a62-e8abf50a3a0f service swift] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:16:42.173122 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33726085-2312-4d3d-a1e0-0d6bd88c6b15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:16:42.173725 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726085-2312-4d3d-a1e0-0d6bd88c6b15 service swift] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:16:42.174010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726085-2312-4d3d-a1e0-0d6bd88c6b15 service swift] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:16:42.174340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726085-2312-4d3d-a1e0-0d6bd88c6b15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:16:42.182643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33726085-2312-4d3d-a1e0-0d6bd88c6b15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:16:42.184201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33726085-2312-4d3d-a1e0-0d6bd88c6b15 service swift] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:16:42.192409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1341/2646] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:16:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:16:52.137887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=6 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:16:52.188872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=6 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:20.577813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9824b2-8a1c-457e-9033-3964530edd44 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:17:20.577813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-be9824b2-8a1c-457e-9033-3964530edd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:17:20.712997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9824b2-8a1c-457e-9033-3964530edd44 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:17:20.718916 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b524c7-8c0d-4a40-9d5a-dbc588dbd017 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:17:20.719539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b524c7-8c0d-4a40-9d5a-dbc588dbd017 service placement] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:17:20.719815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b524c7-8c0d-4a40-9d5a-dbc588dbd017 service placement] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:17:20.720082 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b524c7-8c0d-4a40-9d5a-dbc588dbd017 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:17:20.722319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c1b524c7-8c0d-4a40-9d5a-dbc588dbd017 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:17:20.735595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b524c7-8c0d-4a40-9d5a-dbc588dbd017 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:17:20.737192 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b524c7-8c0d-4a40-9d5a-dbc588dbd017 service placement] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:17:20.748737 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1306/2647] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:17:30.155211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f97b9-8029-4689-8668-ecc93be95ad2 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:17:30.159635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f97b9-8029-4689-8668-ecc93be95ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:17:30.159635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f97b9-8029-4689-8668-ecc93be95ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:17:30.175641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-a55f97b9-8029-4689-8668-ecc93be95ad2 None None] MFA Rules not processed for user `0e84875da0ff4917bd9a640e3b425244`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:17:30.177136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a55f97b9-8029-4689-8668-ecc93be95ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:17:30.233092 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1342/2648] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:17:30.743731 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=41 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:39.395691 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b524c7-8c0d-4a40-9d5a-dbc588dbd017 service placement] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:17:39.399855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b524c7-8c0d-4a40-9d5a-dbc588dbd017 service placement] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:17:39.405481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d23f1d-f6b8-4390-bc7c-2c6dfaff98ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:17:39.406755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d23f1d-f6b8-4390-bc7c-2c6dfaff98ec service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:17:39.407208 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d23f1d-f6b8-4390-bc7c-2c6dfaff98ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:17:39.407656 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d23f1d-f6b8-4390-bc7c-2c6dfaff98ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:17:39.409684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-45d23f1d-f6b8-4390-bc7c-2c6dfaff98ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:17:39.428640 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d23f1d-f6b8-4390-bc7c-2c6dfaff98ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:17:39.431147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d23f1d-f6b8-4390-bc7c-2c6dfaff98ec service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:17:39.444955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1307/2649] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:17:40.226922 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=25 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:42.077926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c15e2-0011-4fd4-a134-cd971c789a59 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:17:42.077926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c15e2-0011-4fd4-a134-cd971c789a59 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:17:42.077926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c15e2-0011-4fd4-a134-cd971c789a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:17:42.101337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9b6c15e2-0011-4fd4-a134-cd971c789a59 None None] MFA Rules not processed for user `b05286dc8d75459b87db5f0cf81ba099`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:17:42.116108 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9b6c15e2-0011-4fd4-a134-cd971c789a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:17:42.124833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1343/2650] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:17:45.381541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d23f1d-f6b8-4390-bc7c-2c6dfaff98ec service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:17:45.392597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d23f1d-f6b8-4390-bc7c-2c6dfaff98ec service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:17:45.397770 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddea5c-6c02-4429-886b-9b2f78f4b7cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:17:45.398411 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddea5c-6c02-4429-886b-9b2f78f4b7cb service placement] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:17:45.398721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddea5c-6c02-4429-886b-9b2f78f4b7cb service placement] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:17:45.398998 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddea5c-6c02-4429-886b-9b2f78f4b7cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:17:45.400705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-81ddea5c-6c02-4429-886b-9b2f78f4b7cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:17:45.412483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddea5c-6c02-4429-886b-9b2f78f4b7cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:17:45.420147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddea5c-6c02-4429-886b-9b2f78f4b7cb service placement] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:17:45.427601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1308/2651] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:17:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:17:45.678238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c15e2-0011-4fd4-a134-cd971c789a59 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:17:45.678238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9b6c15e2-0011-4fd4-a134-cd971c789a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:17:45.678238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c15e2-0011-4fd4-a134-cd971c789a59 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:17:45.680208 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:17:45.680208 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:17:45.680208 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:17:45.680208 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] PATH_INFO: `/v3/users/a800d16e85b044288be508715d1ad977` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:17:45.680581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a800d16e85b044288be508715d1ad977)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:17:45.680581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:17:45.957164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a800d16e85b044288be508715d1ad977'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:45.957900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a800d16e85b044288be508715d1ad977'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:45.966673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a800d16e85b044288be508715d1ad977'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:45.981075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a800d16e85b044288be508715d1ad977'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:45.981844 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a800d16e85b044288be508715d1ad977'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:46.075042 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1344/2652] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:17:45 2022] DELETE /identity/v3/users/a800d16e85b044288be508715d1ad977 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:17:46.314188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddea5c-6c02-4429-886b-9b2f78f4b7cb service placement] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:17:46.338741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddea5c-6c02-4429-886b-9b2f78f4b7cb service placement] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:17:46.399325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:17:46.400038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:17:46.400415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:17:46.400752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] PATH_INFO: `/v3/projects/b7c6a0bbf9a34f99a037533e5f6965de` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:17:46.402009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c6a0bbf9a34f99a037533e5f6965de)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:17:46.404214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:17:46.564974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c6a0bbf9a34f99a037533e5f6965de', 'request_id': 'req-00b979f7-bc18-4906-a317-3ded897d5d9f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:46.571752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c6a0bbf9a34f99a037533e5f6965de', 'request_id': 'req-00b979f7-bc18-4906-a317-3ded897d5d9f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:46.577553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c6a0bbf9a34f99a037533e5f6965de', 'request_id': 'req-00b979f7-bc18-4906-a317-3ded897d5d9f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:46.668448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] The token cache is being invalidate because project b7c6a0bbf9a34f99a037533e5f6965de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:17:46.671397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:46.671397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:46.671397 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1309/2653] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:17:46 2022] DELETE /identity/v3/projects/b7c6a0bbf9a34f99a037533e5f6965de => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:17:46.675428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:17:46.676992 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:17:46.691172 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95bb9e-bfba-4626-8715-44a4069b32ca admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:17:46.757395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:17:46.758904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:17:46.759462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:17:46.763267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] PATH_INFO: `/v3/users/643e09ef646f42188fd834c84b194a6f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:17:46.763267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=643e09ef646f42188fd834c84b194a6f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:17:46.767210 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:17:47.008442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '643e09ef646f42188fd834c84b194a6f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:47.009267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '643e09ef646f42188fd834c84b194a6f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:47.016382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '643e09ef646f42188fd834c84b194a6f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:47.024512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:47.029198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '643e09ef646f42188fd834c84b194a6f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:47.030113 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '643e09ef646f42188fd834c84b194a6f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:47.162381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1345/2654] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:17:46 2022] DELETE /identity/v3/users/643e09ef646f42188fd834c84b194a6f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:17:47.442518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:17:47.444059 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:17:47.465456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b979f7-bc18-4906-a317-3ded897d5d9f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:17:47.532995 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:17:47.533739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:17:47.534021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:17:47.534327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] PATH_INFO: `/v3/projects/7eae6e25db1c4a66850943866d3abbf2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:17:47.535505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eae6e25db1c4a66850943866d3abbf2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:17:47.537398 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:17:47.544627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:47.651533 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eae6e25db1c4a66850943866d3abbf2', 'request_id': 'req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:47.658136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eae6e25db1c4a66850943866d3abbf2', 'request_id': 'req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:47.663855 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eae6e25db1c4a66850943866d3abbf2', 'request_id': 'req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:47.742607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] The token cache is being invalidate because project 7eae6e25db1c4a66850943866d3abbf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:17:47.742899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:47.743534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:17:47.745029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1310/2655] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:17:47 2022] DELETE /identity/v3/projects/7eae6e25db1c4a66850943866d3abbf2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:17:57.274466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=4,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:17:57.891894 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:35.592845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:18:35.594525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:18:35.652780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb14b2e-0ce7-44bc-a684-39d6b8b36ec5 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:18:35.703496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e108ae-9b1c-455b-b31f-dfb08197e2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:18:35.704129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e108ae-9b1c-455b-b31f-dfb08197e2ca service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:18:35.704412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e108ae-9b1c-455b-b31f-dfb08197e2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:18:35.704688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e108ae-9b1c-455b-b31f-dfb08197e2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:18:35.707409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-45e108ae-9b1c-455b-b31f-dfb08197e2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:18:35.795810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e108ae-9b1c-455b-b31f-dfb08197e2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:18:35.797780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e108ae-9b1c-455b-b31f-dfb08197e2ca service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:18:35.821524 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1346/2656] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:18:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:18:37.003087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:18:37.004616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:18:37.017815 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80fd01-2e1e-4470-bb92-dd7c3afab04b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:18:37.022135 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031f5fd-625e-4037-b0e3-b7cb7a7d1ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:18:37.022764 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031f5fd-625e-4037-b0e3-b7cb7a7d1ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:18:37.023041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031f5fd-625e-4037-b0e3-b7cb7a7d1ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:18:37.023310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031f5fd-625e-4037-b0e3-b7cb7a7d1ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:18:37.025008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8031f5fd-625e-4037-b0e3-b7cb7a7d1ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:18:37.038285 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031f5fd-625e-4037-b0e3-b7cb7a7d1ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:18:37.216345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031f5fd-625e-4037-b0e3-b7cb7a7d1ea8 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:18:37.216345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1311/2657] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:18:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:18:45.818644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=83 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:47.045686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=6 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:47.081614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ed9f8-611b-400a-952c-61ba7c8360c2 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:18:47.082080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ed9f8-611b-400a-952c-61ba7c8360c2 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:18:47.082188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ed9f8-611b-400a-952c-61ba7c8360c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:18:47.101615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-554ed9f8-611b-400a-952c-61ba7c8360c2 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:18:47.105540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-554ed9f8-611b-400a-952c-61ba7c8360c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:18:47.159671 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1347/2658] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:18:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:18:47.323997 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031f5fd-625e-4037-b0e3-b7cb7a7d1ea8 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:18:47.325440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8031f5fd-625e-4037-b0e3-b7cb7a7d1ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:18:47.395387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031f5fd-625e-4037-b0e3-b7cb7a7d1ea8 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:18:47.402043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c91e8e-3493-4c0c-b479-38bbeee02efe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:18:47.402686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c91e8e-3493-4c0c-b479-38bbeee02efe service swift] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:18:47.402966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c91e8e-3493-4c0c-b479-38bbeee02efe service swift] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:18:47.403298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c91e8e-3493-4c0c-b479-38bbeee02efe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:18:47.411763 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c91e8e-3493-4c0c-b479-38bbeee02efe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:18:47.414738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c91e8e-3493-4c0c-b479-38bbeee02efe service swift] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:18:47.422449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1312/2659] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:18:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:18:57.152517 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=25 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:18:57.419110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=32 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:00.691502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4efd-084c-45c2-a898-71cd242e3566 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:19:00.693386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4efd-084c-45c2-a898-71cd242e3566 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:19:00.693386 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4efd-084c-45c2-a898-71cd242e3566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:19:00.712360 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-1e1e4efd-084c-45c2-a898-71cd242e3566 None None] MFA Rules not processed for user `b05286dc8d75459b87db5f0cf81ba099`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:19:00.713584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-1e1e4efd-084c-45c2-a898-71cd242e3566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:19:00.768910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1348/2660] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:19:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:19:06.910241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c91e8e-3493-4c0c-b479-38bbeee02efe service swift] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:19:06.911799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-68c91e8e-3493-4c0c-b479-38bbeee02efe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:19:06.935413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c91e8e-3493-4c0c-b479-38bbeee02efe service swift] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:19:06.946204 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb1d2e-e3f9-4e73-bb1d-00e67b6f0e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:19:06.947577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb1d2e-e3f9-4e73-bb1d-00e67b6f0e51 service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:19:06.948516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb1d2e-e3f9-4e73-bb1d-00e67b6f0e51 service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:19:06.949475 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb1d2e-e3f9-4e73-bb1d-00e67b6f0e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:19:06.952167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5cdb1d2e-e3f9-4e73-bb1d-00e67b6f0e51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:19:06.968349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb1d2e-e3f9-4e73-bb1d-00e67b6f0e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:19:06.969922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb1d2e-e3f9-4e73-bb1d-00e67b6f0e51 service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:19:06.981849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1313/2661] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:19:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:19:07.071224 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4efd-084c-45c2-a898-71cd242e3566 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:19:07.080721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4efd-084c-45c2-a898-71cd242e3566 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:19:07.084297 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186220-e81e-444e-9891-ad747b1507f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:19:07.084893 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186220-e81e-444e-9891-ad747b1507f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:19:07.085168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186220-e81e-444e-9891-ad747b1507f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:19:07.085604 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186220-e81e-444e-9891-ad747b1507f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:19:07.087126 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ac186220-e81e-444e-9891-ad747b1507f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:19:07.096408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac186220-e81e-444e-9891-ad747b1507f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:19:07.098399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac186220-e81e-444e-9891-ad747b1507f2 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:19:07.106325 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1349/2662] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:19:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:19:10.178183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5eef7-6d2a-4cbc-baf2-35bfeae77e88 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:19:10.178784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5eef7-6d2a-4cbc-baf2-35bfeae77e88 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:19:10.178784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5eef7-6d2a-4cbc-baf2-35bfeae77e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:19:10.235361 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-17f5eef7-6d2a-4cbc-baf2-35bfeae77e88 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:19:10.236636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-17f5eef7-6d2a-4cbc-baf2-35bfeae77e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:19:10.256374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1314/2663] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:19:10.268742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186220-e81e-444e-9891-ad747b1507f2 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:19:10.291947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186220-e81e-444e-9891-ad747b1507f2 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:19:10.297165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaf25c-bc8c-4960-a946-1371cdbb47af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:19:10.298088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaf25c-bc8c-4960-a946-1371cdbb47af service swift] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:19:10.298404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaf25c-bc8c-4960-a946-1371cdbb47af service swift] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:19:10.298679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaf25c-bc8c-4960-a946-1371cdbb47af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:19:10.308723 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaf25c-bc8c-4960-a946-1371cdbb47af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:19:10.310509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaf25c-bc8c-4960-a946-1371cdbb47af service swift] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:19:10.319436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1350/2664] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:19:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:19:20.252884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=24 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:20.315943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=41 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:24.475375 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5eef7-6d2a-4cbc-baf2-35bfeae77e88 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:19:24.488670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5eef7-6d2a-4cbc-baf2-35bfeae77e88 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:19:24.494312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb97ea-137a-40cc-a390-1a8ea5ba7f8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:19:24.494943 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb97ea-137a-40cc-a390-1a8ea5ba7f8e service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:19:24.495253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb97ea-137a-40cc-a390-1a8ea5ba7f8e service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:19:24.495552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb97ea-137a-40cc-a390-1a8ea5ba7f8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:19:24.497265 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-74bb97ea-137a-40cc-a390-1a8ea5ba7f8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:19:24.510565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb97ea-137a-40cc-a390-1a8ea5ba7f8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:19:24.512060 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb97ea-137a-40cc-a390-1a8ea5ba7f8e service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:19:24.523552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1315/2665] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:19:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:19:27.285584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daf4f4-616a-4429-82b4-bc96e14f944d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:19:27.286041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daf4f4-616a-4429-82b4-bc96e14f944d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:19:27.286141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daf4f4-616a-4429-82b4-bc96e14f944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:19:27.306488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-44daf4f4-616a-4429-82b4-bc96e14f944d None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:19:27.307704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-44daf4f4-616a-4429-82b4-bc96e14f944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:19:27.318341 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1351/2666] 10.222.0.77 () {58 vars in 967 bytes} [Wed Sep 14 12:19:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:19:27.330628 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb97ea-137a-40cc-a390-1a8ea5ba7f8e service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:19:27.341978 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb97ea-137a-40cc-a390-1a8ea5ba7f8e service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:19:27.347650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447894f1-5d2d-4003-82e3-1ac63a9146e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:19:27.348253 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447894f1-5d2d-4003-82e3-1ac63a9146e0 service swift] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:19:27.348526 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447894f1-5d2d-4003-82e3-1ac63a9146e0 service swift] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:19:27.348793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447894f1-5d2d-4003-82e3-1ac63a9146e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:19:27.356733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447894f1-5d2d-4003-82e3-1ac63a9146e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:19:27.358322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447894f1-5d2d-4003-82e3-1ac63a9146e0 service swift] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:19:27.366802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1316/2667] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:19:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:19:37.301197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:19:37.363612 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=12 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:03.777986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daf4f4-616a-4429-82b4-bc96e14f944d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:03.779469 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-44daf4f4-616a-4429-82b4-bc96e14f944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:03.857710 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daf4f4-616a-4429-82b4-bc96e14f944d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:03.861944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9ce5c-5f67-4ca0-b026-40a2008c671a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:03.862582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9ce5c-5f67-4ca0-b026-40a2008c671a service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:03.862861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9ce5c-5f67-4ca0-b026-40a2008c671a service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:03.863138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9ce5c-5f67-4ca0-b026-40a2008c671a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:03.864875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-42a9ce5c-5f67-4ca0-b026-40a2008c671a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:03.875640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9ce5c-5f67-4ca0-b026-40a2008c671a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:03.877661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9ce5c-5f67-4ca0-b026-40a2008c671a service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:03.886792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1352/2668] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:07.866130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447894f1-5d2d-4003-82e3-1ac63a9146e0 service swift] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:07.877077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447894f1-5d2d-4003-82e3-1ac63a9146e0 service swift] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:07.881750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd561a-5f91-429a-b360-f91bd6b9fc3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:07.882469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd561a-5f91-429a-b360-f91bd6b9fc3a service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:07.882750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd561a-5f91-429a-b360-f91bd6b9fc3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:07.883437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd561a-5f91-429a-b360-f91bd6b9fc3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:07.885762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1ffd561a-5f91-429a-b360-f91bd6b9fc3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:07.948718 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd561a-5f91-429a-b360-f91bd6b9fc3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:07.950244 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd561a-5f91-429a-b360-f91bd6b9fc3a service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:07.960263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1317/2669] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:13.882511 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=35 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:17.955262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=28 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:19.149876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9ce5c-5f67-4ca0-b026-40a2008c671a service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:19.159666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9ce5c-5f67-4ca0-b026-40a2008c671a service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:19.163270 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58657c18-f7d8-4806-b56b-696e974f0a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:19.163869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58657c18-f7d8-4806-b56b-696e974f0a28 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:19.166977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58657c18-f7d8-4806-b56b-696e974f0a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:19.166977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58657c18-f7d8-4806-b56b-696e974f0a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:19.166977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-58657c18-f7d8-4806-b56b-696e974f0a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:19.229483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58657c18-f7d8-4806-b56b-696e974f0a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:19.230935 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58657c18-f7d8-4806-b56b-696e974f0a28 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:19.241167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1353/2670] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:20.070035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd561a-5f91-429a-b360-f91bd6b9fc3a service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:20.071933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1ffd561a-5f91-429a-b360-f91bd6b9fc3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:20.087370 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd561a-5f91-429a-b360-f91bd6b9fc3a service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:20.091959 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee126da-060d-450b-a44b-b886a273f6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:20.092689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee126da-060d-450b-a44b-b886a273f6fb service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:20.093016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee126da-060d-450b-a44b-b886a273f6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:20.093525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee126da-060d-450b-a44b-b886a273f6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:20.095550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-fee126da-060d-450b-a44b-b886a273f6fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:20.108990 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee126da-060d-450b-a44b-b886a273f6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:20.111165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee126da-060d-450b-a44b-b886a273f6fb service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:20.120840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1318/2671] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:23.459904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58657c18-f7d8-4806-b56b-696e974f0a28 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:23.461374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-58657c18-f7d8-4806-b56b-696e974f0a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:23.473807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58657c18-f7d8-4806-b56b-696e974f0a28 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:23.478501 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:23.479154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:23.479439 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:23.479717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] PATH_INFO: `/v3/users/0e84875da0ff4917bd9a640e3b425244` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:23.480871 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e84875da0ff4917bd9a640e3b425244)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:23.482853 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:23.724355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e84875da0ff4917bd9a640e3b425244'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:23.725073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e84875da0ff4917bd9a640e3b425244'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:23.734197 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e84875da0ff4917bd9a640e3b425244'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:23.748087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e84875da0ff4917bd9a640e3b425244'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:23.748890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e84875da0ff4917bd9a640e3b425244'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:23.857286 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1354/2672] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:23 2022] DELETE /identity/v3/users/0e84875da0ff4917bd9a640e3b425244 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:24.215876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee126da-060d-450b-a44b-b886a273f6fb service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:24.215876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-fee126da-060d-450b-a44b-b886a273f6fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:24.242694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:24.246921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:24.299031 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee126da-060d-450b-a44b-b886a273f6fb service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:24.323106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65bf7d-c25f-4f1b-9687-5f6296edacf9 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:24.327656 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:24.332941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:24.332941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:24.332941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] PATH_INFO: `/v3/projects/d1b879e4d8784a80a4e432b7b7cc3179` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:24.332941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b879e4d8784a80a4e432b7b7cc3179)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:24.332941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:24.340648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:24.367774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec22a43-d051-4b38-872f-25a0245750c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:24.367774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec22a43-d051-4b38-872f-25a0245750c3 service placement] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:24.367774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec22a43-d051-4b38-872f-25a0245750c3 service placement] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:24.367774 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec22a43-d051-4b38-872f-25a0245750c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:24.368136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1ec22a43-d051-4b38-872f-25a0245750c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:24.379721 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec22a43-d051-4b38-872f-25a0245750c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:24.381440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec22a43-d051-4b38-872f-25a0245750c3 service placement] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:24.392931 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1319/2673] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:24.393754 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec22a43-d051-4b38-872f-25a0245750c3 service placement] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:24.395112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1ec22a43-d051-4b38-872f-25a0245750c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:24.408171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec22a43-d051-4b38-872f-25a0245750c3 service placement] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:24.412897 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:24.413524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:24.413803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:24.414076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] PATH_INFO: `/v3/users/b05286dc8d75459b87db5f0cf81ba099` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:24.415250 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05286dc8d75459b87db5f0cf81ba099)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:24.417288 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:24.482622 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b879e4d8784a80a4e432b7b7cc3179', 'request_id': 'req-796912ff-795b-4cf9-887f-aff28ef4d7eb'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:24.615025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b879e4d8784a80a4e432b7b7cc3179', 'request_id': 'req-796912ff-795b-4cf9-887f-aff28ef4d7eb'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:24.623887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b879e4d8784a80a4e432b7b7cc3179', 'request_id': 'req-796912ff-795b-4cf9-887f-aff28ef4d7eb'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:24.635301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] The token cache is being invalidate because project d1b879e4d8784a80a4e432b7b7cc3179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:24.635591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:24.636254 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-796912ff-795b-4cf9-887f-aff28ef4d7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:24.637755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1355/2674] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:24 2022] DELETE /identity/v3/projects/d1b879e4d8784a80a4e432b7b7cc3179 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:24.643354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20754a7-3044-4591-9857-38fe6b8d8ed3 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:24.645152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20754a7-3044-4591-9857-38fe6b8d8ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:24.645152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20754a7-3044-4591-9857-38fe6b8d8ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:24.667152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c20754a7-3044-4591-9857-38fe6b8d8ed3 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:24.668484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c20754a7-3044-4591-9857-38fe6b8d8ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:24.716794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05286dc8d75459b87db5f0cf81ba099'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:24.725367 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05286dc8d75459b87db5f0cf81ba099'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:24.737249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1356/2675] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:24.741167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05286dc8d75459b87db5f0cf81ba099'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:24.743464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:24.745433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c1be-2e2f-463d-8b63-3a314712f7a0 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:24.745901 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c1be-2e2f-463d-8b63-3a314712f7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:24.746380 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c1be-2e2f-463d-8b63-3a314712f7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:24.767573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d7f8c1be-2e2f-463d-8b63-3a314712f7a0 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:24.768850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d7f8c1be-2e2f-463d-8b63-3a314712f7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:24.776816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1357/2676] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:24.781040 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8c1be-2e2f-463d-8b63-3a314712f7a0 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:24.791001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8c1be-2e2f-463d-8b63-3a314712f7a0 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:24.795793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22579d1b-b720-4255-a13c-3e8d44ebca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:24.800850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22579d1b-b720-4255-a13c-3e8d44ebca38 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:24.800850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22579d1b-b720-4255-a13c-3e8d44ebca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:24.800850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22579d1b-b720-4255-a13c-3e8d44ebca38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:24.800850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22579d1b-b720-4255-a13c-3e8d44ebca38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:20:24.800850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22579d1b-b720-4255-a13c-3e8d44ebca38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:24.800850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22579d1b-b720-4255-a13c-3e8d44ebca38 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:24.811644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1358/2677] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:20:24.816207 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22579d1b-b720-4255-a13c-3e8d44ebca38 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:24.824977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05286dc8d75459b87db5f0cf81ba099'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:24.825594 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05286dc8d75459b87db5f0cf81ba099'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:24.826312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22579d1b-b720-4255-a13c-3e8d44ebca38 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:24.831925 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c02f5a-2ca2-4298-940a-f547a13fc46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:24.835200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c02f5a-2ca2-4298-940a-f547a13fc46f admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:24.835200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c02f5a-2ca2-4298-940a-f547a13fc46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:24.835200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c02f5a-2ca2-4298-940a-f547a13fc46f admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:24.835200 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c02f5a-2ca2-4298-940a-f547a13fc46f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:24.835665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1320/2678] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:24 2022] DELETE /identity/v3/users/b05286dc8d75459b87db5f0cf81ba099 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:24.835850 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c02f5a-2ca2-4298-940a-f547a13fc46f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:24.959259 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1359/2679] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:24 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:24.963533 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:24.964970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:25.031398 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a07db2-b67f-42da-af3b-39b619b5b24c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.088438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb817f-fccf-41c0-9639-45a153fd1aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.088808 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb817f-fccf-41c0-9639-45a153fd1aea admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.089043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb817f-fccf-41c0-9639-45a153fd1aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.089314 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb817f-fccf-41c0-9639-45a153fd1aea admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.089521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c02f5a-2ca2-4298-940a-f547a13fc46f admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.089962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb817f-fccf-41c0-9639-45a153fd1aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.091946 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb817f-fccf-41c0-9639-45a153fd1aea admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.092502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-92c02f5a-2ca2-4298-940a-f547a13fc46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:25.113574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c02f5a-2ca2-4298-940a-f547a13fc46f admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.118977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.119666 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.120005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.120177 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] PATH_INFO: `/v3/projects/d665f88e1e7f487dbf069db7112df933` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.121525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d665f88e1e7f487dbf069db7112df933)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.123362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.198006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1321/2680] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:24 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:25.202321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb817f-fccf-41c0-9639-45a153fd1aea admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.213408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb817f-fccf-41c0-9639-45a153fd1aea admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.218200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89745b-2f40-4e8b-acbf-310b6c9bfe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.218827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89745b-2f40-4e8b-acbf-310b6c9bfe43 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.219067 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89745b-2f40-4e8b-acbf-310b6c9bfe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.219335 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89745b-2f40-4e8b-acbf-310b6c9bfe43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.220016 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89745b-2f40-4e8b-acbf-310b6c9bfe43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.221626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89745b-2f40-4e8b-acbf-310b6c9bfe43 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.234473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1322/2681] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:20:25.235615 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89745b-2f40-4e8b-acbf-310b6c9bfe43 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.238921 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd665f88e1e7f487dbf069db7112df933', 'request_id': 'req-1266d8a8-0c4b-4128-990a-648b7d2b3afc'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:25.240879 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:25.245992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89745b-2f40-4e8b-acbf-310b6c9bfe43 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.304217 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04501825-dc8f-4164-8de6-e809c29fe0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.304738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04501825-dc8f-4164-8de6-e809c29fe0de admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.305013 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04501825-dc8f-4164-8de6-e809c29fe0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.305280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04501825-dc8f-4164-8de6-e809c29fe0de admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.305910 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04501825-dc8f-4164-8de6-e809c29fe0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.307518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04501825-dc8f-4164-8de6-e809c29fe0de admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.311624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd665f88e1e7f487dbf069db7112df933', 'request_id': 'req-1266d8a8-0c4b-4128-990a-648b7d2b3afc'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:25.318101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1323/2682] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:20:25.321820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd665f88e1e7f487dbf069db7112df933', 'request_id': 'req-1266d8a8-0c4b-4128-990a-648b7d2b3afc'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:25.322629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04501825-dc8f-4164-8de6-e809c29fe0de admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.330771 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] The token cache is being invalidate because project d665f88e1e7f487dbf069db7112df933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:25.331065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:25.331754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-1266d8a8-0c4b-4128-990a-648b7d2b3afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:25.333244 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1360/2683] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:25 2022] DELETE /identity/v3/projects/d665f88e1e7f487dbf069db7112df933 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:25.333405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04501825-dc8f-4164-8de6-e809c29fe0de admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.337983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc2e1f-5d5c-4d11-adfd-d5a353579f51 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.338598 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc2e1f-5d5c-4d11-adfd-d5a353579f51 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.338876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc2e1f-5d5c-4d11-adfd-d5a353579f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.339900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9324-6ea3-4bf0-8dae-6ec69289656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.340547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9324-6ea3-4bf0-8dae-6ec69289656f admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.340832 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9324-6ea3-4bf0-8dae-6ec69289656f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.341144 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9324-6ea3-4bf0-8dae-6ec69289656f admin admin] PATH_INFO: `/v3/projects/5aea1b26b30d4043b035f7a2cfda6fa9/users/23551447474740f1853360767d56b33b/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.354231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:25.358233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b9324-6ea3-4bf0-8dae-6ec69289656f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aea1b26b30d4043b035f7a2cfda6fa9, user_id=23551447474740f1853360767d56b33b, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.359582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-edfc2e1f-5d5c-4d11-adfd-d5a353579f51 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:25.361167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b9324-6ea3-4bf0-8dae-6ec69289656f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.361350 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-edfc2e1f-5d5c-4d11-adfd-d5a353579f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:25.369776 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1361/2684] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:25.378595 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80377c2-e14f-4616-9ca0-16c518d7e2d7 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.380706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80377c2-e14f-4616-9ca0-16c518d7e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.380706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80377c2-e14f-4616-9ca0-16c518d7e2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.399819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-d80377c2-e14f-4616-9ca0-16c518d7e2d7 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:25.401089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-d80377c2-e14f-4616-9ca0-16c518d7e2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:25.409592 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1362/2685] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:25.413636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80377c2-e14f-4616-9ca0-16c518d7e2d7 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.422462 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80377c2-e14f-4616-9ca0-16c518d7e2d7 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.427404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850e5aa-2c10-4f95-82c8-9c8603929fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.427985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850e5aa-2c10-4f95-82c8-9c8603929fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.428266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850e5aa-2c10-4f95-82c8-9c8603929fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.428539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850e5aa-2c10-4f95-82c8-9c8603929fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.429204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850e5aa-2c10-4f95-82c8-9c8603929fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:20:25.429510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850e5aa-2c10-4f95-82c8-9c8603929fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.431125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850e5aa-2c10-4f95-82c8-9c8603929fb4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.443348 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1363/2686] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:20:25.447603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850e5aa-2c10-4f95-82c8-9c8603929fb4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.455196 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1324/2687] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:25 2022] PUT /identity/v3/projects/5aea1b26b30d4043b035f7a2cfda6fa9/users/23551447474740f1853360767d56b33b/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:25.458063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850e5aa-2c10-4f95-82c8-9c8603929fb4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.467326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af141cd2-4961-4eca-9c3d-0bf02bd5ba39 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.467694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af141cd2-4961-4eca-9c3d-0bf02bd5ba39 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.467966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af141cd2-4961-4eca-9c3d-0bf02bd5ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.496486 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-af141cd2-4961-4eca-9c3d-0bf02bd5ba39 None None] MFA Rules not processed for user `23551447474740f1853360767d56b33b`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:25.497719 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-af141cd2-4961-4eca-9c3d-0bf02bd5ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:25.515180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e5534-6ae5-444b-9f1d-094de95f87b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.515790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e5534-6ae5-444b-9f1d-094de95f87b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.516076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e5534-6ae5-444b-9f1d-094de95f87b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.516353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e5534-6ae5-444b-9f1d-094de95f87b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.518235 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e5534-6ae5-444b-9f1d-094de95f87b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.520168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e5534-6ae5-444b-9f1d-094de95f87b6 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.562388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1325/2688] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:25.567019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af141cd2-4961-4eca-9c3d-0bf02bd5ba39 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.569156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-af141cd2-4961-4eca-9c3d-0bf02bd5ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:25.583406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af141cd2-4961-4eca-9c3d-0bf02bd5ba39 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.587986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a78467-2ce5-4599-a702-0735497aa8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.588575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a78467-2ce5-4599-a702-0735497aa8cc admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.588862 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a78467-2ce5-4599-a702-0735497aa8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.589198 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a78467-2ce5-4599-a702-0735497aa8cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.589870 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a78467-2ce5-4599-a702-0735497aa8cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.591805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a78467-2ce5-4599-a702-0735497aa8cc admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.609653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1364/2689] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:25 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:20:25.614129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e5534-6ae5-444b-9f1d-094de95f87b6 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.677340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e5534-6ae5-444b-9f1d-094de95f87b6 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.682028 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82bb55-00ec-4d95-b3e6-7836582b24cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.682667 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82bb55-00ec-4d95-b3e6-7836582b24cf admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.682949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82bb55-00ec-4d95-b3e6-7836582b24cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.683226 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82bb55-00ec-4d95-b3e6-7836582b24cf admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.686552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1326/2690] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:25 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:25.686701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82bb55-00ec-4d95-b3e6-7836582b24cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.686701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82bb55-00ec-4d95-b3e6-7836582b24cf admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.687494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a78467-2ce5-4599-a702-0735497aa8cc admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.758641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a78467-2ce5-4599-a702-0735497aa8cc admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.763381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583fe80-66cd-4b19-90b6-4c58c674b336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.763988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583fe80-66cd-4b19-90b6-4c58c674b336 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.764287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583fe80-66cd-4b19-90b6-4c58c674b336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.764550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583fe80-66cd-4b19-90b6-4c58c674b336 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.765186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583fe80-66cd-4b19-90b6-4c58c674b336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.767742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583fe80-66cd-4b19-90b6-4c58c674b336 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.780182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1365/2691] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:25 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:20:25.784320 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82bb55-00ec-4d95-b3e6-7836582b24cf admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.794499 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82bb55-00ec-4d95-b3e6-7836582b24cf admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.799643 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcbed6-635b-476c-8e1a-081a9b934012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.800237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcbed6-635b-476c-8e1a-081a9b934012 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.800548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcbed6-635b-476c-8e1a-081a9b934012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.800827 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcbed6-635b-476c-8e1a-081a9b934012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.801470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcbed6-635b-476c-8e1a-081a9b934012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.803117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcbed6-635b-476c-8e1a-081a9b934012 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.813097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1366/2692] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:25.817770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcbed6-635b-476c-8e1a-081a9b934012 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.827148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcbed6-635b-476c-8e1a-081a9b934012 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.832624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d8a75-8a24-405b-a8f4-1d6f6c810343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.835843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d8a75-8a24-405b-a8f4-1d6f6c810343 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.835843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d8a75-8a24-405b-a8f4-1d6f6c810343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.835843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d8a75-8a24-405b-a8f4-1d6f6c810343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.835843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d8a75-8a24-405b-a8f4-1d6f6c810343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.836198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d8a75-8a24-405b-a8f4-1d6f6c810343 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.846337 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1367/2693] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:25.850326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d8a75-8a24-405b-a8f4-1d6f6c810343 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.856312 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:25.861589 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d8a75-8a24-405b-a8f4-1d6f6c810343 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.864911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1327/2694] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:25 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:20:25.865677 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b5a90-392e-4e55-8b39-5f8b8c58a2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.867354 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583fe80-66cd-4b19-90b6-4c58c674b336 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.867920 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b5a90-392e-4e55-8b39-5f8b8c58a2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.868281 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b5a90-392e-4e55-8b39-5f8b8c58a2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.868640 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b5a90-392e-4e55-8b39-5f8b8c58a2d7 admin admin] PATH_INFO: `/v3/projects/c7acf7717edf42b1877e4d5dc6ef1fac/users/16ef8c5282f14db9a4241c10062b0698/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.878369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583fe80-66cd-4b19-90b6-4c58c674b336 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.883435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529c21-e26f-49f4-b6f0-9b9df209055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.884452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b5a90-392e-4e55-8b39-5f8b8c58a2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7acf7717edf42b1877e4d5dc6ef1fac, user_id=16ef8c5282f14db9a4241c10062b0698, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.887886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529c21-e26f-49f4-b6f0-9b9df209055a admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.887886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529c21-e26f-49f4-b6f0-9b9df209055a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.887886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529c21-e26f-49f4-b6f0-9b9df209055a admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.887886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66529c21-e26f-49f4-b6f0-9b9df209055a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.888289 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b5a90-392e-4e55-8b39-5f8b8c58a2d7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.888391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66529c21-e26f-49f4-b6f0-9b9df209055a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.899168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1328/2695] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:25.903240 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529c21-e26f-49f4-b6f0-9b9df209055a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:25.912977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529c21-e26f-49f4-b6f0-9b9df209055a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:25.917591 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269a33e-280c-4d90-baee-9c6fec1c126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:25.918230 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269a33e-280c-4d90-baee-9c6fec1c126e admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:25.918525 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269a33e-280c-4d90-baee-9c6fec1c126e admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:25.918799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269a33e-280c-4d90-baee-9c6fec1c126e admin admin] PATH_INFO: `/v3/projects/2813c3a016e249819ce976ed872d49ba/users/c26d34d80aa34e68962cb9934cf107b5/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:25.933356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269a33e-280c-4d90-baee-9c6fec1c126e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2813c3a016e249819ce976ed872d49ba, user_id=c26d34d80aa34e68962cb9934cf107b5, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:25.936027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269a33e-280c-4d90-baee-9c6fec1c126e admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:25.992570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1368/2696] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:25 2022] PUT /identity/v3/projects/c7acf7717edf42b1877e4d5dc6ef1fac/users/16ef8c5282f14db9a4241c10062b0698/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:26.003375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e63f3b-c563-42bb-898d-99c4b694315a None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:26.003777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e63f3b-c563-42bb-898d-99c4b694315a None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:26.004062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e63f3b-c563-42bb-898d-99c4b694315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:26.020620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1329/2697] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:25 2022] PUT /identity/v3/projects/2813c3a016e249819ce976ed872d49ba/users/c26d34d80aa34e68962cb9934cf107b5/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:26.022899 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269a33e-280c-4d90-baee-9c6fec1c126e admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:26.034482 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c1e63f3b-c563-42bb-898d-99c4b694315a None None] MFA Rules not processed for user `16ef8c5282f14db9a4241c10062b0698`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:26.035736 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c1e63f3b-c563-42bb-898d-99c4b694315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:26.035908 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:26.085582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269a33e-280c-4d90-baee-9c6fec1c126e admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:26.090149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceef18-c95e-4173-b497-b19175fe27aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:26.095004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceef18-c95e-4173-b497-b19175fe27aa admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:26.095004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceef18-c95e-4173-b497-b19175fe27aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:26.095004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceef18-c95e-4173-b497-b19175fe27aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:26.095004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceef18-c95e-4173-b497-b19175fe27aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:26.095004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceef18-c95e-4173-b497-b19175fe27aa admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:26.100568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1369/2698] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:26.106137 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1330/2699] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:26.109936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e63f3b-c563-42bb-898d-99c4b694315a None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:26.112905 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceef18-c95e-4173-b497-b19175fe27aa admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:26.114676 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-36ceef18-c95e-4173-b497-b19175fe27aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:26.121587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e63f3b-c563-42bb-898d-99c4b694315a None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:26.127693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f300c-36ce-4f9f-aab2-9137e9ead99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:26.129561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f300c-36ce-4f9f-aab2-9137e9ead99d admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:26.129561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f300c-36ce-4f9f-aab2-9137e9ead99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:26.129561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f300c-36ce-4f9f-aab2-9137e9ead99d admin admin] PATH_INFO: `/v3/projects/2813c3a016e249819ce976ed872d49ba/users/c26d34d80aa34e68962cb9934cf107b5/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:26.130820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f300c-36ce-4f9f-aab2-9137e9ead99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2813c3a016e249819ce976ed872d49ba, user_id=c26d34d80aa34e68962cb9934cf107b5, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:26.133473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f300c-36ce-4f9f-aab2-9137e9ead99d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:26.143889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1370/2700] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:26 2022] PUT /identity/v3/projects/2813c3a016e249819ce976ed872d49ba/users/c26d34d80aa34e68962cb9934cf107b5/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:26.154664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b90c-d91b-4f78-9190-3ca66fe2d543 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:26.154950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b90c-d91b-4f78-9190-3ca66fe2d543 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:26.155231 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b90c-d91b-4f78-9190-3ca66fe2d543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:26.184180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-7c66b90c-d91b-4f78-9190-3ca66fe2d543 None None] MFA Rules not processed for user `c26d34d80aa34e68962cb9934cf107b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:26.185398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7c66b90c-d91b-4f78-9190-3ca66fe2d543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:26.194969 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceef18-c95e-4173-b497-b19175fe27aa admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:26.256856 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1371/2701] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:26.260064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3669f5d-5e14-4a3e-a551-aa744affc06e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:26.260775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3669f5d-5e14-4a3e-a551-aa744affc06e service nova] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:26.261069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3669f5d-5e14-4a3e-a551-aa744affc06e service nova] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:26.261343 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3669f5d-5e14-4a3e-a551-aa744affc06e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:26.268377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66b90c-d91b-4f78-9190-3ca66fe2d543 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:26.269712 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7c66b90c-d91b-4f78-9190-3ca66fe2d543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:26.304739 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:26.316003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:26.319708 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3669f5d-5e14-4a3e-a551-aa744affc06e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:26.321311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3669f5d-5e14-4a3e-a551-aa744affc06e service nova] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:26.327663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66b90c-d91b-4f78-9190-3ca66fe2d543 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:26.330805 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1331/2702] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:20:26.331750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d1a51-87a0-4eb7-b0fb-9d18ff4d4305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:26.332593 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d1a51-87a0-4eb7-b0fb-9d18ff4d4305 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:26.332729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d1a51-87a0-4eb7-b0fb-9d18ff4d4305 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:26.332936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d1a51-87a0-4eb7-b0fb-9d18ff4d4305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:26.342280 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d1a51-87a0-4eb7-b0fb-9d18ff4d4305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:26.343694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d1a51-87a0-4eb7-b0fb-9d18ff4d4305 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:26.353479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1372/2703] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:26.503585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3669f5d-5e14-4a3e-a551-aa744affc06e service nova] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:26.513078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3669f5d-5e14-4a3e-a551-aa744affc06e service nova] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:26.516861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c54819-da1b-4302-85b6-a90f9012ba41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:26.517449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c54819-da1b-4302-85b6-a90f9012ba41 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:26.517727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c54819-da1b-4302-85b6-a90f9012ba41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:26.517996 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c54819-da1b-4302-85b6-a90f9012ba41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:26.575317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c54819-da1b-4302-85b6-a90f9012ba41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:26.576738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c54819-da1b-4302-85b6-a90f9012ba41 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:26.586139 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1332/2704] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:31.715644 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d1a51-87a0-4eb7-b0fb-9d18ff4d4305 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:31.783560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d1a51-87a0-4eb7-b0fb-9d18ff4d4305 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:31.788076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:31.791476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:31.791476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:31.791476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] PATH_INFO: `/v3/users/23551447474740f1853360767d56b33b` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:31.791476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23551447474740f1853360767d56b33b)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:31.792318 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:32.012530 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23551447474740f1853360767d56b33b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:32.013182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23551447474740f1853360767d56b33b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:32.023230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23551447474740f1853360767d56b33b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:32.037142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23551447474740f1853360767d56b33b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:32.037911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23551447474740f1853360767d56b33b'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:32.157233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1373/2705] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:31 2022] DELETE /identity/v3/users/23551447474740f1853360767d56b33b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:32.161773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52ced-20c9-43ec-8a3f-2a500e35401f None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:32.162247 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52ced-20c9-43ec-8a3f-2a500e35401f None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:32.162350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52ced-20c9-43ec-8a3f-2a500e35401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:32.182891 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-01f52ced-20c9-43ec-8a3f-2a500e35401f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:32.184342 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-01f52ced-20c9-43ec-8a3f-2a500e35401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:32.243418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1333/2706] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:32.253882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:32.255266 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:32.313622 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44748d-200c-45bc-b45b-45325234a692 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:32.317444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0cb8e-2e07-4524-9641-584da85bd31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:32.318048 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0cb8e-2e07-4524-9641-584da85bd31b service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:32.318361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0cb8e-2e07-4524-9641-584da85bd31b service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:32.318631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0cb8e-2e07-4524-9641-584da85bd31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:32.327395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0cb8e-2e07-4524-9641-584da85bd31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:32.329383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0cb8e-2e07-4524-9641-584da85bd31b service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:32.339262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1374/2707] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:32.587911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52ced-20c9-43ec-8a3f-2a500e35401f None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:32.587911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-01f52ced-20c9-43ec-8a3f-2a500e35401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:32.600425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52ced-20c9-43ec-8a3f-2a500e35401f None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:32.605236 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:32.605868 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:32.606151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:32.606466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] PATH_INFO: `/v3/users/16ef8c5282f14db9a4241c10062b0698` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:32.607602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ef8c5282f14db9a4241c10062b0698)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:32.609514 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:32.828371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ef8c5282f14db9a4241c10062b0698'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:32.835665 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ef8c5282f14db9a4241c10062b0698'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:32.847945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ef8c5282f14db9a4241c10062b0698'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:32.851020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:32.855590 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0cb8e-2e07-4524-9641-584da85bd31b service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:32.857081 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-67b0cb8e-2e07-4524-9641-584da85bd31b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:32.870999 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0cb8e-2e07-4524-9641-584da85bd31b service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:32.876648 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:32.877296 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:32.877576 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:32.877847 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] PATH_INFO: `/v3/projects/5aea1b26b30d4043b035f7a2cfda6fa9` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:32.879008 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aea1b26b30d4043b035f7a2cfda6fa9)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:32.880894 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:32.882721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:32.933782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ef8c5282f14db9a4241c10062b0698'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:32.934430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-67225731-211c-4e97-85e1-7e975b61b123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ef8c5282f14db9a4241c10062b0698'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:32.941955 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1334/2708] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:32 2022] DELETE /identity/v3/users/16ef8c5282f14db9a4241c10062b0698 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:32.946377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3d0de-af97-41b1-b295-bff7d4cc5474 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:32.946708 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3d0de-af97-41b1-b295-bff7d4cc5474 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:32.946983 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3d0de-af97-41b1-b295-bff7d4cc5474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:32.967841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-dda3d0de-af97-41b1-b295-bff7d4cc5474 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:32.969046 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-dda3d0de-af97-41b1-b295-bff7d4cc5474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:32.985670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aea1b26b30d4043b035f7a2cfda6fa9', 'request_id': 'req-a52e53d4-991a-4283-a564-a16f2f346bbf'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.028892 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1335/2709] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:33.039150 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3d0de-af97-41b1-b295-bff7d4cc5474 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:33.040654 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-dda3d0de-af97-41b1-b295-bff7d4cc5474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:33.102521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3d0de-af97-41b1-b295-bff7d4cc5474 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:33.111610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aea1b26b30d4043b035f7a2cfda6fa9', 'request_id': 'req-a52e53d4-991a-4283-a564-a16f2f346bbf'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.118408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aea1b26b30d4043b035f7a2cfda6fa9', 'request_id': 'req-a52e53d4-991a-4283-a564-a16f2f346bbf'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.129662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] The token cache is being invalidate because project 5aea1b26b30d4043b035f7a2cfda6fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:33.129958 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.130622 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.132115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1375/2710] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:32 2022] DELETE /identity/v3/projects/5aea1b26b30d4043b035f7a2cfda6fa9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:33.136078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:33.137441 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:33.151911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d9595-1c1e-4b70-98d0-c76c41f66eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:33.152517 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d9595-1c1e-4b70-98d0-c76c41f66eab service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:33.152796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d9595-1c1e-4b70-98d0-c76c41f66eab service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:33.153063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d9595-1c1e-4b70-98d0-c76c41f66eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:33.154812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-947d9595-1c1e-4b70-98d0-c76c41f66eab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:33.203057 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e53d4-991a-4283-a564-a16f2f346bbf admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:33.208190 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:33.208902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:33.209257 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:33.209602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] PATH_INFO: `/v3/users/c26d34d80aa34e68962cb9934cf107b5` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:33.210832 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26d34d80aa34e68962cb9934cf107b5)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:33.212824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:33.217684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d9595-1c1e-4b70-98d0-c76c41f66eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:33.219956 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d9595-1c1e-4b70-98d0-c76c41f66eab service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:33.229775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1336/2711] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:20:33.242601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:33.393790 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26d34d80aa34e68962cb9934cf107b5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.394476 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26d34d80aa34e68962cb9934cf107b5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.401745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26d34d80aa34e68962cb9934cf107b5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.414283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26d34d80aa34e68962cb9934cf107b5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.414971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-8e448a9a-f74b-4ece-8497-9bfe94666185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26d34d80aa34e68962cb9934cf107b5'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.545417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1376/2712] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:33 2022] DELETE /identity/v3/users/c26d34d80aa34e68962cb9934cf107b5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:33.708097 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d9595-1c1e-4b70-98d0-c76c41f66eab service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:33.709773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-947d9595-1c1e-4b70-98d0-c76c41f66eab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:33.725365 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d9595-1c1e-4b70-98d0-c76c41f66eab service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:33.784982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:33.787849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:33.787849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:33.787849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] PATH_INFO: `/v3/projects/c7acf7717edf42b1877e4d5dc6ef1fac` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:33.787849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7acf7717edf42b1877e4d5dc6ef1fac)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:33.789327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:33.935966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7acf7717edf42b1877e4d5dc6ef1fac', 'request_id': 'req-662f78f3-f097-431e-87da-0f37051ce7ab'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.943245 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7acf7717edf42b1877e4d5dc6ef1fac', 'request_id': 'req-662f78f3-f097-431e-87da-0f37051ce7ab'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:33.948799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7acf7717edf42b1877e4d5dc6ef1fac', 'request_id': 'req-662f78f3-f097-431e-87da-0f37051ce7ab'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:34.029984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] The token cache is being invalidate because project c7acf7717edf42b1877e4d5dc6ef1fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:34.030310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:34.030972 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-662f78f3-f097-431e-87da-0f37051ce7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:34.033092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1337/2713] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:33 2022] DELETE /identity/v3/projects/c7acf7717edf42b1877e4d5dc6ef1fac => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:34.038027 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c40d6-3d4d-41fa-b5fc-1b23db5add1c None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.038551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c40d6-3d4d-41fa-b5fc-1b23db5add1c None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.038662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c40d6-3d4d-41fa-b5fc-1b23db5add1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.059432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9d6c40d6-3d4d-41fa-b5fc-1b23db5add1c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:34.060625 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9d6c40d6-3d4d-41fa-b5fc-1b23db5add1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:34.065078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:34.120409 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1377/2714] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:34.128875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cee8-30bb-4b68-a2c2-6eb194cf9f77 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.129160 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cee8-30bb-4b68-a2c2-6eb194cf9f77 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.129433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8cee8-30bb-4b68-a2c2-6eb194cf9f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.150154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-12c8cee8-30bb-4b68-a2c2-6eb194cf9f77 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:34.151412 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-12c8cee8-30bb-4b68-a2c2-6eb194cf9f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:34.159953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1338/2715] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:34.161998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c40d6-3d4d-41fa-b5fc-1b23db5add1c None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.163642 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9d6c40d6-3d4d-41fa-b5fc-1b23db5add1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:34.163900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8cee8-30bb-4b68-a2c2-6eb194cf9f77 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.173616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8cee8-30bb-4b68-a2c2-6eb194cf9f77 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.177030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c40d6-3d4d-41fa-b5fc-1b23db5add1c None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.178981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e863ac-b28d-4485-b3a8-a708827d2f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.182694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e863ac-b28d-4485-b3a8-a708827d2f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.182694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e863ac-b28d-4485-b3a8-a708827d2f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.182694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e863ac-b28d-4485-b3a8-a708827d2f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.182694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e863ac-b28d-4485-b3a8-a708827d2f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:20:34.182694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e863ac-b28d-4485-b3a8-a708827d2f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.183274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.183386 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e863ac-b28d-4485-b3a8-a708827d2f80 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.183789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.184069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.184342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] PATH_INFO: `/v3/projects/2813c3a016e249819ce976ed872d49ba` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.185606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2813c3a016e249819ce976ed872d49ba)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.187433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.198065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1339/2716] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:20:34.202334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e863ac-b28d-4485-b3a8-a708827d2f80 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.217118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e863ac-b28d-4485-b3a8-a708827d2f80 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.222146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee232c-77da-4def-8dfd-aa06958fdffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.222929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee232c-77da-4def-8dfd-aa06958fdffb admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.223309 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee232c-77da-4def-8dfd-aa06958fdffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.223667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee232c-77da-4def-8dfd-aa06958fdffb admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.224303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee232c-77da-4def-8dfd-aa06958fdffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.226292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee232c-77da-4def-8dfd-aa06958fdffb admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.305295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2813c3a016e249819ce976ed872d49ba', 'request_id': 'req-4a44907d-5b82-4030-bcc9-cdedba611524'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:34.329377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1340/2717] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:34 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:34.333481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee232c-77da-4def-8dfd-aa06958fdffb admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.379456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2813c3a016e249819ce976ed872d49ba', 'request_id': 'req-4a44907d-5b82-4030-bcc9-cdedba611524'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:34.383014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:34.386985 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2813c3a016e249819ce976ed872d49ba', 'request_id': 'req-4a44907d-5b82-4030-bcc9-cdedba611524'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:34.396605 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee232c-77da-4def-8dfd-aa06958fdffb admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.397826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] The token cache is being invalidate because project 2813c3a016e249819ce976ed872d49ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:34.398120 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:34.398807 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-4a44907d-5b82-4030-bcc9-cdedba611524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:34.400344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1378/2718] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:34 2022] DELETE /identity/v3/projects/2813c3a016e249819ce976ed872d49ba => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:34.404006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331a1cc-51c4-42f1-a6f4-ce085034a863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.404006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331a1cc-51c4-42f1-a6f4-ce085034a863 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.404006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331a1cc-51c4-42f1-a6f4-ce085034a863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.404006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331a1cc-51c4-42f1-a6f4-ce085034a863 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.404841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331a1cc-51c4-42f1-a6f4-ce085034a863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.405536 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce2aa9-26f7-442e-8af8-d4d27564b617 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.405884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce2aa9-26f7-442e-8af8-d4d27564b617 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.405986 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331a1cc-51c4-42f1-a6f4-ce085034a863 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.406305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce2aa9-26f7-442e-8af8-d4d27564b617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.427427 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-36ce2aa9-26f7-442e-8af8-d4d27564b617 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:34.428629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-36ce2aa9-26f7-442e-8af8-d4d27564b617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:34.436948 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1379/2719] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:34.445699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbc954-674b-40f0-932f-bce377103c1f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.445981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbc954-674b-40f0-932f-bce377103c1f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.446290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbc954-674b-40f0-932f-bce377103c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.466278 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e6cbc954-674b-40f0-932f-bce377103c1f None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:34.467646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e6cbc954-674b-40f0-932f-bce377103c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:34.475840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1380/2720] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:34.479814 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbc954-674b-40f0-932f-bce377103c1f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.489715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbc954-674b-40f0-932f-bce377103c1f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.494305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025777d-205b-48e7-8675-01ba1a308428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.494890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025777d-205b-48e7-8675-01ba1a308428 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.495169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025777d-205b-48e7-8675-01ba1a308428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.495442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025777d-205b-48e7-8675-01ba1a308428 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.496082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025777d-205b-48e7-8675-01ba1a308428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:20:34.496410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025777d-205b-48e7-8675-01ba1a308428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.498053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025777d-205b-48e7-8675-01ba1a308428 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.510135 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1381/2721] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:20:34.514282 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025777d-205b-48e7-8675-01ba1a308428 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.523944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025777d-205b-48e7-8675-01ba1a308428 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.528606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a37c88-8ace-44b6-ae7a-73c52f78d979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.529176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a37c88-8ace-44b6-ae7a-73c52f78d979 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.529458 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a37c88-8ace-44b6-ae7a-73c52f78d979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.529735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a37c88-8ace-44b6-ae7a-73c52f78d979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.530381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a37c88-8ace-44b6-ae7a-73c52f78d979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.532351 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a37c88-8ace-44b6-ae7a-73c52f78d979 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.533362 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1341/2722] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:34 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:34.537186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331a1cc-51c4-42f1-a6f4-ce085034a863 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.538865 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-1331a1cc-51c4-42f1-a6f4-ce085034a863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:34.551630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331a1cc-51c4-42f1-a6f4-ce085034a863 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.556206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94523474-a97e-4940-af83-6600ddbe0889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.556797 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523474-a97e-4940-af83-6600ddbe0889 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.557076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523474-a97e-4940-af83-6600ddbe0889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.557345 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523474-a97e-4940-af83-6600ddbe0889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.557982 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94523474-a97e-4940-af83-6600ddbe0889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.559702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94523474-a97e-4940-af83-6600ddbe0889 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.570294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1342/2723] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:34.574304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94523474-a97e-4940-af83-6600ddbe0889 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.584813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94523474-a97e-4940-af83-6600ddbe0889 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.589360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e555a-2661-4d9f-a7b9-8240925b24d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.589933 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e555a-2661-4d9f-a7b9-8240925b24d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.590227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e555a-2661-4d9f-a7b9-8240925b24d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.590548 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e555a-2661-4d9f-a7b9-8240925b24d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.591175 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e555a-2661-4d9f-a7b9-8240925b24d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.592736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e555a-2661-4d9f-a7b9-8240925b24d9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.603418 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1343/2724] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:34.607536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e555a-2661-4d9f-a7b9-8240925b24d9 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.617617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e555a-2661-4d9f-a7b9-8240925b24d9 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.625364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7fe35-9f17-4a0a-a726-7695663b6bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.625364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7fe35-9f17-4a0a-a726-7695663b6bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.625364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7fe35-9f17-4a0a-a726-7695663b6bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.625364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7fe35-9f17-4a0a-a726-7695663b6bba admin admin] PATH_INFO: `/v3/projects/f162d099d93e4bdea8bf8e2c23c53dcd/users/5ee541ea737c414bb3d5d0bbfd3b4cd8/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.639358 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7fe35-9f17-4a0a-a726-7695663b6bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f162d099d93e4bdea8bf8e2c23c53dcd, user_id=5ee541ea737c414bb3d5d0bbfd3b4cd8, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.642610 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7fe35-9f17-4a0a-a726-7695663b6bba admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.683567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1382/2725] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:34 2022] POST /identity/v3/projects => generated 405 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:34.687690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a37c88-8ace-44b6-ae7a-73c52f78d979 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.724686 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1344/2726] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:34 2022] PUT /identity/v3/projects/f162d099d93e4bdea8bf8e2c23c53dcd/users/5ee541ea737c414bb3d5d0bbfd3b4cd8/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:34.736046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:34.737293 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc8d25-237f-46eb-b5cc-1643c3aaada7 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.737577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc8d25-237f-46eb-b5cc-1643c3aaada7 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.737852 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc8d25-237f-46eb-b5cc-1643c3aaada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.752983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a37c88-8ace-44b6-ae7a-73c52f78d979 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.765839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-31fc8d25-237f-46eb-b5cc-1643c3aaada7 None None] MFA Rules not processed for user `5ee541ea737c414bb3d5d0bbfd3b4cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:34.767902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-31fc8d25-237f-46eb-b5cc-1643c3aaada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:34.811479 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973236df-0d6c-41cb-b97d-3c02d5dcd234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.812094 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973236df-0d6c-41cb-b97d-3c02d5dcd234 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.812377 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973236df-0d6c-41cb-b97d-3c02d5dcd234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.812681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973236df-0d6c-41cb-b97d-3c02d5dcd234 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.813756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973236df-0d6c-41cb-b97d-3c02d5dcd234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.815956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973236df-0d6c-41cb-b97d-3c02d5dcd234 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.833760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1345/2727] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:34.838264 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc8d25-237f-46eb-b5cc-1643c3aaada7 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.848715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc8d25-237f-46eb-b5cc-1643c3aaada7 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:34.853652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849e876-c598-44a5-8656-2c16956850df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:34.854292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849e876-c598-44a5-8656-2c16956850df admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:34.854583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849e876-c598-44a5-8656-2c16956850df admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:34.854859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849e876-c598-44a5-8656-2c16956850df admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:34.855482 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849e876-c598-44a5-8656-2c16956850df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:34.857377 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849e876-c598-44a5-8656-2c16956850df admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:34.986506 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1383/2728] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:34 2022] POST /identity/v3/users => generated 303 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:34.990369 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973236df-0d6c-41cb-b97d-3c02d5dcd234 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:34.999670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973236df-0d6c-41cb-b97d-3c02d5dcd234 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.004328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21fd3e-5478-4a5f-84bb-c2ffad8ffc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.004904 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21fd3e-5478-4a5f-84bb-c2ffad8ffc53 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.005184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21fd3e-5478-4a5f-84bb-c2ffad8ffc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.005459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21fd3e-5478-4a5f-84bb-c2ffad8ffc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.006087 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21fd3e-5478-4a5f-84bb-c2ffad8ffc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.007694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21fd3e-5478-4a5f-84bb-c2ffad8ffc53 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.018521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1384/2729] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:35.027288 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21fd3e-5478-4a5f-84bb-c2ffad8ffc53 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.037839 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21fd3e-5478-4a5f-84bb-c2ffad8ffc53 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.042564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443f327-a954-4b37-bac1-3e5516f3897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.043150 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f327-a954-4b37-bac1-3e5516f3897a admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.043417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f327-a954-4b37-bac1-3e5516f3897a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.043694 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f327-a954-4b37-bac1-3e5516f3897a admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.044328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443f327-a954-4b37-bac1-3e5516f3897a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.045885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443f327-a954-4b37-bac1-3e5516f3897a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.057019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1385/2730] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:35.060886 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443f327-a954-4b37-bac1-3e5516f3897a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.070551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443f327-a954-4b37-bac1-3e5516f3897a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.075143 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a67818-6af6-4a1a-bf7f-54f7c6d32e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.075760 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a67818-6af6-4a1a-bf7f-54f7c6d32e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.076039 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a67818-6af6-4a1a-bf7f-54f7c6d32e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.076310 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a67818-6af6-4a1a-bf7f-54f7c6d32e19 admin admin] PATH_INFO: `/v3/projects/2f8cd275ce664118a2fb70af50f6df1c/users/65accdad24854d828329b572ec3ba4be/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.085816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1346/2731] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:34 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:35.092082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a67818-6af6-4a1a-bf7f-54f7c6d32e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8cd275ce664118a2fb70af50f6df1c, user_id=65accdad24854d828329b572ec3ba4be, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.092854 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849e876-c598-44a5-8656-2c16956850df admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.094295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a67818-6af6-4a1a-bf7f-54f7c6d32e19 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.153934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849e876-c598-44a5-8656-2c16956850df admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.159260 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660dbe1-62d0-43f3-981b-7550b66d1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.159867 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660dbe1-62d0-43f3-981b-7550b66d1a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.160148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660dbe1-62d0-43f3-981b-7550b66d1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.160421 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660dbe1-62d0-43f3-981b-7550b66d1a67 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.161047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660dbe1-62d0-43f3-981b-7550b66d1a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.163007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660dbe1-62d0-43f3-981b-7550b66d1a67 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.191283 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1386/2732] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:35 2022] PUT /identity/v3/projects/2f8cd275ce664118a2fb70af50f6df1c/users/65accdad24854d828329b572ec3ba4be/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:35.202562 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd96981-d30d-4937-a998-05a13f715c19 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.202851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd96981-d30d-4937-a998-05a13f715c19 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.203125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd96981-d30d-4937-a998-05a13f715c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.207256 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:35.231164 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2bd96981-d30d-4937-a998-05a13f715c19 None None] MFA Rules not processed for user `65accdad24854d828329b572ec3ba4be`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:35.232369 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2bd96981-d30d-4937-a998-05a13f715c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:35.278625 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1347/2733] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:35 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:35.280067 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660dbe1-62d0-43f3-981b-7550b66d1a67 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.290553 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660dbe1-62d0-43f3-981b-7550b66d1a67 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.296328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1387/2734] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:35 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:35.305137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd96981-d30d-4937-a998-05a13f715c19 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.350430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881107e-b687-4928-ad6a-d29805ea2c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.351040 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881107e-b687-4928-ad6a-d29805ea2c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.351315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881107e-b687-4928-ad6a-d29805ea2c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.351582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881107e-b687-4928-ad6a-d29805ea2c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.352216 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881107e-b687-4928-ad6a-d29805ea2c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.353802 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881107e-b687-4928-ad6a-d29805ea2c44 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.363372 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1348/2735] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:20:35.367466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881107e-b687-4928-ad6a-d29805ea2c44 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.370969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd96981-d30d-4937-a998-05a13f715c19 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.372703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780fa24-5492-450b-9e5d-a002f3124839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.373317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780fa24-5492-450b-9e5d-a002f3124839 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.373600 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780fa24-5492-450b-9e5d-a002f3124839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.373876 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780fa24-5492-450b-9e5d-a002f3124839 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.374661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780fa24-5492-450b-9e5d-a002f3124839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.376568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780fa24-5492-450b-9e5d-a002f3124839 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.377353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881107e-b687-4928-ad6a-d29805ea2c44 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.382051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3187e79-478b-4ad1-99bc-aedfe82fcc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.382736 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3187e79-478b-4ad1-99bc-aedfe82fcc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.383017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3187e79-478b-4ad1-99bc-aedfe82fcc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.383292 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3187e79-478b-4ad1-99bc-aedfe82fcc87 admin admin] PATH_INFO: `/v3/projects/244122c2d3d84a15983aea49e09c8ee6/users/cf7df532b29348499ac9df7a6292ac28/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.399729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3187e79-478b-4ad1-99bc-aedfe82fcc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244122c2d3d84a15983aea49e09c8ee6, user_id=cf7df532b29348499ac9df7a6292ac28, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.402419 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3187e79-478b-4ad1-99bc-aedfe82fcc87 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.505118 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:35.522116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1349/2736] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:35 2022] PUT /identity/v3/projects/244122c2d3d84a15983aea49e09c8ee6/users/cf7df532b29348499ac9df7a6292ac28/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:35.526170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1388/2737] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:35 2022] POST /identity/v3/projects => generated 407 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:35.526353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3187e79-478b-4ad1-99bc-aedfe82fcc87 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.527136 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780fa24-5492-450b-9e5d-a002f3124839 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.590469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3187e79-478b-4ad1-99bc-aedfe82fcc87 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.593029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780fa24-5492-450b-9e5d-a002f3124839 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.596366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc41c47-8c85-4458-87f1-127f47215e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.597127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc41c47-8c85-4458-87f1-127f47215e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.597405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc41c47-8c85-4458-87f1-127f47215e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.597683 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc41c47-8c85-4458-87f1-127f47215e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.598379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc41c47-8c85-4458-87f1-127f47215e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.599183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e326a6-fa5c-40fd-a6a6-f897460d6e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.599815 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e326a6-fa5c-40fd-a6a6-f897460d6e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.600079 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc41c47-8c85-4458-87f1-127f47215e75 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.600193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e326a6-fa5c-40fd-a6a6-f897460d6e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.600357 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e326a6-fa5c-40fd-a6a6-f897460d6e0b admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.600987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e326a6-fa5c-40fd-a6a6-f897460d6e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.602963 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e326a6-fa5c-40fd-a6a6-f897460d6e0b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.615366 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1350/2738] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:20:35.616457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc41c47-8c85-4458-87f1-127f47215e75 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.626200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc41c47-8c85-4458-87f1-127f47215e75 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.631294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e47f09-41a7-4c33-a14a-593e7bfaae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.631474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47f09-41a7-4c33-a14a-593e7bfaae46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.631755 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47f09-41a7-4c33-a14a-593e7bfaae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.632026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e47f09-41a7-4c33-a14a-593e7bfaae46 admin admin] PATH_INFO: `/v3/projects/244122c2d3d84a15983aea49e09c8ee6/users/cf7df532b29348499ac9df7a6292ac28/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.633952 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e47f09-41a7-4c33-a14a-593e7bfaae46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244122c2d3d84a15983aea49e09c8ee6, user_id=cf7df532b29348499ac9df7a6292ac28, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.636642 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e47f09-41a7-4c33-a14a-593e7bfaae46 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.647248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1351/2739] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:35 2022] PUT /identity/v3/projects/244122c2d3d84a15983aea49e09c8ee6/users/cf7df532b29348499ac9df7a6292ac28/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:35.658017 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625667-c5d6-4fc6-8df5-cd43db8926af None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.658349 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625667-c5d6-4fc6-8df5-cd43db8926af None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.658627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625667-c5d6-4fc6-8df5-cd43db8926af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.685281 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1389/2740] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:35 2022] POST /identity/v3/users => generated 310 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:35.686620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e326a6-fa5c-40fd-a6a6-f897460d6e0b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.688705 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-9f625667-c5d6-4fc6-8df5-cd43db8926af None None] MFA Rules not processed for user `cf7df532b29348499ac9df7a6292ac28`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:35.689048 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9f625667-c5d6-4fc6-8df5-cd43db8926af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:35.697352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e326a6-fa5c-40fd-a6a6-f897460d6e0b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.722524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:35.756496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aead72-18a7-479e-b072-d4ab07e82e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.757106 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aead72-18a7-479e-b072-d4ab07e82e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.757387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aead72-18a7-479e-b072-d4ab07e82e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.757661 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aead72-18a7-479e-b072-d4ab07e82e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.758335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aead72-18a7-479e-b072-d4ab07e82e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.759964 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aead72-18a7-479e-b072-d4ab07e82e2d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.763813 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1352/2741] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:35.770796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1390/2742] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:35.774556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f625667-c5d6-4fc6-8df5-cd43db8926af None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.775768 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aead72-18a7-479e-b072-d4ab07e82e2d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.777614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-06aead72-18a7-479e-b072-d4ab07e82e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:35.785470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f625667-c5d6-4fc6-8df5-cd43db8926af None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.790317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415afc6b-a902-4351-9a62-d6b0de2b5681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.791338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415afc6b-a902-4351-9a62-d6b0de2b5681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.792216 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415afc6b-a902-4351-9a62-d6b0de2b5681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.792447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415afc6b-a902-4351-9a62-d6b0de2b5681 admin admin] PATH_INFO: `/v3/projects/ef617355af9a4ec0b819fccd4841c89a/users/34b16ef922534243870629cf2ab40944/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.808821 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415afc6b-a902-4351-9a62-d6b0de2b5681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef617355af9a4ec0b819fccd4841c89a, user_id=34b16ef922534243870629cf2ab40944, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.811509 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415afc6b-a902-4351-9a62-d6b0de2b5681 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.821367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:35.838914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aead72-18a7-479e-b072-d4ab07e82e2d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:35.842594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7cb0d-5279-4a69-8a4e-cef84aef234e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:35.843132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7cb0d-5279-4a69-8a4e-cef84aef234e service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:35.843410 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7cb0d-5279-4a69-8a4e-cef84aef234e service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:35.843680 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7cb0d-5279-4a69-8a4e-cef84aef234e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:35.853209 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7cb0d-5279-4a69-8a4e-cef84aef234e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:35.858498 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7cb0d-5279-4a69-8a4e-cef84aef234e service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:35.864721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1391/2743] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:20:35.933979 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1353/2744] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:35 2022] PUT /identity/v3/projects/ef617355af9a4ec0b819fccd4841c89a/users/34b16ef922534243870629cf2ab40944/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:35.937936 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7cb0d-5279-4a69-8a4e-cef84aef234e service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:35.949149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7cb0d-5279-4a69-8a4e-cef84aef234e service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:36.014913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4bcf6-7225-420b-9281-9ba2601efda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:36.015532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bcf6-7225-420b-9281-9ba2601efda5 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:36.015816 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bcf6-7225-420b-9281-9ba2601efda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:36.016345 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bcf6-7225-420b-9281-9ba2601efda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:36.016772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4bcf6-7225-420b-9281-9ba2601efda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:36.018786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4bcf6-7225-420b-9281-9ba2601efda5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:36.028927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1392/2745] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:20:36.033127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415afc6b-a902-4351-9a62-d6b0de2b5681 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:36.043948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415afc6b-a902-4351-9a62-d6b0de2b5681 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:36.049125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cb09e-d32e-457d-8a32-6eb6759f621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:36.049771 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cb09e-d32e-457d-8a32-6eb6759f621a admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:36.050047 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cb09e-d32e-457d-8a32-6eb6759f621a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:36.050391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cb09e-d32e-457d-8a32-6eb6759f621a admin admin] PATH_INFO: `/v3/projects/ef617355af9a4ec0b819fccd4841c89a/users/34b16ef922534243870629cf2ab40944/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:36.052310 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cb09e-d32e-457d-8a32-6eb6759f621a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef617355af9a4ec0b819fccd4841c89a, user_id=34b16ef922534243870629cf2ab40944, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:36.054984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cb09e-d32e-457d-8a32-6eb6759f621a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:36.066118 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1354/2746] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:36 2022] PUT /identity/v3/projects/ef617355af9a4ec0b819fccd4841c89a/users/34b16ef922534243870629cf2ab40944/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:36.077324 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54961ed-e1f2-44c1-be32-86b972646746 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:36.077810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54961ed-e1f2-44c1-be32-86b972646746 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:36.077908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54961ed-e1f2-44c1-be32-86b972646746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:36.105134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e54961ed-e1f2-44c1-be32-86b972646746 None None] MFA Rules not processed for user `34b16ef922534243870629cf2ab40944`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:36.106300 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e54961ed-e1f2-44c1-be32-86b972646746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:36.159623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cb09e-d32e-457d-8a32-6eb6759f621a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:36.179328 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1393/2747] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:36.195488 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54961ed-e1f2-44c1-be32-86b972646746 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:36.196785 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e54961ed-e1f2-44c1-be32-86b972646746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:36.218228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cb09e-d32e-457d-8a32-6eb6759f621a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:36.222538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1b4b1-b789-4927-9d4d-24d9858cba31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:36.223138 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1b4b1-b789-4927-9d4d-24d9858cba31 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:36.223420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1b4b1-b789-4927-9d4d-24d9858cba31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:36.223687 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1b4b1-b789-4927-9d4d-24d9858cba31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:36.255182 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54961ed-e1f2-44c1-be32-86b972646746 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:36.258949 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5b60a-ab34-4bca-a3fa-43f5b3623367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:36.259560 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5b60a-ab34-4bca-a3fa-43f5b3623367 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:36.259862 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5b60a-ab34-4bca-a3fa-43f5b3623367 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:36.260117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5b60a-ab34-4bca-a3fa-43f5b3623367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:36.269339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5b60a-ab34-4bca-a3fa-43f5b3623367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:36.270795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5b60a-ab34-4bca-a3fa-43f5b3623367 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:36.280676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1394/2748] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:36 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:20:36.283339 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1b4b1-b789-4927-9d4d-24d9858cba31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:36.284788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1b4b1-b789-4927-9d4d-24d9858cba31 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:36.294392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1355/2749] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:20:36.721128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5b60a-ab34-4bca-a3fa-43f5b3623367 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:36.725116 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:36.730033 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5b60a-ab34-4bca-a3fa-43f5b3623367 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:36.733587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fff04-fba3-44ca-be84-55fe277a85a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:36.736745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fff04-fba3-44ca-be84-55fe277a85a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:36.736745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fff04-fba3-44ca-be84-55fe277a85a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:36.736745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fff04-fba3-44ca-be84-55fe277a85a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:36.805588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fff04-fba3-44ca-be84-55fe277a85a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:36.807264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fff04-fba3-44ca-be84-55fe277a85a9 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:36.818718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1395/2750] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:36 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:43.928856 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1b4b1-b789-4927-9d4d-24d9858cba31 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:43.976371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:43.991471 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1b4b1-b789-4927-9d4d-24d9858cba31 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:43.996344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:43.997355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:43.997355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:43.997575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] PATH_INFO: `/v3/users/65accdad24854d828329b572ec3ba4be` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:43.998715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65accdad24854d828329b572ec3ba4be)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:44.001492 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:44.232884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65accdad24854d828329b572ec3ba4be'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:44.240782 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65accdad24854d828329b572ec3ba4be'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:44.253590 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65accdad24854d828329b572ec3ba4be'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:44.327645 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65accdad24854d828329b572ec3ba4be'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:44.328315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65accdad24854d828329b572ec3ba4be'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:44.334620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1356/2751] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:43 2022] DELETE /identity/v3/users/65accdad24854d828329b572ec3ba4be => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:44.339102 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74919ac6-0034-4548-bb15-950d2c448178 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:44.339618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74919ac6-0034-4548-bb15-950d2c448178 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:44.339793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74919ac6-0034-4548-bb15-950d2c448178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:44.358962 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-74919ac6-0034-4548-bb15-950d2c448178 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:44.360896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-74919ac6-0034-4548-bb15-950d2c448178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:44.419473 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1396/2752] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:44.429835 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:44.431277 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:44.490402 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b6873-5e04-4a4e-9b29-dc36f4a11b33 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:44.493974 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc1763-f235-4254-a0aa-51b7eb8c7681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:44.494607 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc1763-f235-4254-a0aa-51b7eb8c7681 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:44.494888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc1763-f235-4254-a0aa-51b7eb8c7681 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:44.495161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc1763-f235-4254-a0aa-51b7eb8c7681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:44.504689 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc1763-f235-4254-a0aa-51b7eb8c7681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:44.506112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc1763-f235-4254-a0aa-51b7eb8c7681 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:44.515583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1357/2753] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:44.974706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74919ac6-0034-4548-bb15-950d2c448178 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:44.976366 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-74919ac6-0034-4548-bb15-950d2c448178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:44.990757 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74919ac6-0034-4548-bb15-950d2c448178 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:44.997398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:44.997398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:44.997398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:44.997398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] PATH_INFO: `/v3/projects/2f8cd275ce664118a2fb70af50f6df1c` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:44.998159 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8cd275ce664118a2fb70af50f6df1c)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:45.000065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:45.121793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8cd275ce664118a2fb70af50f6df1c', 'request_id': 'req-932c474f-635e-41e3-9c66-a836dca9d9cf'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.196152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8cd275ce664118a2fb70af50f6df1c', 'request_id': 'req-932c474f-635e-41e3-9c66-a836dca9d9cf'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.205107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8cd275ce664118a2fb70af50f6df1c', 'request_id': 'req-932c474f-635e-41e3-9c66-a836dca9d9cf'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.216256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] The token cache is being invalidate because project 2f8cd275ce664118a2fb70af50f6df1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:45.216629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.217756 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.219914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1397/2754] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:44 2022] DELETE /identity/v3/projects/2f8cd275ce664118a2fb70af50f6df1c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:45.224279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc1763-f235-4254-a0aa-51b7eb8c7681 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:45.234780 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc1763-f235-4254-a0aa-51b7eb8c7681 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:45.291949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:45.292511 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:45.292796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:45.293077 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] PATH_INFO: `/v3/users/34b16ef922534243870629cf2ab40944` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:45.294334 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b16ef922534243870629cf2ab40944)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:45.296287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:45.307216 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:45.530778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b16ef922534243870629cf2ab40944'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.537612 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:45.538887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b16ef922534243870629cf2ab40944'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.539391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:45.553137 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c474f-635e-41e3-9c66-a836dca9d9cf admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:45.553551 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b16ef922534243870629cf2ab40944'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.557746 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:45.558420 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:45.558705 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:45.558981 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] PATH_INFO: `/v3/users/5ee541ea737c414bb3d5d0bbfd3b4cd8` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:45.560129 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee541ea737c414bb3d5d0bbfd3b4cd8)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:45.562038 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:45.585603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:45.658893 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b16ef922534243870629cf2ab40944'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.659538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-990cdeb1-21da-4ba7-aaa2-bfbf2bed3add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b16ef922534243870629cf2ab40944'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.666036 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1358/2755] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:45 2022] DELETE /identity/v3/users/34b16ef922534243870629cf2ab40944 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:45.827618 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee541ea737c414bb3d5d0bbfd3b4cd8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.828702 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee541ea737c414bb3d5d0bbfd3b4cd8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.835786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee541ea737c414bb3d5d0bbfd3b4cd8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.848841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee541ea737c414bb3d5d0bbfd3b4cd8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.849596 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee541ea737c414bb3d5d0bbfd3b4cd8'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:45.940047 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1398/2756] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:45 2022] DELETE /identity/v3/users/5ee541ea737c414bb3d5d0bbfd3b4cd8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:45.945103 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7ac3-455a-4bed-9244-52992152c9a4 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:45.945392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7ac3-455a-4bed-9244-52992152c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:45.945669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7ac3-455a-4bed-9244-52992152c9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:45.965888 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-decd7ac3-455a-4bed-9244-52992152c9a4 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:45.970743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-decd7ac3-455a-4bed-9244-52992152c9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:46.042724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1359/2757] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:46.053036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:46.054520 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:46.101323 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd7ac3-455a-4bed-9244-52992152c9a4 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:46.102864 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-decd7ac3-455a-4bed-9244-52992152c9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:46.118483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd7ac3-455a-4bed-9244-52992152c9a4 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:46.122490 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6193d-f7be-408f-8062-2db946a513ae admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:46.123317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:46.123993 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:46.124276 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:46.124557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] PATH_INFO: `/v3/projects/ef617355af9a4ec0b819fccd4841c89a` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:46.125846 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef617355af9a4ec0b819fccd4841c89a)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:46.128573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:46.134683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8efa3-27c7-466e-9c42-6b892fcd936d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:46.135322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8efa3-27c7-466e-9c42-6b892fcd936d service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:46.135634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8efa3-27c7-466e-9c42-6b892fcd936d service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:46.135915 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8efa3-27c7-466e-9c42-6b892fcd936d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:46.145907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8efa3-27c7-466e-9c42-6b892fcd936d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:46.147383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8efa3-27c7-466e-9c42-6b892fcd936d service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:46.158971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1399/2758] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:46.238003 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef617355af9a4ec0b819fccd4841c89a', 'request_id': 'req-2bad507c-ce39-4821-b84f-bf7d1f36918f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:46.244390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef617355af9a4ec0b819fccd4841c89a', 'request_id': 'req-2bad507c-ce39-4821-b84f-bf7d1f36918f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:46.250140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef617355af9a4ec0b819fccd4841c89a', 'request_id': 'req-2bad507c-ce39-4821-b84f-bf7d1f36918f'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:46.408423 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] The token cache is being invalidate because project ef617355af9a4ec0b819fccd4841c89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:46.408717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:46.409381 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2bad507c-ce39-4821-b84f-bf7d1f36918f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:46.410931 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1360/2759] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:46 2022] DELETE /identity/v3/projects/ef617355af9a4ec0b819fccd4841c89a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:46.416006 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea77ac7-7a70-48d3-8d8b-b34dc115c863 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:46.416294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea77ac7-7a70-48d3-8d8b-b34dc115c863 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:46.416566 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea77ac7-7a70-48d3-8d8b-b34dc115c863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:46.436837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-dea77ac7-7a70-48d3-8d8b-b34dc115c863 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:46.438156 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-dea77ac7-7a70-48d3-8d8b-b34dc115c863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:46.500993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1400/2760] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:46.509768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2333b-aa17-4da3-a6a5-5052404e1f18 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:46.510055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2333b-aa17-4da3-a6a5-5052404e1f18 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:46.510369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2333b-aa17-4da3-a6a5-5052404e1f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:46.531073 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-99e2333b-aa17-4da3-a6a5-5052404e1f18 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:46.532963 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-99e2333b-aa17-4da3-a6a5-5052404e1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:46.541043 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1361/2761] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:46.545240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea77ac7-7a70-48d3-8d8b-b34dc115c863 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:46.555183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea77ac7-7a70-48d3-8d8b-b34dc115c863 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:46.559792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611b3d6-ca43-42c6-9bfa-787c33c5c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:46.560396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b3d6-ca43-42c6-9bfa-787c33c5c2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:46.560679 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b3d6-ca43-42c6-9bfa-787c33c5c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:46.560955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b3d6-ca43-42c6-9bfa-787c33c5c2f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:46.561603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611b3d6-ca43-42c6-9bfa-787c33c5c2f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:20:46.561907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611b3d6-ca43-42c6-9bfa-787c33c5c2f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:46.563607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611b3d6-ca43-42c6-9bfa-787c33c5c2f3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:46.575549 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1401/2762] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:20:46.599134 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2333b-aa17-4da3-a6a5-5052404e1f18 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:46.601466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-99e2333b-aa17-4da3-a6a5-5052404e1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:46.611019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:46.621627 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2333b-aa17-4da3-a6a5-5052404e1f18 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:46.627473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:46.628095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:46.628380 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:46.628670 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] PATH_INFO: `/v3/projects/f162d099d93e4bdea8bf8e2c23c53dcd` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:46.630129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f162d099d93e4bdea8bf8e2c23c53dcd)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:46.631981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:46.642963 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611b3d6-ca43-42c6-9bfa-787c33c5c2f3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:46.653358 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611b3d6-ca43-42c6-9bfa-787c33c5c2f3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:46.658956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9621c92-1f84-4134-b632-64ebbcb266d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:46.659532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621c92-1f84-4134-b632-64ebbcb266d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:46.659808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621c92-1f84-4134-b632-64ebbcb266d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:46.660076 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621c92-1f84-4134-b632-64ebbcb266d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:46.660786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9621c92-1f84-4134-b632-64ebbcb266d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:46.662743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9621c92-1f84-4134-b632-64ebbcb266d4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:46.808456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f162d099d93e4bdea8bf8e2c23c53dcd', 'request_id': 'req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:46.815461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f162d099d93e4bdea8bf8e2c23c53dcd', 'request_id': 'req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:46.821023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f162d099d93e4bdea8bf8e2c23c53dcd', 'request_id': 'req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:46.860749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1402/2763] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:46 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:46.864829 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9621c92-1f84-4134-b632-64ebbcb266d4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:46.870301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:46.925851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9621c92-1f84-4134-b632-64ebbcb266d4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:46.927921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] The token cache is being invalidate because project f162d099d93e4bdea8bf8e2c23c53dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:46.928214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:46.928877 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:46.930595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1362/2764] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:46 2022] DELETE /identity/v3/projects/f162d099d93e4bdea8bf8e2c23c53dcd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:46.933841 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495560b-1967-4da4-b69e-daa3f04188cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:46.934515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495560b-1967-4da4-b69e-daa3f04188cb admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:46.934703 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:46.934831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495560b-1967-4da4-b69e-daa3f04188cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:46.935073 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495560b-1967-4da4-b69e-daa3f04188cb admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:46.935821 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495560b-1967-4da4-b69e-daa3f04188cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:46.936126 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:46.938433 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495560b-1967-4da4-b69e-daa3f04188cb admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:47.001422 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032ddf-c7f9-434a-bb07-7b4ab9570b24 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:47.006091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:47.006742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.007054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.007357 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] PATH_INFO: `/v3/users/cf7df532b29348499ac9df7a6292ac28` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.008484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7df532b29348499ac9df7a6292ac28)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:47.010405 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:47.076602 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1403/2765] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:46 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:47.080606 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495560b-1967-4da4-b69e-daa3f04188cb admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:47.082275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-6495560b-1967-4da4-b69e-daa3f04188cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:47.094781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495560b-1967-4da4-b69e-daa3f04188cb admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:47.099369 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100ccf-bc80-4e9e-9355-093db0abebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:47.099956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100ccf-bc80-4e9e-9355-093db0abebeb admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.100237 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100ccf-bc80-4e9e-9355-093db0abebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.100509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100ccf-bc80-4e9e-9355-093db0abebeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.101149 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100ccf-bc80-4e9e-9355-093db0abebeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:47.102779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100ccf-bc80-4e9e-9355-093db0abebeb admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:47.113367 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1404/2766] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:47.117037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100ccf-bc80-4e9e-9355-093db0abebeb admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:47.127353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100ccf-bc80-4e9e-9355-093db0abebeb admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:47.131944 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317dd2-558b-4460-b1b2-91c1a7be097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:47.132510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317dd2-558b-4460-b1b2-91c1a7be097b admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.132792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317dd2-558b-4460-b1b2-91c1a7be097b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.133068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317dd2-558b-4460-b1b2-91c1a7be097b admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.133687 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c317dd2-558b-4460-b1b2-91c1a7be097b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:47.135257 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c317dd2-558b-4460-b1b2-91c1a7be097b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:47.146064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1405/2767] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:47.150035 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317dd2-558b-4460-b1b2-91c1a7be097b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:47.159943 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317dd2-558b-4460-b1b2-91c1a7be097b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:47.164548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb9f25-d354-4a1d-a6e5-cc8e1de1774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:47.165152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9f25-d354-4a1d-a6e5-cc8e1de1774e admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.165431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9f25-d354-4a1d-a6e5-cc8e1de1774e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.165703 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9f25-d354-4a1d-a6e5-cc8e1de1774e admin admin] PATH_INFO: `/v3/projects/f38f1ba9066d41968b5528df6235311e/users/b07b314d33084213b98e51833a2645cd/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.180766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb9f25-d354-4a1d-a6e5-cc8e1de1774e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38f1ba9066d41968b5528df6235311e, user_id=b07b314d33084213b98e51833a2645cd, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:47.183422 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb9f25-d354-4a1d-a6e5-cc8e1de1774e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:47.232557 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7df532b29348499ac9df7a6292ac28'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:47.240006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7df532b29348499ac9df7a6292ac28'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:47.253294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7df532b29348499ac9df7a6292ac28'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:47.253934 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1406/2768] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:47 2022] PUT /identity/v3/projects/f38f1ba9066d41968b5528df6235311e/users/b07b314d33084213b98e51833a2645cd/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:47.263987 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99722a3e-33b5-41ca-ba46-ed1694e26e7d None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.264277 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99722a3e-33b5-41ca-ba46-ed1694e26e7d None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.264578 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99722a3e-33b5-41ca-ba46-ed1694e26e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.291961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-99722a3e-33b5-41ca-ba46-ed1694e26e7d None None] MFA Rules not processed for user `b07b314d33084213b98e51833a2645cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:47.293204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-99722a3e-33b5-41ca-ba46-ed1694e26e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:47.357075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1407/2769] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:47.362046 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99722a3e-33b5-41ca-ba46-ed1694e26e7d None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:47.366746 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7df532b29348499ac9df7a6292ac28'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:47.367391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7df532b29348499ac9df7a6292ac28'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:47.374037 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1363/2770] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:46 2022] DELETE /identity/v3/users/cf7df532b29348499ac9df7a6292ac28 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:47.405263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:47.428059 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99722a3e-33b5-41ca-ba46-ed1694e26e7d None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:47.486269 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af8e95-00cd-47f0-b135-d8da5977b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:47.486890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af8e95-00cd-47f0-b135-d8da5977b42e admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.487173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af8e95-00cd-47f0-b135-d8da5977b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.487452 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af8e95-00cd-47f0-b135-d8da5977b42e admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.488089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af8e95-00cd-47f0-b135-d8da5977b42e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:47.489995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af8e95-00cd-47f0-b135-d8da5977b42e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:47.617068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1408/2771] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:47 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:47.620944 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:47.623021 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:47.640329 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1edeab-6a07-4a60-ac60-c67cfa1db53c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:47.644079 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:47.699542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea9637-9b99-487f-a203-889f84575ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:47.701331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea9637-9b99-487f-a203-889f84575ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.701331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea9637-9b99-487f-a203-889f84575ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.701331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea9637-9b99-487f-a203-889f84575ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.701331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea9637-9b99-487f-a203-889f84575ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:47.703688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea9637-9b99-487f-a203-889f84575ab7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:47.853850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1364/2772] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:47 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:20:47.857887 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af8e95-00cd-47f0-b135-d8da5977b42e admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:47.868240 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af8e95-00cd-47f0-b135-d8da5977b42e admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:47.872749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d12de-323b-4736-95a3-8a9761c16734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:47.873354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d12de-323b-4736-95a3-8a9761c16734 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.873636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d12de-323b-4736-95a3-8a9761c16734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.873912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d12de-323b-4736-95a3-8a9761c16734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.874607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d12de-323b-4736-95a3-8a9761c16734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:47.876194 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d12de-323b-4736-95a3-8a9761c16734 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:47.887885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1409/2773] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:20:47.892702 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea9637-9b99-487f-a203-889f84575ab7 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:47.901426 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d12de-323b-4736-95a3-8a9761c16734 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:47.903727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-a25d12de-323b-4736-95a3-8a9761c16734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:47.910392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea9637-9b99-487f-a203-889f84575ab7 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:47.916014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6a655-421e-4e25-b79b-cb3f92cb8e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:47.916539 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6a655-421e-4e25-b79b-cb3f92cb8e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.916829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6a655-421e-4e25-b79b-cb3f92cb8e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.917106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6a655-421e-4e25-b79b-cb3f92cb8e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.917756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6a655-421e-4e25-b79b-cb3f92cb8e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:47.918090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d12de-323b-4736-95a3-8a9761c16734 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:47.919407 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6a655-421e-4e25-b79b-cb3f92cb8e00 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:47.923646 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:47.924322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.924767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.925053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] PATH_INFO: `/v3/projects/244122c2d3d84a15983aea49e09c8ee6` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.926607 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=244122c2d3d84a15983aea49e09c8ee6)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:47.928513 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:47.933647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1365/2774] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:47.934556 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6a655-421e-4e25-b79b-cb3f92cb8e00 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:47.945383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6a655-421e-4e25-b79b-cb3f92cb8e00 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:47.950087 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211409d-6d0e-49fe-a1d7-d1b2f7676d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:47.950758 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211409d-6d0e-49fe-a1d7-d1b2f7676d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:47.956302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211409d-6d0e-49fe-a1d7-d1b2f7676d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:47.956302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211409d-6d0e-49fe-a1d7-d1b2f7676d14 admin admin] PATH_INFO: `/v3/projects/f308abd562764f77b31d05997ba5eb60/users/7ed01acc32554e3c8de586fb6d0474ef/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:47.967639 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211409d-6d0e-49fe-a1d7-d1b2f7676d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f308abd562764f77b31d05997ba5eb60, user_id=7ed01acc32554e3c8de586fb6d0474ef, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:47.971435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211409d-6d0e-49fe-a1d7-d1b2f7676d14 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.093829 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1366/2775] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:47 2022] PUT /identity/v3/projects/f308abd562764f77b31d05997ba5eb60/users/7ed01acc32554e3c8de586fb6d0474ef/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:48.104183 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da962e9f-55d0-4391-9d27-f72c2f1d7179 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.104463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da962e9f-55d0-4391-9d27-f72c2f1d7179 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.104738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da962e9f-55d0-4391-9d27-f72c2f1d7179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.112187 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244122c2d3d84a15983aea49e09c8ee6', 'request_id': 'req-aab0c0de-7a96-4fae-b87f-0b9b412e2373'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:48.131929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-da962e9f-55d0-4391-9d27-f72c2f1d7179 None None] MFA Rules not processed for user `7ed01acc32554e3c8de586fb6d0474ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:48.133133 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-da962e9f-55d0-4391-9d27-f72c2f1d7179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:48.198186 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1367/2776] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:48.202558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da962e9f-55d0-4391-9d27-f72c2f1d7179 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.230761 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244122c2d3d84a15983aea49e09c8ee6', 'request_id': 'req-aab0c0de-7a96-4fae-b87f-0b9b412e2373'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:48.238228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244122c2d3d84a15983aea49e09c8ee6', 'request_id': 'req-aab0c0de-7a96-4fae-b87f-0b9b412e2373'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:48.252353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] The token cache is being invalidate because project 244122c2d3d84a15983aea49e09c8ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:48.252653 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:48.253430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-aab0c0de-7a96-4fae-b87f-0b9b412e2373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:48.255061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1410/2777] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:47 2022] DELETE /identity/v3/projects/244122c2d3d84a15983aea49e09c8ee6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:48.256352 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:48.259826 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e28c8-89b8-4918-a47e-201894d269d5 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.260116 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e28c8-89b8-4918-a47e-201894d269d5 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.260391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e28c8-89b8-4918-a47e-201894d269d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.269494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da962e9f-55d0-4391-9d27-f72c2f1d7179 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.275115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93167095-abfd-4607-8b14-6891ef34f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.276156 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93167095-abfd-4607-8b14-6891ef34f3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.276447 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93167095-abfd-4607-8b14-6891ef34f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.276720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93167095-abfd-4607-8b14-6891ef34f3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.277723 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93167095-abfd-4607-8b14-6891ef34f3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.279911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93167095-abfd-4607-8b14-6891ef34f3b5 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.281322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-ae0e28c8-89b8-4918-a47e-201894d269d5 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:48.282626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ae0e28c8-89b8-4918-a47e-201894d269d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:48.290586 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1411/2778] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:48.299543 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd8b18-6268-4fd0-be18-5aaece9c80b6 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.302031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd8b18-6268-4fd0-be18-5aaece9c80b6 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.302031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd8b18-6268-4fd0-be18-5aaece9c80b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.319657 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-17bd8b18-6268-4fd0-be18-5aaece9c80b6 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:48.320851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-17bd8b18-6268-4fd0-be18-5aaece9c80b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:48.329156 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1412/2779] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:48.333223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd8b18-6268-4fd0-be18-5aaece9c80b6 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.341924 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd8b18-6268-4fd0-be18-5aaece9c80b6 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.346692 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324ae15-377a-41e4-82c2-c45c95236438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.347256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324ae15-377a-41e4-82c2-c45c95236438 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.347534 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324ae15-377a-41e4-82c2-c45c95236438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.347808 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324ae15-377a-41e4-82c2-c45c95236438 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.348437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324ae15-377a-41e4-82c2-c45c95236438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:20:48.348737 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324ae15-377a-41e4-82c2-c45c95236438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.350335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324ae15-377a-41e4-82c2-c45c95236438 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.361803 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1413/2780] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:20:48.365900 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324ae15-377a-41e4-82c2-c45c95236438 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.375777 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324ae15-377a-41e4-82c2-c45c95236438 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.380368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe342e4-62a4-4331-b53d-4fb7a28d28f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.380937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe342e4-62a4-4331-b53d-4fb7a28d28f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.391721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe342e4-62a4-4331-b53d-4fb7a28d28f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.391721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe342e4-62a4-4331-b53d-4fb7a28d28f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.391721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe342e4-62a4-4331-b53d-4fb7a28d28f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.391721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe342e4-62a4-4331-b53d-4fb7a28d28f3 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.392109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1368/2781] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:48 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:20:48.394413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93167095-abfd-4607-8b14-6891ef34f3b5 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.396109 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-93167095-abfd-4607-8b14-6891ef34f3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:48.399863 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:48.460536 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93167095-abfd-4607-8b14-6891ef34f3b5 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.465157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49ccfd-12a7-4085-8278-1e42bb313505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.465753 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49ccfd-12a7-4085-8278-1e42bb313505 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.466029 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49ccfd-12a7-4085-8278-1e42bb313505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.466333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49ccfd-12a7-4085-8278-1e42bb313505 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.467001 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49ccfd-12a7-4085-8278-1e42bb313505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.469069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49ccfd-12a7-4085-8278-1e42bb313505 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.513550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1414/2782] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:48 2022] POST /identity/v3/projects => generated 357 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:48.517272 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe342e4-62a4-4331-b53d-4fb7a28d28f3 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.584376 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe342e4-62a4-4331-b53d-4fb7a28d28f3 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.588939 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23b1c8-a11a-4bd9-a674-2a951a40c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.589556 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b1c8-a11a-4bd9-a674-2a951a40c389 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.589835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b1c8-a11a-4bd9-a674-2a951a40c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.590107 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b1c8-a11a-4bd9-a674-2a951a40c389 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.590916 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23b1c8-a11a-4bd9-a674-2a951a40c389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.592857 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23b1c8-a11a-4bd9-a674-2a951a40c389 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.596490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1369/2783] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:48 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:48.600303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49ccfd-12a7-4085-8278-1e42bb313505 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.611313 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49ccfd-12a7-4085-8278-1e42bb313505 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.616169 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a06f07-fefe-4284-a43b-eae6968cc080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.616769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a06f07-fefe-4284-a43b-eae6968cc080 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.617046 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a06f07-fefe-4284-a43b-eae6968cc080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.617315 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a06f07-fefe-4284-a43b-eae6968cc080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.617956 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a06f07-fefe-4284-a43b-eae6968cc080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.619576 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a06f07-fefe-4284-a43b-eae6968cc080 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.630558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1370/2784] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:48.634481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a06f07-fefe-4284-a43b-eae6968cc080 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.644296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a06f07-fefe-4284-a43b-eae6968cc080 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.648918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bdac0-a1ab-4d26-b6af-390dcc11e18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.649535 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bdac0-a1ab-4d26-b6af-390dcc11e18c admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.649819 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bdac0-a1ab-4d26-b6af-390dcc11e18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.650095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bdac0-a1ab-4d26-b6af-390dcc11e18c admin admin] PATH_INFO: `/v3/projects/6896a8efa96d429ca0dcf9656fd27504/users/55a4e1bb3f9a493785b189452c8f5509/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.664537 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bdac0-a1ab-4d26-b6af-390dcc11e18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6896a8efa96d429ca0dcf9656fd27504, user_id=55a4e1bb3f9a493785b189452c8f5509, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.667249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bdac0-a1ab-4d26-b6af-390dcc11e18c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.693459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1415/2785] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:48 2022] POST /identity/v3/users => generated 279 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:20:48.697563 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23b1c8-a11a-4bd9-a674-2a951a40c389 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.707303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23b1c8-a11a-4bd9-a674-2a951a40c389 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.712041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5233b7-7a45-4369-8a6e-59433e92a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.712623 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5233b7-7a45-4369-8a6e-59433e92a173 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.712902 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5233b7-7a45-4369-8a6e-59433e92a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.713162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5233b7-7a45-4369-8a6e-59433e92a173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.713801 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5233b7-7a45-4369-8a6e-59433e92a173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.715393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5233b7-7a45-4369-8a6e-59433e92a173 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.725176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1416/2786] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:48.728961 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5233b7-7a45-4369-8a6e-59433e92a173 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.738969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5233b7-7a45-4369-8a6e-59433e92a173 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.743589 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060234c-4916-45ea-96bb-1d44c8f05c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.744212 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060234c-4916-45ea-96bb-1d44c8f05c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.744492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060234c-4916-45ea-96bb-1d44c8f05c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.744767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060234c-4916-45ea-96bb-1d44c8f05c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.745394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060234c-4916-45ea-96bb-1d44c8f05c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.746983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060234c-4916-45ea-96bb-1d44c8f05c4c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.757890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1417/2787] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:48.761947 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060234c-4916-45ea-96bb-1d44c8f05c4c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.771387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060234c-4916-45ea-96bb-1d44c8f05c4c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.776749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae14be3-d46c-4f0d-a31c-9f2b7e421223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.777403 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14be3-d46c-4f0d-a31c-9f2b7e421223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.777688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14be3-d46c-4f0d-a31c-9f2b7e421223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.777969 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14be3-d46c-4f0d-a31c-9f2b7e421223 admin admin] PATH_INFO: `/v3/projects/bc2b2111ef5947f18b5881da2dd8749a/users/a20acc2ad72c4e1c9aa2a277fb44f5a9/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.779171 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1371/2788] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:48 2022] PUT /identity/v3/projects/6896a8efa96d429ca0dcf9656fd27504/users/55a4e1bb3f9a493785b189452c8f5509/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:48.785650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bdac0-a1ab-4d26-b6af-390dcc11e18c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.792908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae14be3-d46c-4f0d-a31c-9f2b7e421223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2b2111ef5947f18b5881da2dd8749a, user_id=a20acc2ad72c4e1c9aa2a277fb44f5a9, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.795599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae14be3-d46c-4f0d-a31c-9f2b7e421223 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.849338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bdac0-a1ab-4d26-b6af-390dcc11e18c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.853911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f085cb-5d98-42ac-9f30-504140e98fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.854543 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f085cb-5d98-42ac-9f30-504140e98fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.854820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f085cb-5d98-42ac-9f30-504140e98fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.855092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f085cb-5d98-42ac-9f30-504140e98fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.855742 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f085cb-5d98-42ac-9f30-504140e98fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.857294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f085cb-5d98-42ac-9f30-504140e98fa8 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.865868 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1418/2789] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:48 2022] PUT /identity/v3/projects/bc2b2111ef5947f18b5881da2dd8749a/users/a20acc2ad72c4e1c9aa2a277fb44f5a9/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:48.871038 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1372/2790] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:20:48.875773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae14be3-d46c-4f0d-a31c-9f2b7e421223 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.882267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc70d-92ab-41dd-8c9b-5bb52067e4c2 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.882560 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc70d-92ab-41dd-8c9b-5bb52067e4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.882834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc70d-92ab-41dd-8c9b-5bb52067e4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.911149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-3ccbc70d-92ab-41dd-8c9b-5bb52067e4c2 None None] MFA Rules not processed for user `a20acc2ad72c4e1c9aa2a277fb44f5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:48.912409 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-3ccbc70d-92ab-41dd-8c9b-5bb52067e4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:48.925942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:48.941864 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae14be3-d46c-4f0d-a31c-9f2b7e421223 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:48.946658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc1987-3ed1-432c-a51a-0ccd3367edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:48.947327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc1987-3ed1-432c-a51a-0ccd3367edcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.947727 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc1987-3ed1-432c-a51a-0ccd3367edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.948010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc1987-3ed1-432c-a51a-0ccd3367edcb admin admin] PATH_INFO: `/v3/projects/6896a8efa96d429ca0dcf9656fd27504/users/55a4e1bb3f9a493785b189452c8f5509/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.949965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc1987-3ed1-432c-a51a-0ccd3367edcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6896a8efa96d429ca0dcf9656fd27504, user_id=55a4e1bb3f9a493785b189452c8f5509, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:48.952688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc1987-3ed1-432c-a51a-0ccd3367edcb admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:48.963525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1419/2791] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:48 2022] PUT /identity/v3/projects/6896a8efa96d429ca0dcf9656fd27504/users/55a4e1bb3f9a493785b189452c8f5509/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:48.975362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919347-ac46-4333-8c3f-8ffa1c8509da None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:48.975649 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919347-ac46-4333-8c3f-8ffa1c8509da None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:48.975927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919347-ac46-4333-8c3f-8ffa1c8509da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:48.982789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1373/2792] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:48.987839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc70d-92ab-41dd-8c9b-5bb52067e4c2 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:48.998163 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc70d-92ab-41dd-8c9b-5bb52067e4c2 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:49.005238 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f3919347-ac46-4333-8c3f-8ffa1c8509da None None] MFA Rules not processed for user `55a4e1bb3f9a493785b189452c8f5509`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:49.006497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f3919347-ac46-4333-8c3f-8ffa1c8509da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:49.024846 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:49.054730 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f5aa9-9225-4bbd-a2dd-7cc273dde6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:49.055360 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f5aa9-9225-4bbd-a2dd-7cc273dde6da admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:49.055633 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f5aa9-9225-4bbd-a2dd-7cc273dde6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:49.055901 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f5aa9-9225-4bbd-a2dd-7cc273dde6da admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:49.056524 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f5aa9-9225-4bbd-a2dd-7cc273dde6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:49.058485 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f5aa9-9225-4bbd-a2dd-7cc273dde6da admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:49.075615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1420/2793] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:49.087221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3919347-ac46-4333-8c3f-8ffa1c8509da None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:49.088591 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f3919347-ac46-4333-8c3f-8ffa1c8509da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:49.144713 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3919347-ac46-4333-8c3f-8ffa1c8509da None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:49.148170 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4e4c8-9102-4ba7-a8df-71498fa0c00f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:49.148772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4e4c8-9102-4ba7-a8df-71498fa0c00f service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:49.149050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4e4c8-9102-4ba7-a8df-71498fa0c00f service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:49.149321 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4e4c8-9102-4ba7-a8df-71498fa0c00f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:49.158295 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4e4c8-9102-4ba7-a8df-71498fa0c00f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:49.159704 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4e4c8-9102-4ba7-a8df-71498fa0c00f service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:49.168833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1421/2794] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:20:49.180924 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1374/2795] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:48 2022] POST /identity/v3/projects => generated 357 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:20:49.184928 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4e4c8-9102-4ba7-a8df-71498fa0c00f service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:49.197130 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4e4c8-9102-4ba7-a8df-71498fa0c00f service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:49.255188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8146-2dc2-44f9-ae35-81ff382d547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:49.255812 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8146-2dc2-44f9-ae35-81ff382d547d admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:49.256080 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8146-2dc2-44f9-ae35-81ff382d547d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:49.256353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8146-2dc2-44f9-ae35-81ff382d547d admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:49.256977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b8146-2dc2-44f9-ae35-81ff382d547d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:49.258932 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b8146-2dc2-44f9-ae35-81ff382d547d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:49.285724 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f5aa9-9225-4bbd-a2dd-7cc273dde6da admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:49.287498 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-474f5aa9-9225-4bbd-a2dd-7cc273dde6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:49.346596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f5aa9-9225-4bbd-a2dd-7cc273dde6da admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:49.350232 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5625b3b-df95-49e0-a5b5-fb2acf0cb422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:49.350844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5625b3b-df95-49e0-a5b5-fb2acf0cb422 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:49.351123 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5625b3b-df95-49e0-a5b5-fb2acf0cb422 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:49.351406 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5625b3b-df95-49e0-a5b5-fb2acf0cb422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:49.353148 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-f5625b3b-df95-49e0-a5b5-fb2acf0cb422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:49.362450 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1422/2796] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:49 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:20:49.366429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8146-2dc2-44f9-ae35-81ff382d547d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:49.376406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8146-2dc2-44f9-ae35-81ff382d547d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:49.381048 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68b8eb-5229-4c6e-8a08-1fb2e08506da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:49.381631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b8eb-5229-4c6e-8a08-1fb2e08506da admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:49.381910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b8eb-5229-4c6e-8a08-1fb2e08506da admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:49.382180 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b8eb-5229-4c6e-8a08-1fb2e08506da admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:49.382840 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68b8eb-5229-4c6e-8a08-1fb2e08506da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:49.384413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68b8eb-5229-4c6e-8a08-1fb2e08506da admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:49.398169 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1423/2797] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:20:49.399077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68b8eb-5229-4c6e-8a08-1fb2e08506da admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:49.409213 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68b8eb-5229-4c6e-8a08-1fb2e08506da admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:49.412302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:49.414525 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7e472-5834-4b2c-98c9-d3c5b9592091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:49.414765 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5625b3b-df95-49e0-a5b5-fb2acf0cb422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:49.415191 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7e472-5834-4b2c-98c9-d3c5b9592091 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:49.415502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7e472-5834-4b2c-98c9-d3c5b9592091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:49.415792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7e472-5834-4b2c-98c9-d3c5b9592091 admin admin] PATH_INFO: `/v3/projects/453b415f6aec436e859a190a3bf6ad3c/users/6aa1084cca2847cbb845921bfc5c82cb/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:49.416540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5625b3b-df95-49e0-a5b5-fb2acf0cb422 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:49.426023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1375/2798] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:49.432555 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7e472-5834-4b2c-98c9-d3c5b9592091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453b415f6aec436e859a190a3bf6ad3c, user_id=6aa1084cca2847cbb845921bfc5c82cb, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:49.435313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7e472-5834-4b2c-98c9-d3c5b9592091 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:49.522361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1424/2799] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:49 2022] PUT /identity/v3/projects/453b415f6aec436e859a190a3bf6ad3c/users/6aa1084cca2847cbb845921bfc5c82cb/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:49.526425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5625b3b-df95-49e0-a5b5-fb2acf0cb422 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:49.537337 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5625b3b-df95-49e0-a5b5-fb2acf0cb422 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:49.594550 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05efd11-b987-478b-afb4-9535bc05d264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:49.595280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05efd11-b987-478b-afb4-9535bc05d264 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:49.595559 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05efd11-b987-478b-afb4-9535bc05d264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:49.595834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05efd11-b987-478b-afb4-9535bc05d264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:49.596477 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05efd11-b987-478b-afb4-9535bc05d264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:49.598054 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05efd11-b987-478b-afb4-9535bc05d264 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:49.611602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1376/2800] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:20:49.613804 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7e472-5834-4b2c-98c9-d3c5b9592091 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:49.624765 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7e472-5834-4b2c-98c9-d3c5b9592091 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:49.630986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0704278-7a7a-452b-aa8b-b9040b0dbce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:49.631685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704278-7a7a-452b-aa8b-b9040b0dbce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:49.632002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704278-7a7a-452b-aa8b-b9040b0dbce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:49.632431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704278-7a7a-452b-aa8b-b9040b0dbce4 admin admin] PATH_INFO: `/v3/projects/453b415f6aec436e859a190a3bf6ad3c/users/6aa1084cca2847cbb845921bfc5c82cb/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:49.634412 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0704278-7a7a-452b-aa8b-b9040b0dbce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453b415f6aec436e859a190a3bf6ad3c, user_id=6aa1084cca2847cbb845921bfc5c82cb, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:49.640577 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0704278-7a7a-452b-aa8b-b9040b0dbce4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:49.643815 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:49.648544 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1425/2801] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:49 2022] PUT /identity/v3/projects/453b415f6aec436e859a190a3bf6ad3c/users/6aa1084cca2847cbb845921bfc5c82cb/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:49.659007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f786e-bc5f-4f55-aac9-65c246b27bb9 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:49.659294 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f786e-bc5f-4f55-aac9-65c246b27bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:49.659568 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f786e-bc5f-4f55-aac9-65c246b27bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:49.689990 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ac6f786e-bc5f-4f55-aac9-65c246b27bb9 None None] MFA Rules not processed for user `6aa1084cca2847cbb845921bfc5c82cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:49.691512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ac6f786e-bc5f-4f55-aac9-65c246b27bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:49.761962 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1377/2802] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:49.773429 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0704278-7a7a-452b-aa8b-b9040b0dbce4 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:49.829198 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0704278-7a7a-452b-aa8b-b9040b0dbce4 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:49.833471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0e799-6d84-476c-a968-583c1b0afaf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:49.834078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0e799-6d84-476c-a968-583c1b0afaf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:49.834399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0e799-6d84-476c-a968-583c1b0afaf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:49.834673 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0e799-6d84-476c-a968-583c1b0afaf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:49.844463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0e799-6d84-476c-a968-583c1b0afaf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:49.845872 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0e799-6d84-476c-a968-583c1b0afaf0 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:49.855211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1426/2803] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:50.085129 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f786e-bc5f-4f55-aac9-65c246b27bb9 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:50.095635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f786e-bc5f-4f55-aac9-65c246b27bb9 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:50.099430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3a55c-e0be-41c9-b82e-95e18e78ae2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:50.100051 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3a55c-e0be-41c9-b82e-95e18e78ae2a service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:50.100438 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3a55c-e0be-41c9-b82e-95e18e78ae2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:50.100635 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3a55c-e0be-41c9-b82e-95e18e78ae2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:50.157841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3a55c-e0be-41c9-b82e-95e18e78ae2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:50.159403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3a55c-e0be-41c9-b82e-95e18e78ae2a service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:50.168317 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1378/2804] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:53.788486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0e799-6d84-476c-a968-583c1b0afaf0 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:53.864558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0e799-6d84-476c-a968-583c1b0afaf0 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:53.864558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:53.864558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:53.864558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:53.865435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] PATH_INFO: `/v3/users/b07b314d33084213b98e51833a2645cd` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:53.865435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07b314d33084213b98e51833a2645cd)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:53.865435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:54.203734 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07b314d33084213b98e51833a2645cd'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:54.204396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07b314d33084213b98e51833a2645cd'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:54.211430 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07b314d33084213b98e51833a2645cd'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:54.224786 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07b314d33084213b98e51833a2645cd'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:54.225463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07b314d33084213b98e51833a2645cd'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:54.333626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1427/2805] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:53 2022] DELETE /identity/v3/users/b07b314d33084213b98e51833a2645cd => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:54.338136 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e989e-be2e-4ac0-a045-60f7de461fbc None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:54.338678 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e989e-be2e-4ac0-a045-60f7de461fbc None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:54.338796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e989e-be2e-4ac0-a045-60f7de461fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:54.358464 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-c00e989e-be2e-4ac0-a045-60f7de461fbc None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:54.360555 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c00e989e-be2e-4ac0-a045-60f7de461fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:54.369653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=100 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:54.419817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1379/2806] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:54.430553 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:54.431908 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:54.459339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:54.491005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97945a5-b0aa-4533-98da-b449c4ae589b admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:54.494610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dc4ca-a1b5-432b-aaff-447e2af51b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:54.495221 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc4ca-a1b5-432b-aaff-447e2af51b43 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:54.495502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc4ca-a1b5-432b-aaff-447e2af51b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:54.495778 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc4ca-a1b5-432b-aaff-447e2af51b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:54.504846 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812dc4ca-a1b5-432b-aaff-447e2af51b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:54.506301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812dc4ca-a1b5-432b-aaff-447e2af51b43 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:54.516192 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1428/2807] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:20:54.959184 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e989e-be2e-4ac0-a045-60f7de461fbc None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:54.960925 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c00e989e-be2e-4ac0-a045-60f7de461fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:55.009042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e989e-be2e-4ac0-a045-60f7de461fbc None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:55.014788 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:55.016481 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:55.016926 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:55.017461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] PATH_INFO: `/v3/projects/f38f1ba9066d41968b5528df6235311e` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:55.019146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38f1ba9066d41968b5528df6235311e)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:55.021320 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:55.151218 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38f1ba9066d41968b5528df6235311e', 'request_id': 'req-9ec12229-73c1-4362-9b9c-32142ab4d544'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:55.158807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38f1ba9066d41968b5528df6235311e', 'request_id': 'req-9ec12229-73c1-4362-9b9c-32142ab4d544'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:55.164272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38f1ba9066d41968b5528df6235311e', 'request_id': 'req-9ec12229-73c1-4362-9b9c-32142ab4d544'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:55.258392 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] The token cache is being invalidate because project f38f1ba9066d41968b5528df6235311e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:55.258545 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:55.259050 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:55.260567 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1380/2808] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:54 2022] DELETE /identity/v3/projects/f38f1ba9066d41968b5528df6235311e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:55.264658 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dc4ca-a1b5-432b-aaff-447e2af51b43 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:55.275519 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dc4ca-a1b5-432b-aaff-447e2af51b43 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:55.339196 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:55.344432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:55.344432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:55.344432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] PATH_INFO: `/v3/users/7ed01acc32554e3c8de586fb6d0474ef` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:55.344432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed01acc32554e3c8de586fb6d0474ef)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:55.344432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:55.627246 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed01acc32554e3c8de586fb6d0474ef'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:55.627912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed01acc32554e3c8de586fb6d0474ef'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:55.635112 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed01acc32554e3c8de586fb6d0474ef'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:55.652034 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed01acc32554e3c8de586fb6d0474ef'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:55.652927 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed01acc32554e3c8de586fb6d0474ef'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:55.766800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1429/2809] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:55 2022] DELETE /identity/v3/users/7ed01acc32554e3c8de586fb6d0474ef => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:20:56.208839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:56.208839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:56.218395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec12229-73c1-4362-9b9c-32142ab4d544 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:56.282101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:56.282756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:56.283031 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:56.283301 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] PATH_INFO: `/v3/projects/f308abd562764f77b31d05997ba5eb60` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:56.284415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f308abd562764f77b31d05997ba5eb60)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:56.286476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:56.426027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:56.432056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f308abd562764f77b31d05997ba5eb60', 'request_id': 'req-c4026f1f-3499-4951-9dae-83779e322048'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:56.439140 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f308abd562764f77b31d05997ba5eb60', 'request_id': 'req-c4026f1f-3499-4951-9dae-83779e322048'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:56.445273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f308abd562764f77b31d05997ba5eb60', 'request_id': 'req-c4026f1f-3499-4951-9dae-83779e322048'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:56.550688 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] The token cache is being invalidate because project f308abd562764f77b31d05997ba5eb60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:56.550907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:56.551532 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:56.553042 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1381/2810] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:56 2022] DELETE /identity/v3/projects/f308abd562764f77b31d05997ba5eb60 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:56.557100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:56.558548 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:56.572127 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff9f05-9ab8-427c-abbd-5c4287513888 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:56.614005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:56.629387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:56.630054 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:56.630362 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:56.630638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] PATH_INFO: `/v3/users/55a4e1bb3f9a493785b189452c8f5509` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:56.631772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a4e1bb3f9a493785b189452c8f5509)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:56.633681 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:56.807317 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a4e1bb3f9a493785b189452c8f5509'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:56.808055 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a4e1bb3f9a493785b189452c8f5509'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:56.816263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a4e1bb3f9a493785b189452c8f5509'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:56.828395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a4e1bb3f9a493785b189452c8f5509'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:56.829575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c6c8a8de-b811-4335-b752-17180d90dad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a4e1bb3f9a493785b189452c8f5509'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:56.922393 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1430/2811] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:20:56 2022] DELETE /identity/v3/users/55a4e1bb3f9a493785b189452c8f5509 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:57.397977 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:57.399638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:57.415034 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026f1f-3499-4951-9dae-83779e322048 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:57.474738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:57.475391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:57.475668 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:57.475939 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] PATH_INFO: `/v3/projects/6896a8efa96d429ca0dcf9656fd27504` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:57.477055 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6896a8efa96d429ca0dcf9656fd27504)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:57.478984 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:57.648132 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6896a8efa96d429ca0dcf9656fd27504', 'request_id': 'req-4925f5a3-f28f-42b4-b933-aa29a8444a87'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:57.654200 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6896a8efa96d429ca0dcf9656fd27504', 'request_id': 'req-4925f5a3-f28f-42b4-b933-aa29a8444a87'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:57.660101 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6896a8efa96d429ca0dcf9656fd27504', 'request_id': 'req-4925f5a3-f28f-42b4-b933-aa29a8444a87'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:57.755064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] The token cache is being invalidate because project 6896a8efa96d429ca0dcf9656fd27504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:20:57.755390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:57.756100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-4925f5a3-f28f-42b4-b933-aa29a8444a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:20:57.757722 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1382/2812] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:20:57 2022] DELETE /identity/v3/projects/6896a8efa96d429ca0dcf9656fd27504 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:57.763621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2a95e-1dcc-4c7d-91d3-11161df6e326 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:57.764088 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2a95e-1dcc-4c7d-91d3-11161df6e326 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:57.764186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2a95e-1dcc-4c7d-91d3-11161df6e326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:57.784219 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-62b2a95e-1dcc-4c7d-91d3-11161df6e326 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:57.785428 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-62b2a95e-1dcc-4c7d-91d3-11161df6e326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:57.846721 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1431/2813] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:57.855164 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a39c8-788d-49c6-a8cd-814ab8ecfe7b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:57.855459 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a39c8-788d-49c6-a8cd-814ab8ecfe7b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:57.855715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a39c8-788d-49c6-a8cd-814ab8ecfe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:57.877209 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-476a39c8-788d-49c6-a8cd-814ab8ecfe7b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:57.878433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-476a39c8-788d-49c6-a8cd-814ab8ecfe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:57.886341 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1383/2814] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:20:57.890523 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2a95e-1dcc-4c7d-91d3-11161df6e326 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:57.900161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2a95e-1dcc-4c7d-91d3-11161df6e326 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:57.904584 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90495aec-6d4b-46e9-8506-75c84925452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:57.905186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90495aec-6d4b-46e9-8506-75c84925452c admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:57.905467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90495aec-6d4b-46e9-8506-75c84925452c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:57.905741 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90495aec-6d4b-46e9-8506-75c84925452c admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:57.906492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90495aec-6d4b-46e9-8506-75c84925452c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:20:57.906793 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90495aec-6d4b-46e9-8506-75c84925452c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:57.908372 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90495aec-6d4b-46e9-8506-75c84925452c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:57.919946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1432/2815] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:20:57.924917 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a39c8-788d-49c6-a8cd-814ab8ecfe7b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:57.934078 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a39c8-788d-49c6-a8cd-814ab8ecfe7b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:57.939587 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a91bc-1163-4021-99d3-3b626d7d87ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:57.940174 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a91bc-1163-4021-99d3-3b626d7d87ef admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:57.940450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a91bc-1163-4021-99d3-3b626d7d87ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:57.940976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a91bc-1163-4021-99d3-3b626d7d87ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:57.941597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a91bc-1163-4021-99d3-3b626d7d87ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:57.943494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a91bc-1163-4021-99d3-3b626d7d87ef admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:58.049789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1384/2816] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:20:57 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:20:58.053819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90495aec-6d4b-46e9-8506-75c84925452c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:58.064496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90495aec-6d4b-46e9-8506-75c84925452c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:58.114431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:58.123685 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209367fc-90d1-4541-9e4f-6c2ec21c4863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:58.124335 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209367fc-90d1-4541-9e4f-6c2ec21c4863 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:58.124811 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209367fc-90d1-4541-9e4f-6c2ec21c4863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:58.125084 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209367fc-90d1-4541-9e4f-6c2ec21c4863 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:58.125715 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209367fc-90d1-4541-9e4f-6c2ec21c4863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:58.127641 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209367fc-90d1-4541-9e4f-6c2ec21c4863 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:58.213535 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1433/2817] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:20:58 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:20:58.217638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a91bc-1163-4021-99d3-3b626d7d87ef admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:58.229863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a91bc-1163-4021-99d3-3b626d7d87ef admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:58.238116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7f669-dc1e-4a98-8721-2f89b6b661f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:58.238800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f669-dc1e-4a98-8721-2f89b6b661f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:58.239091 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f669-dc1e-4a98-8721-2f89b6b661f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:58.239371 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f669-dc1e-4a98-8721-2f89b6b661f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:58.240096 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7f669-dc1e-4a98-8721-2f89b6b661f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:58.241623 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7f669-dc1e-4a98-8721-2f89b6b661f7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:58.255927 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1385/2818] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:20:58.257154 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209367fc-90d1-4541-9e4f-6c2ec21c4863 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:58.268796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209367fc-90d1-4541-9e4f-6c2ec21c4863 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:58.273567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7100111-4817-4d58-b52c-25f9b94d956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:58.274173 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100111-4817-4d58-b52c-25f9b94d956d admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:58.274481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100111-4817-4d58-b52c-25f9b94d956d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:58.274754 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100111-4817-4d58-b52c-25f9b94d956d admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:58.275390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7100111-4817-4d58-b52c-25f9b94d956d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:58.276959 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7100111-4817-4d58-b52c-25f9b94d956d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:58.287627 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1434/2819] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:20:58.291836 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7f669-dc1e-4a98-8721-2f89b6b661f7 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:58.303073 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7f669-dc1e-4a98-8721-2f89b6b661f7 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:58.308007 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18c6fd-febd-4942-ade0-6f3da7862529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:58.308664 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c6fd-febd-4942-ade0-6f3da7862529 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:58.308964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c6fd-febd-4942-ade0-6f3da7862529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:58.309229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18c6fd-febd-4942-ade0-6f3da7862529 admin admin] PATH_INFO: `/v3/projects/01e40ba3e265449db0af4742eec2ff4b/users/d48362e21411461995f87288aede9a9f/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:58.325243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18c6fd-febd-4942-ade0-6f3da7862529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e40ba3e265449db0af4742eec2ff4b, user_id=d48362e21411461995f87288aede9a9f, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:58.330903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18c6fd-febd-4942-ade0-6f3da7862529 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:58.335026 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:20:58.414617 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1386/2820] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:20:58 2022] PUT /identity/v3/projects/01e40ba3e265449db0af4742eec2ff4b/users/d48362e21411461995f87288aede9a9f/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:20:58.427531 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5ee27-694e-4093-8d00-f646421c0576 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:58.427821 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5ee27-694e-4093-8d00-f646421c0576 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:58.428121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5ee27-694e-4093-8d00-f646421c0576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:58.458291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-60f5ee27-694e-4093-8d00-f646421c0576 None None] MFA Rules not processed for user `d48362e21411461995f87288aede9a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:20:58.459561 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-60f5ee27-694e-4093-8d00-f646421c0576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:58.525635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1435/2821] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:20:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:20:58.536975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18c6fd-febd-4942-ade0-6f3da7862529 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:20:58.538769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-bf18c6fd-febd-4942-ade0-6f3da7862529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:20:58.596906 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18c6fd-febd-4942-ade0-6f3da7862529 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:20:58.600743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766942-444c-43a7-8e43-87c69a61aec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:20:58.601355 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766942-444c-43a7-8e43-87c69a61aec9 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:20:58.601637 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766942-444c-43a7-8e43-87c69a61aec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:20:58.602022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766942-444c-43a7-8e43-87c69a61aec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:20:58.611369 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766942-444c-43a7-8e43-87c69a61aec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:20:58.613403 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766942-444c-43a7-8e43-87c69a61aec9 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:20:58.623814 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1387/2822] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:20:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:02.799022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5ee27-694e-4093-8d00-f646421c0576 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:02.861946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5ee27-694e-4093-8d00-f646421c0576 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:02.866502 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:02.867134 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:02.867414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:02.867688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] PATH_INFO: `/v3/users/d48362e21411461995f87288aede9a9f` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:02.868865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48362e21411461995f87288aede9a9f)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:02.870757 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:03.045368 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48362e21411461995f87288aede9a9f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:03.046025 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48362e21411461995f87288aede9a9f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:03.053767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48362e21411461995f87288aede9a9f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:03.058264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:03.067353 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48362e21411461995f87288aede9a9f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:03.068022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48362e21411461995f87288aede9a9f'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:03.144800 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1436/2823] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:21:02 2022] DELETE /identity/v3/users/d48362e21411461995f87288aede9a9f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:03.149165 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f951485-5650-4f31-ad04-72ab28f8ab80 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:03.149647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f951485-5650-4f31-ad04-72ab28f8ab80 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:03.149760 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f951485-5650-4f31-ad04-72ab28f8ab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:03.168565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-9f951485-5650-4f31-ad04-72ab28f8ab80 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:03.169780 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9f951485-5650-4f31-ad04-72ab28f8ab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:03.233188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1388/2824] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:03.243664 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:03.245261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:03.306230 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15f20e-4293-4275-845d-10c9102522c9 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:03.310701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3520763-f3d1-41a5-b47f-5bfcfa8de54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:03.311649 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3520763-f3d1-41a5-b47f-5bfcfa8de54e service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:03.312121 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3520763-f3d1-41a5-b47f-5bfcfa8de54e service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:03.312599 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3520763-f3d1-41a5-b47f-5bfcfa8de54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:03.321945 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3520763-f3d1-41a5-b47f-5bfcfa8de54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:03.323383 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3520763-f3d1-41a5-b47f-5bfcfa8de54e service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:03.335063 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1437/2825] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:03.798601 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f951485-5650-4f31-ad04-72ab28f8ab80 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:03.800147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-9f951485-5650-4f31-ad04-72ab28f8ab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:03.812322 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f951485-5650-4f31-ad04-72ab28f8ab80 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:03.817521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:03.818159 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:03.818470 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:03.818745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] PATH_INFO: `/v3/projects/01e40ba3e265449db0af4742eec2ff4b` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:03.819876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e40ba3e265449db0af4742eec2ff4b)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:03.821797 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:03.936311 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e40ba3e265449db0af4742eec2ff4b', 'request_id': 'req-6f6e1b24-9b66-4349-9eea-5156e543b44a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:03.943383 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e40ba3e265449db0af4742eec2ff4b', 'request_id': 'req-6f6e1b24-9b66-4349-9eea-5156e543b44a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:03.949041 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e40ba3e265449db0af4742eec2ff4b', 'request_id': 'req-6f6e1b24-9b66-4349-9eea-5156e543b44a'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:04.029229 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] The token cache is being invalidate because project 01e40ba3e265449db0af4742eec2ff4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:21:04.029544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:04.030157 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-6f6e1b24-9b66-4349-9eea-5156e543b44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:04.032839 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1389/2826] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:21:03 2022] DELETE /identity/v3/projects/01e40ba3e265449db0af4742eec2ff4b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:04.038248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be24cd-cd9c-4e89-9d4a-5db809bdc19b None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:04.038248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be24cd-cd9c-4e89-9d4a-5db809bdc19b None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:04.038809 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be24cd-cd9c-4e89-9d4a-5db809bdc19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:04.061050 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-f6be24cd-cd9c-4e89-9d4a-5db809bdc19b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:04.062384 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f6be24cd-cd9c-4e89-9d4a-5db809bdc19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:04.122303 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1438/2827] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:04.130907 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfeb20-60c8-4935-b71b-85a2dce5dce8 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:04.131195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfeb20-60c8-4935-b71b-85a2dce5dce8 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:04.131473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfeb20-60c8-4935-b71b-85a2dce5dce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:04.156797 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-96bfeb20-60c8-4935-b71b-85a2dce5dce8 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:04.160945 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-96bfeb20-60c8-4935-b71b-85a2dce5dce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:04.170255 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1390/2828] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:04.174630 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be24cd-cd9c-4e89-9d4a-5db809bdc19b None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:04.195009 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be24cd-cd9c-4e89-9d4a-5db809bdc19b None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:04.199573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c760393-98ca-4ddd-8cf8-d992aaec3e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:04.200183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c760393-98ca-4ddd-8cf8-d992aaec3e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:04.200468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c760393-98ca-4ddd-8cf8-d992aaec3e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:04.200745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c760393-98ca-4ddd-8cf8-d992aaec3e93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:04.201391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c760393-98ca-4ddd-8cf8-d992aaec3e93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:21:04.201699 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c760393-98ca-4ddd-8cf8-d992aaec3e93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:04.203865 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c760393-98ca-4ddd-8cf8-d992aaec3e93 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:04.216165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1439/2829] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:21:04.220634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfeb20-60c8-4935-b71b-85a2dce5dce8 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:04.229728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfeb20-60c8-4935-b71b-85a2dce5dce8 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:04.234508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb56337-8fc0-4f4a-bb8b-90a2b3b91d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:04.235095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56337-8fc0-4f4a-bb8b-90a2b3b91d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:04.235373 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56337-8fc0-4f4a-bb8b-90a2b3b91d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:04.235641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56337-8fc0-4f4a-bb8b-90a2b3b91d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:04.236262 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb56337-8fc0-4f4a-bb8b-90a2b3b91d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:04.238127 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb56337-8fc0-4f4a-bb8b-90a2b3b91d84 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:04.253251 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:04.375268 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1391/2830] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:21:04 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:04.379573 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c760393-98ca-4ddd-8cf8-d992aaec3e93 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:04.389783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c760393-98ca-4ddd-8cf8-d992aaec3e93 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:04.452770 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2c0b2-8df9-4755-b777-cbd57e36f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:04.453434 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2c0b2-8df9-4755-b777-cbd57e36f345 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:04.453720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2c0b2-8df9-4755-b777-cbd57e36f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:04.453995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2c0b2-8df9-4755-b777-cbd57e36f345 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:04.454670 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2c0b2-8df9-4755-b777-cbd57e36f345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:04.456617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2c0b2-8df9-4755-b777-cbd57e36f345 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:04.523416 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:04.529195 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1440/2831] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:21:04 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:04.533427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb56337-8fc0-4f4a-bb8b-90a2b3b91d84 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:04.543849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb56337-8fc0-4f4a-bb8b-90a2b3b91d84 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:04.549284 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c589c15-5737-4ba9-9f70-446484e2ce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:04.549876 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c589c15-5737-4ba9-9f70-446484e2ce13 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:04.550151 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c589c15-5737-4ba9-9f70-446484e2ce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:04.550458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c589c15-5737-4ba9-9f70-446484e2ce13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:04.551099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c589c15-5737-4ba9-9f70-446484e2ce13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:04.552672 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c589c15-5737-4ba9-9f70-446484e2ce13 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:04.563711 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1392/2832] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:04.568424 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2c0b2-8df9-4755-b777-cbd57e36f345 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:04.578869 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2c0b2-8df9-4755-b777-cbd57e36f345 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:04.584516 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42c59a-f3a6-43c6-a1d1-5078f622ac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:04.585162 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42c59a-f3a6-43c6-a1d1-5078f622ac10 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:04.592493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42c59a-f3a6-43c6-a1d1-5078f622ac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:04.592493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42c59a-f3a6-43c6-a1d1-5078f622ac10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:04.592493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42c59a-f3a6-43c6-a1d1-5078f622ac10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:04.592493 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42c59a-f3a6-43c6-a1d1-5078f622ac10 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:04.599110 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1441/2833] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:04.603233 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c589c15-5737-4ba9-9f70-446484e2ce13 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:04.614466 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c589c15-5737-4ba9-9f70-446484e2ce13 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:04.619225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18892e7-5270-46bc-a12d-06505acd6aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:04.619953 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18892e7-5270-46bc-a12d-06505acd6aed admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:04.620181 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18892e7-5270-46bc-a12d-06505acd6aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:04.620458 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18892e7-5270-46bc-a12d-06505acd6aed admin admin] PATH_INFO: `/v3/projects/a8f9f28576da48c38276481b06b40594/users/a170f59c028942409ea0ccdb5aefebde/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:04.635887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18892e7-5270-46bc-a12d-06505acd6aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f9f28576da48c38276481b06b40594, user_id=a170f59c028942409ea0ccdb5aefebde, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:04.638583 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18892e7-5270-46bc-a12d-06505acd6aed admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:04.710122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1393/2834] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:21:04 2022] PUT /identity/v3/projects/a8f9f28576da48c38276481b06b40594/users/a170f59c028942409ea0ccdb5aefebde/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:04.720686 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866e708-7ffc-41ee-a2ca-7697dbca8634 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:04.720977 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866e708-7ffc-41ee-a2ca-7697dbca8634 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:04.721678 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866e708-7ffc-41ee-a2ca-7697dbca8634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:04.752539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9866e708-7ffc-41ee-a2ca-7697dbca8634 None None] MFA Rules not processed for user `a170f59c028942409ea0ccdb5aefebde`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:04.753890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9866e708-7ffc-41ee-a2ca-7697dbca8634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:04.826037 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1442/2835] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:04.838807 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18892e7-5270-46bc-a12d-06505acd6aed admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:04.840521 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e18892e7-5270-46bc-a12d-06505acd6aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:04.922849 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18892e7-5270-46bc-a12d-06505acd6aed admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:04.927177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6be506-9a93-4921-a8bb-61819c279c83 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bdd5f0b3bc4c099c0d34b3b7c3f3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:04.927812 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be506-9a93-4921-a8bb-61819c279c83 service glance] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:04.928098 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be506-9a93-4921-a8bb-61819c279c83 service glance] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:04.928374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be506-9a93-4921-a8bb-61819c279c83 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:04.937273 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6be506-9a93-4921-a8bb-61819c279c83 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:04.938752 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6be506-9a93-4921-a8bb-61819c279c83 service glance] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:04.947994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1394/2836] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:09.589355 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866e708-7ffc-41ee-a2ca-7697dbca8634 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:09.591392 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9866e708-7ffc-41ee-a2ca-7697dbca8634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:09.662463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866e708-7ffc-41ee-a2ca-7697dbca8634 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:09.667773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:09.668463 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:09.668749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:09.669026 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] PATH_INFO: `/v3/users/a20acc2ad72c4e1c9aa2a277fb44f5a9` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:09.670326 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20acc2ad72c4e1c9aa2a277fb44f5a9)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:09.672796 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:09.858279 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20acc2ad72c4e1c9aa2a277fb44f5a9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:09.859551 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20acc2ad72c4e1c9aa2a277fb44f5a9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:09.866682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20acc2ad72c4e1c9aa2a277fb44f5a9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:09.879456 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20acc2ad72c4e1c9aa2a277fb44f5a9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:09.880128 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20acc2ad72c4e1c9aa2a277fb44f5a9'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:09.883724 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:09.990884 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1443/2837] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:21:09 2022] DELETE /identity/v3/users/a20acc2ad72c4e1c9aa2a277fb44f5a9 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:09.995435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993abe9-886c-4a1c-bbc7-6c3ef7b2483b None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:09.996024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993abe9-886c-4a1c-bbc7-6c3ef7b2483b None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:09.996024 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993abe9-886c-4a1c-bbc7-6c3ef7b2483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:10.015569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-2993abe9-886c-4a1c-bbc7-6c3ef7b2483b None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:10.016971 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2993abe9-886c-4a1c-bbc7-6c3ef7b2483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:10.077988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1395/2838] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:10.087937 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:10.089508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:10.153794 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f38234-b8bf-4dd5-8220-546e8da7c747 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:10.157509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fc994-7189-4095-b4fa-8578d75f52da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:10.158119 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fc994-7189-4095-b4fa-8578d75f52da service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:10.158423 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fc994-7189-4095-b4fa-8578d75f52da service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:10.158693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fc994-7189-4095-b4fa-8578d75f52da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:10.167723 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fc994-7189-4095-b4fa-8578d75f52da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:10.169132 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fc994-7189-4095-b4fa-8578d75f52da service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:10.178818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1444/2839] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:10.625783 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993abe9-886c-4a1c-bbc7-6c3ef7b2483b None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:10.627231 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2993abe9-886c-4a1c-bbc7-6c3ef7b2483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:10.643565 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993abe9-886c-4a1c-bbc7-6c3ef7b2483b None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:10.646145 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:10.646834 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:10.647116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:10.647427 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] PATH_INFO: `/v3/projects/bc2b2111ef5947f18b5881da2dd8749a` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:10.648592 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2b2111ef5947f18b5881da2dd8749a)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:10.650569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:10.777218 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:10.786768 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2b2111ef5947f18b5881da2dd8749a', 'request_id': 'req-222738ab-6473-4422-ae32-c0519aedaf83'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:10.792913 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2b2111ef5947f18b5881da2dd8749a', 'request_id': 'req-222738ab-6473-4422-ae32-c0519aedaf83'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:10.799241 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2b2111ef5947f18b5881da2dd8749a', 'request_id': 'req-222738ab-6473-4422-ae32-c0519aedaf83'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:10.897903 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] The token cache is being invalidate because project bc2b2111ef5947f18b5881da2dd8749a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:21:10.898131 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:10.898827 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:10.900304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1396/2840] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:21:10 2022] DELETE /identity/v3/projects/bc2b2111ef5947f18b5881da2dd8749a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:10.904339 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fc994-7189-4095-b4fa-8578d75f52da service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:10.914766 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fc994-7189-4095-b4fa-8578d75f52da service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:10.974069 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:10.974732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:10.975036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:10.975307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] PATH_INFO: `/v3/users/6aa1084cca2847cbb845921bfc5c82cb` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:10.976404 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa1084cca2847cbb845921bfc5c82cb)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:10.978338 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:11.184797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa1084cca2847cbb845921bfc5c82cb'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:11.185615 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa1084cca2847cbb845921bfc5c82cb'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:11.195031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa1084cca2847cbb845921bfc5c82cb'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:11.208290 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa1084cca2847cbb845921bfc5c82cb'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:11.209097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-85f5a2cd-5731-4fc7-805b-d05418b8740e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa1084cca2847cbb845921bfc5c82cb'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:11.333701 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1445/2841] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:21:10 2022] DELETE /identity/v3/users/6aa1084cca2847cbb845921bfc5c82cb => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:11.991249 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:11.992684 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:12.006533 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222738ab-6473-4422-ae32-c0519aedaf83 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:12.069207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:12.069851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:12.070131 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:12.070435 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] PATH_INFO: `/v3/projects/453b415f6aec436e859a190a3bf6ad3c` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:12.071597 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] RBAC: Authorizing `identity:delete_project(project_id=453b415f6aec436e859a190a3bf6ad3c)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:12.073503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:12.191566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453b415f6aec436e859a190a3bf6ad3c', 'request_id': 'req-f85476af-e0e5-4660-a45c-f2fa6cd4482b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:12.197744 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453b415f6aec436e859a190a3bf6ad3c', 'request_id': 'req-f85476af-e0e5-4660-a45c-f2fa6cd4482b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:12.203549 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453b415f6aec436e859a190a3bf6ad3c', 'request_id': 'req-f85476af-e0e5-4660-a45c-f2fa6cd4482b'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:12.309664 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] The token cache is being invalidate because project 453b415f6aec436e859a190a3bf6ad3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:21:12.309880 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:12.310541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-f85476af-e0e5-4660-a45c-f2fa6cd4482b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:12.312378 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1397/2842] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:21:11 2022] DELETE /identity/v3/projects/453b415f6aec436e859a190a3bf6ad3c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:12.319153 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc054-e496-4ecc-be8b-dfb64e1c31e9 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:12.319629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc054-e496-4ecc-be8b-dfb64e1c31e9 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:12.319629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc054-e496-4ecc-be8b-dfb64e1c31e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:12.340294 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-c3fbc054-e496-4ecc-be8b-dfb64e1c31e9 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:12.341539 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-c3fbc054-e496-4ecc-be8b-dfb64e1c31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:12.354989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:12.402824 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1446/2843] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:12.410970 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031145bf-1655-4a7d-8d03-5a5f08addf72 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:12.411300 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031145bf-1655-4a7d-8d03-5a5f08addf72 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:12.411577 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031145bf-1655-4a7d-8d03-5a5f08addf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:12.432789 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-031145bf-1655-4a7d-8d03-5a5f08addf72 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:12.434020 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-031145bf-1655-4a7d-8d03-5a5f08addf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:12.442727 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1398/2844] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:12.447307 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc054-e496-4ecc-be8b-dfb64e1c31e9 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:12.457587 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc054-e496-4ecc-be8b-dfb64e1c31e9 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:12.462193 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a464b-5c50-41ec-9581-acd689b0f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:12.463036 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a464b-5c50-41ec-9581-acd689b0f7dd admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:12.463318 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a464b-5c50-41ec-9581-acd689b0f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:12.463636 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a464b-5c50-41ec-9581-acd689b0f7dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:12.464284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a464b-5c50-41ec-9581-acd689b0f7dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:21:12.464588 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a464b-5c50-41ec-9581-acd689b0f7dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:12.466179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a464b-5c50-41ec-9581-acd689b0f7dd admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:12.478391 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1447/2845] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:21:12.482887 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031145bf-1655-4a7d-8d03-5a5f08addf72 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:12.492749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031145bf-1655-4a7d-8d03-5a5f08addf72 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:12.497620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0282752-3a8c-45c1-b2dc-31c709378a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:12.498396 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0282752-3a8c-45c1-b2dc-31c709378a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:12.498798 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0282752-3a8c-45c1-b2dc-31c709378a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:12.499131 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0282752-3a8c-45c1-b2dc-31c709378a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:12.499947 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0282752-3a8c-45c1-b2dc-31c709378a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:12.502333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0282752-3a8c-45c1-b2dc-31c709378a0f admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:12.620541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1399/2846] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:21:12 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:12.624834 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a464b-5c50-41ec-9581-acd689b0f7dd admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:12.635089 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a464b-5c50-41ec-9581-acd689b0f7dd admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:12.694262 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7c412-22ba-48c4-99d3-4377aa737350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:12.694877 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c412-22ba-48c4-99d3-4377aa737350 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:12.695160 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c412-22ba-48c4-99d3-4377aa737350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:12.695436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c412-22ba-48c4-99d3-4377aa737350 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:12.696082 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7c412-22ba-48c4-99d3-4377aa737350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:12.697996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7c412-22ba-48c4-99d3-4377aa737350 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:12.775494 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1448/2847] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:21:12 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:12.777679 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0282752-3a8c-45c1-b2dc-31c709378a0f admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:12.789389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0282752-3a8c-45c1-b2dc-31c709378a0f admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:12.794585 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639f395-bb1b-4e81-aa4e-905f093633c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:12.795203 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639f395-bb1b-4e81-aa4e-905f093633c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:12.795483 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639f395-bb1b-4e81-aa4e-905f093633c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:12.795754 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639f395-bb1b-4e81-aa4e-905f093633c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:12.796593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639f395-bb1b-4e81-aa4e-905f093633c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:12.798507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639f395-bb1b-4e81-aa4e-905f093633c1 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:12.810122 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1400/2848] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:21:12.814382 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7c412-22ba-48c4-99d3-4377aa737350 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:12.824818 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7c412-22ba-48c4-99d3-4377aa737350 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:12.829878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e85ea-6467-470b-85cf-ad52585ea59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:12.830496 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e85ea-6467-470b-85cf-ad52585ea59f admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:12.830773 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e85ea-6467-470b-85cf-ad52585ea59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:12.831044 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e85ea-6467-470b-85cf-ad52585ea59f admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:12.831682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e85ea-6467-470b-85cf-ad52585ea59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:12.833250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e85ea-6467-470b-85cf-ad52585ea59f admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:12.844432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1449/2849] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:12.848518 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639f395-bb1b-4e81-aa4e-905f093633c1 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:12.859681 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639f395-bb1b-4e81-aa4e-905f093633c1 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:12.864338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b7893-636e-44a4-bcba-e027edd9a212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:12.864989 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b7893-636e-44a4-bcba-e027edd9a212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:12.865272 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b7893-636e-44a4-bcba-e027edd9a212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:12.865547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b7893-636e-44a4-bcba-e027edd9a212 admin admin] PATH_INFO: `/v3/projects/2cf32efdf6a6448992aa6145c58b563d/users/3e5dc1ca82184cf28c0541083cda2858/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:12.878816 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:12.881902 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b7893-636e-44a4-bcba-e027edd9a212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf32efdf6a6448992aa6145c58b563d, user_id=3e5dc1ca82184cf28c0541083cda2858, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:12.884647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b7893-636e-44a4-bcba-e027edd9a212 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:12.961473 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1401/2850] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:21:12 2022] PUT /identity/v3/projects/2cf32efdf6a6448992aa6145c58b563d/users/3e5dc1ca82184cf28c0541083cda2858/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:21:12.971568 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac54f6-e1b3-47ab-ae10-6d679fe78347 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:12.971889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac54f6-e1b3-47ab-ae10-6d679fe78347 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:12.972165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac54f6-e1b3-47ab-ae10-6d679fe78347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:13.002291 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-b5ac54f6-e1b3-47ab-ae10-6d679fe78347 None None] MFA Rules not processed for user `3e5dc1ca82184cf28c0541083cda2858`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:13.006843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-b5ac54f6-e1b3-47ab-ae10-6d679fe78347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:13.067431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1450/2851] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:13.072981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b7893-636e-44a4-bcba-e027edd9a212 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:13.136634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b7893-636e-44a4-bcba-e027edd9a212 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:13.142073 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b8660-9a61-4534-9f91-0cfe56088925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:13.142709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8660-9a61-4534-9f91-0cfe56088925 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:13.142988 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8660-9a61-4534-9f91-0cfe56088925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:13.143280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8660-9a61-4534-9f91-0cfe56088925 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:13.143935 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b8660-9a61-4534-9f91-0cfe56088925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:13.145822 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b8660-9a61-4534-9f91-0cfe56088925 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:13.357712 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1402/2852] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:21:13 2022] POST /identity/v3/projects => generated 365 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:13.362432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac54f6-e1b3-47ab-ae10-6d679fe78347 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:13.373357 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac54f6-e1b3-47ab-ae10-6d679fe78347 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:13.382711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:13.429475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73656bc9-366c-4115-9278-9cc4eae53e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:13.430225 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73656bc9-366c-4115-9278-9cc4eae53e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:13.430634 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73656bc9-366c-4115-9278-9cc4eae53e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:13.431020 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73656bc9-366c-4115-9278-9cc4eae53e1c admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:13.431789 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73656bc9-366c-4115-9278-9cc4eae53e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:13.434003 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73656bc9-366c-4115-9278-9cc4eae53e1c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:13.579582 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1451/2853] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:21:13 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:13.583620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b8660-9a61-4534-9f91-0cfe56088925 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:13.594659 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b8660-9a61-4534-9f91-0cfe56088925 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:13.601569 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3da7fb-1317-4fb8-97b9-6d37b9dc6b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:13.602185 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3da7fb-1317-4fb8-97b9-6d37b9dc6b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:13.602496 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3da7fb-1317-4fb8-97b9-6d37b9dc6b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:13.602762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3da7fb-1317-4fb8-97b9-6d37b9dc6b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:13.603413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3da7fb-1317-4fb8-97b9-6d37b9dc6b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:13.605082 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3da7fb-1317-4fb8-97b9-6d37b9dc6b1b admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:13.619064 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1403/2854] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:13.629993 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73656bc9-366c-4115-9278-9cc4eae53e1c admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:13.640347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73656bc9-366c-4115-9278-9cc4eae53e1c admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:13.645138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8dd09-d20a-4391-8554-cb652fc35eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:13.645905 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8dd09-d20a-4391-8554-cb652fc35eee admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:13.646284 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8dd09-d20a-4391-8554-cb652fc35eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:13.646631 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8dd09-d20a-4391-8554-cb652fc35eee admin admin] PATH_INFO: `/v3/projects/75d7c58a6668400da7ed09bb786c12a4/users/9a229fe309b44d549570207ad62eb381/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:13.662023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8dd09-d20a-4391-8554-cb652fc35eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d7c58a6668400da7ed09bb786c12a4, user_id=9a229fe309b44d549570207ad62eb381, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:13.664695 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8dd09-d20a-4391-8554-cb652fc35eee admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:13.733274 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1452/2855] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:21:13 2022] PUT /identity/v3/projects/75d7c58a6668400da7ed09bb786c12a4/users/9a229fe309b44d549570207ad62eb381/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:13.737749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3da7fb-1317-4fb8-97b9-6d37b9dc6b1b admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:13.747994 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3da7fb-1317-4fb8-97b9-6d37b9dc6b1b admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:13.805224 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd61cf-2cba-4e1b-88fc-bdc30cd38a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:13.805885 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd61cf-2cba-4e1b-88fc-bdc30cd38a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:13.806168 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd61cf-2cba-4e1b-88fc-bdc30cd38a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:13.806479 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd61cf-2cba-4e1b-88fc-bdc30cd38a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:13.807143 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd61cf-2cba-4e1b-88fc-bdc30cd38a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:13.808780 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd61cf-2cba-4e1b-88fc-bdc30cd38a8c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:13.819346 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1404/2856] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:13.823510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8dd09-d20a-4391-8554-cb652fc35eee admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:13.833767 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8dd09-d20a-4391-8554-cb652fc35eee admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:13.838411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7445e9-d165-4cdb-81e0-0a9c911cb549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:13.839066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7445e9-d165-4cdb-81e0-0a9c911cb549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:13.839347 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7445e9-d165-4cdb-81e0-0a9c911cb549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:13.839621 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7445e9-d165-4cdb-81e0-0a9c911cb549 admin admin] PATH_INFO: `/v3/projects/75d7c58a6668400da7ed09bb786c12a4/users/9a229fe309b44d549570207ad62eb381/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:13.841509 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7445e9-d165-4cdb-81e0-0a9c911cb549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d7c58a6668400da7ed09bb786c12a4, user_id=9a229fe309b44d549570207ad62eb381, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:13.844946 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7445e9-d165-4cdb-81e0-0a9c911cb549 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:13.855287 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1453/2857] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:21:13 2022] PUT /identity/v3/projects/75d7c58a6668400da7ed09bb786c12a4/users/9a229fe309b44d549570207ad62eb381/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:13.866894 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf7c93-a487-41c9-a174-4f3781e5a645 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:13.867312 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf7c93-a487-41c9-a174-4f3781e5a645 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:13.867457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf7c93-a487-41c9-a174-4f3781e5a645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:13.897474 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-fdbf7c93-a487-41c9-a174-4f3781e5a645 None None] MFA Rules not processed for user `9a229fe309b44d549570207ad62eb381`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:13.898733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-fdbf7c93-a487-41c9-a174-4f3781e5a645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:13.945153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:13.967487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1405/2858] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:13.981973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7445e9-d165-4cdb-81e0-0a9c911cb549 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:13.983813 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-fb7445e9-d165-4cdb-81e0-0a9c911cb549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:14.042151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7445e9-d165-4cdb-81e0-0a9c911cb549 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:14.046574 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c39e2-1564-4e22-9646-772bac0d2a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:14.047467 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c39e2-1564-4e22-9646-772bac0d2a3c service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:14.047749 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c39e2-1564-4e22-9646-772bac0d2a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:14.048066 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c39e2-1564-4e22-9646-772bac0d2a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:14.057564 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c39e2-1564-4e22-9646-772bac0d2a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:14.059152 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c39e2-1564-4e22-9646-772bac0d2a3c service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:14.071249 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1454/2859] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:14.291873 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf7c93-a487-41c9-a174-4f3781e5a645 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:14.302248 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf7c93-a487-41c9-a174-4f3781e5a645 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:14.305761 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9901a-202d-4733-aac0-9d5dc8b65d13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:14.306390 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9901a-202d-4733-aac0-9d5dc8b65d13 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:14.306667 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9901a-202d-4733-aac0-9d5dc8b65d13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:14.306931 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9901a-202d-4733-aac0-9d5dc8b65d13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:14.366750 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9901a-202d-4733-aac0-9d5dc8b65d13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:14.368213 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9901a-202d-4733-aac0-9d5dc8b65d13 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:14.378894 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1406/2860] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:21.073466 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c39e2-1564-4e22-9646-772bac0d2a3c service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:21.135031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c39e2-1564-4e22-9646-772bac0d2a3c service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:21.140175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:21.140882 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:21.141168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:21.141443 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] PATH_INFO: `/v3/users/3e5dc1ca82184cf28c0541083cda2858` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:21.142608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5dc1ca82184cf28c0541083cda2858)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:21.144523 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:21.154464 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:21.466683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5dc1ca82184cf28c0541083cda2858'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:21.467342 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5dc1ca82184cf28c0541083cda2858'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:21.474570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5dc1ca82184cf28c0541083cda2858'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:21.487557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5dc1ca82184cf28c0541083cda2858'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:21.488259 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5dc1ca82184cf28c0541083cda2858'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:21.672998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1455/2861] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:21:21 2022] DELETE /identity/v3/users/3e5dc1ca82184cf28c0541083cda2858 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:21.677841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f34026-06fb-4e71-84f0-bc29eb0cfd95 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:21.678338 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f34026-06fb-4e71-84f0-bc29eb0cfd95 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:21.678449 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f34026-06fb-4e71-84f0-bc29eb0cfd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:21.700112 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-83f34026-06fb-4e71-84f0-bc29eb0cfd95 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:21.701388 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-83f34026-06fb-4e71-84f0-bc29eb0cfd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:21.763881 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1407/2862] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:21.771973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:21.773402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:21.835313 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45720c3c-5e0e-49b8-80a2-c3a628771040 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:21.838910 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1611e-31dd-48ec-b53e-0ea6e7619ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:21.839521 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1611e-31dd-48ec-b53e-0ea6e7619ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:21.839803 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1611e-31dd-48ec-b53e-0ea6e7619ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:21.840077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1611e-31dd-48ec-b53e-0ea6e7619ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:21.849432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1611e-31dd-48ec-b53e-0ea6e7619ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:21.850911 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1611e-31dd-48ec-b53e-0ea6e7619ea0 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:21.861201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1456/2863] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:22.450843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f34026-06fb-4e71-84f0-bc29eb0cfd95 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:22.450843 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-83f34026-06fb-4e71-84f0-bc29eb0cfd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:22.463267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f34026-06fb-4e71-84f0-bc29eb0cfd95 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:22.470777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:22.473484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:22.473484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:22.473484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] PATH_INFO: `/v3/projects/2cf32efdf6a6448992aa6145c58b563d` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:22.475056 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf32efdf6a6448992aa6145c58b563d)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:22.478728 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:22.664297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf32efdf6a6448992aa6145c58b563d', 'request_id': 'req-fc321bc7-6237-4449-ac34-ecd68c81c0d4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:22.670399 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf32efdf6a6448992aa6145c58b563d', 'request_id': 'req-fc321bc7-6237-4449-ac34-ecd68c81c0d4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:22.676074 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf32efdf6a6448992aa6145c58b563d', 'request_id': 'req-fc321bc7-6237-4449-ac34-ecd68c81c0d4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:22.800523 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] The token cache is being invalidate because project 2cf32efdf6a6448992aa6145c58b563d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:21:22.801149 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:22.801347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:22.802921 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1408/2864] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:21:22 2022] DELETE /identity/v3/projects/2cf32efdf6a6448992aa6145c58b563d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:22.807125 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1611e-31dd-48ec-b53e-0ea6e7619ea0 service neutron] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:22.817663 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1611e-31dd-48ec-b53e-0ea6e7619ea0 service neutron] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:22.872861 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:22.873489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:22.874323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:22.874575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] PATH_INFO: `/v3/users/9a229fe309b44d549570207ad62eb381` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:22.875700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a229fe309b44d549570207ad62eb381)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:22.877614 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:23.094030 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:23.105918 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a229fe309b44d549570207ad62eb381'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:23.106649 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a229fe309b44d549570207ad62eb381'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:23.114279 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a229fe309b44d549570207ad62eb381'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:23.127005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a229fe309b44d549570207ad62eb381'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:23.127700 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-598fe00c-1ff1-455d-90a4-9062a554851c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a229fe309b44d549570207ad62eb381'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:23.229794 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1457/2865] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:21:22 2022] DELETE /identity/v3/users/9a229fe309b44d549570207ad62eb381 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:21:23.688008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:23.689463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:23.703698 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc321bc7-6237-4449-ac34-ecd68c81c0d4 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:23.709052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:23.762319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:23.762967 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:23.763234 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:23.763507 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] PATH_INFO: `/v3/projects/75d7c58a6668400da7ed09bb786c12a4` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:23.764649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d7c58a6668400da7ed09bb786c12a4)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:23.766749 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:23.950104 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d7c58a6668400da7ed09bb786c12a4', 'request_id': 'req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:23.958717 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d7c58a6668400da7ed09bb786c12a4', 'request_id': 'req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:23.966426 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d7c58a6668400da7ed09bb786c12a4', 'request_id': 'req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:24.052709 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] The token cache is being invalidate because project 75d7c58a6668400da7ed09bb786c12a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:21:24.053004 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:24.053626 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-45fb4f9b-4170-47c5-a971-3adb3b90b5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:24.055146 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1409/2866] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:21:23 2022] DELETE /identity/v3/projects/75d7c58a6668400da7ed09bb786c12a4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:24.060552 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537ecf-8c62-4eff-b6b5-78459fdf2710 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:24.064481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537ecf-8c62-4eff-b6b5-78459fdf2710 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:24.064481 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6537ecf-8c62-4eff-b6b5-78459fdf2710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:24.081603 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e6537ecf-8c62-4eff-b6b5-78459fdf2710 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:24.082828 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e6537ecf-8c62-4eff-b6b5-78459fdf2710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:24.142919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1458/2867] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:24.150529 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc99a5a-8415-4a10-b1c1-98c837e84a0a None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:24.150817 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc99a5a-8415-4a10-b1c1-98c837e84a0a None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:24.151092 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc99a5a-8415-4a10-b1c1-98c837e84a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:24.171432 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-bdc99a5a-8415-4a10-b1c1-98c837e84a0a None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:24.178904 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-bdc99a5a-8415-4a10-b1c1-98c837e84a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:24.180530 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1410/2868] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:24.184913 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6537ecf-8c62-4eff-b6b5-78459fdf2710 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:24.195783 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6537ecf-8c62-4eff-b6b5-78459fdf2710 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:24.200575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b95e4-c263-40ba-845c-d22f4ecda63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:24.201119 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b95e4-c263-40ba-845c-d22f4ecda63a admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:24.201402 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b95e4-c263-40ba-845c-d22f4ecda63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:24.201706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b95e4-c263-40ba-845c-d22f4ecda63a admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:24.202926 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b95e4-c263-40ba-845c-d22f4ecda63a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:21:24.203229 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b95e4-c263-40ba-845c-d22f4ecda63a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:24.204820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b95e4-c263-40ba-845c-d22f4ecda63a admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:24.216314 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1459/2869] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:21:24.221261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc99a5a-8415-4a10-b1c1-98c837e84a0a None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:24.231100 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc99a5a-8415-4a10-b1c1-98c837e84a0a None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:24.235800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce257cd7-df87-4417-9f5c-193d2ef8f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:24.236389 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257cd7-df87-4417-9f5c-193d2ef8f1ca admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:24.236662 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257cd7-df87-4417-9f5c-193d2ef8f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:24.236929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257cd7-df87-4417-9f5c-193d2ef8f1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:24.237546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce257cd7-df87-4417-9f5c-193d2ef8f1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:24.239455 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce257cd7-df87-4417-9f5c-193d2ef8f1ca admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:24.339344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1411/2870] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:21:24 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:24.343662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b95e4-c263-40ba-845c-d22f4ecda63a admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:24.353755 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b95e4-c263-40ba-845c-d22f4ecda63a admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:24.417116 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd47c8-6c9f-4ea2-be75-1584252089fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:24.417733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd47c8-6c9f-4ea2-be75-1584252089fa admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:24.418078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd47c8-6c9f-4ea2-be75-1584252089fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:24.418387 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd47c8-6c9f-4ea2-be75-1584252089fa admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:24.419029 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd47c8-6c9f-4ea2-be75-1584252089fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:24.421000 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd47c8-6c9f-4ea2-be75-1584252089fa admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:24.526966 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1460/2871] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:21:24 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:21:24.530938 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce257cd7-df87-4417-9f5c-193d2ef8f1ca admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:24.541224 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce257cd7-df87-4417-9f5c-193d2ef8f1ca admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:24.546669 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9c1c-b49b-40dc-add7-8e482ddbbea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:24.547263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9c1c-b49b-40dc-add7-8e482ddbbea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:24.547538 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9c1c-b49b-40dc-add7-8e482ddbbea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:24.547806 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9c1c-b49b-40dc-add7-8e482ddbbea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:24.548442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9c1c-b49b-40dc-add7-8e482ddbbea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:24.550019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9c1c-b49b-40dc-add7-8e482ddbbea7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:24.560516 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1412/2872] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:24.565077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd47c8-6c9f-4ea2-be75-1584252089fa admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:24.575344 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd47c8-6c9f-4ea2-be75-1584252089fa admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:24.580010 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a5f7a-afd5-4fa2-9c75-a53af99d2788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:24.580610 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a5f7a-afd5-4fa2-9c75-a53af99d2788 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:24.580896 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a5f7a-afd5-4fa2-9c75-a53af99d2788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:24.581175 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a5f7a-afd5-4fa2-9c75-a53af99d2788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:24.581837 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a5f7a-afd5-4fa2-9c75-a53af99d2788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:24.583435 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a5f7a-afd5-4fa2-9c75-a53af99d2788 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:24.594022 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1461/2873] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:24.598063 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9c1c-b49b-40dc-add7-8e482ddbbea7 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:24.608602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9c1c-b49b-40dc-add7-8e482ddbbea7 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:24.613326 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee13df4-e501-46a0-b0ce-35013327aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:24.613985 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee13df4-e501-46a0-b0ce-35013327aa6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:24.614303 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee13df4-e501-46a0-b0ce-35013327aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:24.614582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee13df4-e501-46a0-b0ce-35013327aa6c admin admin] PATH_INFO: `/v3/projects/b85b4f2e00f1471c952908c5ae646db7/users/0553efe5a3c140e8838196d2a1fc6574/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:24.630076 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee13df4-e501-46a0-b0ce-35013327aa6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85b4f2e00f1471c952908c5ae646db7, user_id=0553efe5a3c140e8838196d2a1fc6574, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:24.632756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee13df4-e501-46a0-b0ce-35013327aa6c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:24.709316 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1413/2874] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:21:24 2022] PUT /identity/v3/projects/b85b4f2e00f1471c952908c5ae646db7/users/0553efe5a3c140e8838196d2a1fc6574/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:24.719571 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d9546-efd5-4e8a-ae0b-58f6261da551 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:24.720019 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d9546-efd5-4e8a-ae0b-58f6261da551 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:24.720144 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d9546-efd5-4e8a-ae0b-58f6261da551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:24.748077 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-3d1d9546-efd5-4e8a-ae0b-58f6261da551 None None] MFA Rules not processed for user `0553efe5a3c140e8838196d2a1fc6574`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:24.749878 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-3d1d9546-efd5-4e8a-ae0b-58f6261da551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:24.753891 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:24.815065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1462/2875] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:24.819741 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee13df4-e501-46a0-b0ce-35013327aa6c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:24.857844 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:24.880558 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee13df4-e501-46a0-b0ce-35013327aa6c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:24.885177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559f3a7-6e54-4001-b5d6-d41b133bedc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:24.885792 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559f3a7-6e54-4001-b5d6-d41b133bedc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:24.886065 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559f3a7-6e54-4001-b5d6-d41b133bedc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:24.886376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559f3a7-6e54-4001-b5d6-d41b133bedc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:24.887006 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559f3a7-6e54-4001-b5d6-d41b133bedc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:24.888901 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559f3a7-6e54-4001-b5d6-d41b133bedc6 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:24.972433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1414/2876] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:21:24 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:24.973512 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d9546-efd5-4e8a-ae0b-58f6261da551 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:24.985263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d9546-efd5-4e8a-ae0b-58f6261da551 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:25.051151 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bafef-8319-424c-94db-4fb58c94b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:25.051765 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bafef-8319-424c-94db-4fb58c94b9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:25.052052 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bafef-8319-424c-94db-4fb58c94b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:25.052329 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bafef-8319-424c-94db-4fb58c94b9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:25.052962 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bafef-8319-424c-94db-4fb58c94b9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:25.054956 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bafef-8319-424c-94db-4fb58c94b9e2 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:25.132247 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1463/2877] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:21:24 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:21:25.136297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559f3a7-6e54-4001-b5d6-d41b133bedc6 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:25.147267 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559f3a7-6e54-4001-b5d6-d41b133bedc6 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:25.152141 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47a6a6-ec74-45a6-a07a-98e8a79e8209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:25.152740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47a6a6-ec74-45a6-a07a-98e8a79e8209 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:25.153023 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47a6a6-ec74-45a6-a07a-98e8a79e8209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:25.153297 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47a6a6-ec74-45a6-a07a-98e8a79e8209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:25.153941 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47a6a6-ec74-45a6-a07a-98e8a79e8209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:25.156469 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47a6a6-ec74-45a6-a07a-98e8a79e8209 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:25.166325 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1415/2878] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:25.170285 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bafef-8319-424c-94db-4fb58c94b9e2 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:25.180742 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bafef-8319-424c-94db-4fb58c94b9e2 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:25.185346 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b074b-f3cd-44e2-999e-349be51c875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:25.185941 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b074b-f3cd-44e2-999e-349be51c875b admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:25.186396 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b074b-f3cd-44e2-999e-349be51c875b admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:25.186676 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b074b-f3cd-44e2-999e-349be51c875b admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:25.187319 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b074b-f3cd-44e2-999e-349be51c875b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:25.188912 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b074b-f3cd-44e2-999e-349be51c875b admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:25.199097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1464/2879] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:25.203333 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47a6a6-ec74-45a6-a07a-98e8a79e8209 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:25.213395 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47a6a6-ec74-45a6-a07a-98e8a79e8209 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:25.218896 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b97461-9de1-4b49-be07-4323c6aa9872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:25.219542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b97461-9de1-4b49-be07-4323c6aa9872 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:25.219820 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b97461-9de1-4b49-be07-4323c6aa9872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:25.220095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b97461-9de1-4b49-be07-4323c6aa9872 admin admin] PATH_INFO: `/v3/projects/2cf51ad3ba29498884cc9012080d23c5/users/34b631896a174f21b0fc7c62ec556bc4/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:25.235219 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b97461-9de1-4b49-be07-4323c6aa9872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf51ad3ba29498884cc9012080d23c5, user_id=34b631896a174f21b0fc7c62ec556bc4, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:25.237859 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b97461-9de1-4b49-be07-4323c6aa9872 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:25.299940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1416/2880] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:21:25 2022] PUT /identity/v3/projects/2cf51ad3ba29498884cc9012080d23c5/users/34b631896a174f21b0fc7c62ec556bc4/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:25.311444 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046e4bc-7edc-4e10-9e24-8fb940893414 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:25.311741 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046e4bc-7edc-4e10-9e24-8fb940893414 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:25.312013 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046e4bc-7edc-4e10-9e24-8fb940893414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:25.341971 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-9046e4bc-7edc-4e10-9e24-8fb940893414 None None] MFA Rules not processed for user `34b631896a174f21b0fc7c62ec556bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:25.343906 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9046e4bc-7edc-4e10-9e24-8fb940893414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:25.410457 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1465/2881] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:25.415085 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b97461-9de1-4b49-be07-4323c6aa9872 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:25.477634 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b97461-9de1-4b49-be07-4323c6aa9872 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:25.482396 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f2375-ec64-4a50-96c6-d209b23cad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:25.483359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f2375-ec64-4a50-96c6-d209b23cad04 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:25.483638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f2375-ec64-4a50-96c6-d209b23cad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:25.483909 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f2375-ec64-4a50-96c6-d209b23cad04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:25.484547 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f2375-ec64-4a50-96c6-d209b23cad04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:25.486608 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f2375-ec64-4a50-96c6-d209b23cad04 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:25.608044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1417/2882] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:21:25 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:25.612233 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046e4bc-7edc-4e10-9e24-8fb940893414 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:25.623204 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046e4bc-7edc-4e10-9e24-8fb940893414 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:25.632012 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:25.679617 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c3f2-3d66-491d-9ba7-834c521c5e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:25.680068 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c3f2-3d66-491d-9ba7-834c521c5e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:25.680411 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c3f2-3d66-491d-9ba7-834c521c5e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:25.680626 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c3f2-3d66-491d-9ba7-834c521c5e62 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:25.681255 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969c3f2-3d66-491d-9ba7-834c521c5e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:25.683211 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969c3f2-3d66-491d-9ba7-834c521c5e62 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:25.807115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1466/2883] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:21:25 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:25.811773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f2375-ec64-4a50-96c6-d209b23cad04 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:25.822437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f2375-ec64-4a50-96c6-d209b23cad04 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:25.827632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfad38-4ddc-4d64-864f-008bbd94c94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:25.828653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfad38-4ddc-4d64-864f-008bbd94c94a admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:25.828653 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfad38-4ddc-4d64-864f-008bbd94c94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:25.828918 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfad38-4ddc-4d64-864f-008bbd94c94a admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:25.829442 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfad38-4ddc-4d64-864f-008bbd94c94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:25.831110 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfad38-4ddc-4d64-864f-008bbd94c94a admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:25.841600 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1418/2884] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:25.846090 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c3f2-3d66-491d-9ba7-834c521c5e62 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:25.856131 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c3f2-3d66-491d-9ba7-834c521c5e62 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:25.861250 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb061ff-f63e-433c-92eb-a79a7c735cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:25.861898 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb061ff-f63e-433c-92eb-a79a7c735cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:25.862176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb061ff-f63e-433c-92eb-a79a7c735cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:25.862484 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb061ff-f63e-433c-92eb-a79a7c735cc2 admin admin] PATH_INFO: `/v3/projects/4597ea975e754e7d81c628e403840d18/users/02d9612302b541e088e15c8c40d3f1d3/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:25.880845 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb061ff-f63e-433c-92eb-a79a7c735cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4597ea975e754e7d81c628e403840d18, user_id=02d9612302b541e088e15c8c40d3f1d3, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:25.884791 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb061ff-f63e-433c-92eb-a79a7c735cc2 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:25.973508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1467/2885] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:21:25 2022] PUT /identity/v3/projects/4597ea975e754e7d81c628e403840d18/users/02d9612302b541e088e15c8c40d3f1d3/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:25.977364 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfad38-4ddc-4d64-864f-008bbd94c94a admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:25.987793 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfad38-4ddc-4d64-864f-008bbd94c94a admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:26.061182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c4545-fe8e-452d-b2ff-1984d2fc1173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:26.062344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c4545-fe8e-452d-b2ff-1984d2fc1173 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:26.062790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c4545-fe8e-452d-b2ff-1984d2fc1173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:26.063057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c4545-fe8e-452d-b2ff-1984d2fc1173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:26.063715 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c4545-fe8e-452d-b2ff-1984d2fc1173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:26.065348 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c4545-fe8e-452d-b2ff-1984d2fc1173 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:26.067225 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:26.076966 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1419/2886] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:26.081417 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb061ff-f63e-433c-92eb-a79a7c735cc2 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:26.091803 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb061ff-f63e-433c-92eb-a79a7c735cc2 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:26.097503 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cf53d-2f26-4c3d-a7c6-99b686729a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:26.097682 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cf53d-2f26-4c3d-a7c6-99b686729a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:26.097903 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cf53d-2f26-4c3d-a7c6-99b686729a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:26.098275 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cf53d-2f26-4c3d-a7c6-99b686729a7d admin admin] PATH_INFO: `/v3/projects/4597ea975e754e7d81c628e403840d18/users/02d9612302b541e088e15c8c40d3f1d3/roles/57aefe4cb3b1409abaaf216f5107c0bf` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:26.101527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cf53d-2f26-4c3d-a7c6-99b686729a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4597ea975e754e7d81c628e403840d18, user_id=02d9612302b541e088e15c8c40d3f1d3, role_id=57aefe4cb3b1409abaaf216f5107c0bf)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:26.104242 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cf53d-2f26-4c3d-a7c6-99b686729a7d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:26.116051 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1468/2887] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:21:26 2022] PUT /identity/v3/projects/4597ea975e754e7d81c628e403840d18/users/02d9612302b541e088e15c8c40d3f1d3/roles/57aefe4cb3b1409abaaf216f5107c0bf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:26.126914 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dfc9b-b0ab-41cf-a326-d2422cde1b36 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:26.127278 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dfc9b-b0ab-41cf-a326-d2422cde1b36 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:26.127630 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dfc9b-b0ab-41cf-a326-d2422cde1b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:26.156729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-8f1dfc9b-b0ab-41cf-a326-d2422cde1b36 None None] MFA Rules not processed for user `02d9612302b541e088e15c8c40d3f1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:26.161778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-8f1dfc9b-b0ab-41cf-a326-d2422cde1b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:26.228675 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1420/2888] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:26.240810 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cf53d-2f26-4c3d-a7c6-99b686729a7d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:26.242684 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-103cf53d-2f26-4c3d-a7c6-99b686729a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:26.301167 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cf53d-2f26-4c3d-a7c6-99b686729a7d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:26.304885 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2014-9ce4-4f46-ab9c-7690739a6af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:26.305495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2014-9ce4-4f46-ab9c-7690739a6af7 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:26.305779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2014-9ce4-4f46-ab9c-7690739a6af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:26.306053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2014-9ce4-4f46-ab9c-7690739a6af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:26.362775 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2014-9ce4-4f46-ab9c-7690739a6af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:26.364408 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2014-9ce4-4f46-ab9c-7690739a6af7 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:26.373148 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1469/2889] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:28.596039 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dfc9b-b0ab-41cf-a326-d2422cde1b36 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:28.605850 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dfc9b-b0ab-41cf-a326-d2422cde1b36 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:28.609650 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ef232-81a2-44ad-9872-ec1ae94f32e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:28.610305 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ef232-81a2-44ad-9872-ec1ae94f32e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:28.612484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ef232-81a2-44ad-9872-ec1ae94f32e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:28.612484 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ef232-81a2-44ad-9872-ec1ae94f32e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:28.672490 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ef232-81a2-44ad-9872-ec1ae94f32e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:28.673948 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ef232-81a2-44ad-9872-ec1ae94f32e2 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:28.683638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1421/2890] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:30.626581 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2014-9ce4-4f46-ab9c-7690739a6af7 service cinder] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:30.635483 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2014-9ce4-4f46-ab9c-7690739a6af7 service cinder] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:30.639138 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed68b5-e401-4204-b1d3-1c8d29a72a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:30.639978 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed68b5-e401-4204-b1d3-1c8d29a72a08 service cinder] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:30.640256 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed68b5-e401-4204-b1d3-1c8d29a72a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:30.640532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed68b5-e401-4204-b1d3-1c8d29a72a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:30.649743 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed68b5-e401-4204-b1d3-1c8d29a72a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:30.651243 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed68b5-e401-4204-b1d3-1c8d29a72a08 service cinder] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:30.661176 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1470/2891] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:34.972306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ef232-81a2-44ad-9872-ec1ae94f32e2 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:34.973778 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-bb1ef232-81a2-44ad-9872-ec1ae94f32e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:35.038147 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ef232-81a2-44ad-9872-ec1ae94f32e2 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:35.042738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:35.043359 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:35.043641 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:35.043913 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] PATH_INFO: `/v3/users/a170f59c028942409ea0ccdb5aefebde` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:35.045612 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a170f59c028942409ea0ccdb5aefebde)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:35.047714 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:35.070810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:35.369845 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a170f59c028942409ea0ccdb5aefebde'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:35.377259 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a170f59c028942409ea0ccdb5aefebde'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:35.389694 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a170f59c028942409ea0ccdb5aefebde'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:35.515616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a170f59c028942409ea0ccdb5aefebde'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:35.516306 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a170f59c028942409ea0ccdb5aefebde'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:35.522883 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1422/2892] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:21:34 2022] DELETE /identity/v3/users/a170f59c028942409ea0ccdb5aefebde => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:35.528222 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ce547-f93d-47b1-a898-47e03b1af32e None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:35.528764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ce547-f93d-47b1-a898-47e03b1af32e None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:35.528764 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ce547-f93d-47b1-a898-47e03b1af32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:35.543165 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:35.551061 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2d9ce547-f93d-47b1-a898-47e03b1af32e None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:35.554008 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2d9ce547-f93d-47b1-a898-47e03b1af32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:35.612852 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1471/2893] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:35.623158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:35.624660 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:35.683956 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de492437-12b4-44b7-8b66-0d5d4a7771a7 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:35.687794 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe6c50-82e0-4f8b-9588-fd5e55022b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:35.688456 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6c50-82e0-4f8b-9588-fd5e55022b22 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:35.688734 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6c50-82e0-4f8b-9588-fd5e55022b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:35.689008 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6c50-82e0-4f8b-9588-fd5e55022b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:35.698697 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe6c50-82e0-4f8b-9588-fd5e55022b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:35.700167 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe6c50-82e0-4f8b-9588-fd5e55022b22 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:35.709964 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1423/2894] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:36.156031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ce547-f93d-47b1-a898-47e03b1af32e None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:36.156031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2d9ce547-f93d-47b1-a898-47e03b1af32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:36.165492 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ce547-f93d-47b1-a898-47e03b1af32e None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:36.170398 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:36.171095 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:36.171374 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:36.171638 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] PATH_INFO: `/v3/projects/a8f9f28576da48c38276481b06b40594` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:36.172769 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f9f28576da48c38276481b06b40594)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:36.174711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:36.344011 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f9f28576da48c38276481b06b40594', 'request_id': 'req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:36.400489 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f9f28576da48c38276481b06b40594', 'request_id': 'req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:36.407023 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f9f28576da48c38276481b06b40594', 'request_id': 'req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:36.417500 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] The token cache is being invalidate because project a8f9f28576da48c38276481b06b40594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:21:36.417795 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:36.418532 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:36.420016 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1472/2895] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:21:36 2022] DELETE /identity/v3/projects/a8f9f28576da48c38276481b06b40594 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:36.425298 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c421c-6eac-4a54-9410-f4a45003226c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:36.425790 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c421c-6eac-4a54-9410-f4a45003226c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:36.425911 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c421c-6eac-4a54-9410-f4a45003226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:36.446620 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b08c421c-6eac-4a54-9410-f4a45003226c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:36.449206 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b08c421c-6eac-4a54-9410-f4a45003226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:36.516851 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1424/2896] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:36.527780 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:36.528243 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea2e5-ab6d-4012-a513-54e38bca2750 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:36.528534 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea2e5-ab6d-4012-a513-54e38bca2750 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:36.528811 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea2e5-ab6d-4012-a513-54e38bca2750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:36.529263 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:36.542142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4e6ee-eec2-4ec1-851c-4e7989138dd7 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:36.548248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:36.548248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:36.548248 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:36.548629 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] PATH_INFO: `/v3/users/0553efe5a3c140e8838196d2a1fc6574` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:36.549740 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0553efe5a3c140e8838196d2a1fc6574)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:36.550012 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-ce3ea2e5-ab6d-4012-a513-54e38bca2750 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:36.551252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-ce3ea2e5-ab6d-4012-a513-54e38bca2750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:36.551722 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:36.559512 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1425/2897] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:36.564307 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea2e5-ab6d-4012-a513-54e38bca2750 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:36.579199 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea2e5-ab6d-4012-a513-54e38bca2750 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:36.584096 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6faa7e-17ef-4caa-95b7-b5024c0dbd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:36.586799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6faa7e-17ef-4caa-95b7-b5024c0dbd26 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:36.586799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6faa7e-17ef-4caa-95b7-b5024c0dbd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:36.586799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6faa7e-17ef-4caa-95b7-b5024c0dbd26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:36.586799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6faa7e-17ef-4caa-95b7-b5024c0dbd26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81557) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:21:36.586799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6faa7e-17ef-4caa-95b7-b5024c0dbd26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:36.587819 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6faa7e-17ef-4caa-95b7-b5024c0dbd26 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:36.599992 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1426/2898] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:21:36.604130 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6faa7e-17ef-4caa-95b7-b5024c0dbd26 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:36.614685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6faa7e-17ef-4caa-95b7-b5024c0dbd26 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:36.619415 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7a73e-226f-4dd7-9705-5f44c8105f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:36.620027 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7a73e-226f-4dd7-9705-5f44c8105f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:36.620308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7a73e-226f-4dd7-9705-5f44c8105f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:36.620582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7a73e-226f-4dd7-9705-5f44c8105f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:36.621207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7a73e-226f-4dd7-9705-5f44c8105f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:36.623207 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7a73e-226f-4dd7-9705-5f44c8105f69 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:36.779116 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:36.785396 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1427/2899] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:21:36 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:21:36.789467 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7a73e-226f-4dd7-9705-5f44c8105f69 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:36.832833 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0553efe5a3c140e8838196d2a1fc6574'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:36.833565 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0553efe5a3c140e8838196d2a1fc6574'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:36.841053 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0553efe5a3c140e8838196d2a1fc6574'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:36.855078 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0553efe5a3c140e8838196d2a1fc6574'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:36.855706 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-f1be0acb-2e35-4e1b-981f-c705a89556b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0553efe5a3c140e8838196d2a1fc6574'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:36.856414 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7a73e-226f-4dd7-9705-5f44c8105f69 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:36.862106 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f4fc-02f9-4f5b-9c94-08df417d7f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:36.862745 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f4fc-02f9-4f5b-9c94-08df417d7f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:36.863028 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f4fc-02f9-4f5b-9c94-08df417d7f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:36.863304 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f4fc-02f9-4f5b-9c94-08df417d7f66 admin admin] PATH_INFO: `/v3/users` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:36.863947 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385f4fc-02f9-4f5b-9c94-08df417d7f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:36.865879 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385f4fc-02f9-4f5b-9c94-08df417d7f66 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:37.092860 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1473/2900] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:21:36 2022] DELETE /identity/v3/users/0553efe5a3c140e8838196d2a1fc6574 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:37.097205 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0efec-a9d1-4fe2-93cd-2fdcc18b7fcc None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:37.097495 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0efec-a9d1-4fe2-93cd-2fdcc18b7fcc None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:37.097772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0efec-a9d1-4fe2-93cd-2fdcc18b7fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:37.110114 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:37.111075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1428/2901] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:21:36 2022] POST /identity/v3/users => generated 288 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:21:37.115296 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f4fc-02f9-4f5b-9c94-08df417d7f66 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:37.117022 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-7385f4fc-02f9-4f5b-9c94-08df417d7f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:37.119394 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-0ea0efec-a9d1-4fe2-93cd-2fdcc18b7fcc None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:37.120557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0ea0efec-a9d1-4fe2-93cd-2fdcc18b7fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:37.129195 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f4fc-02f9-4f5b-9c94-08df417d7f66 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:37.181567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1474/2902] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:21:37.192347 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39e3ce-146f-4f69-a309-f394fc8e9925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:37.192546 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0efec-a9d1-4fe2-93cd-2fdcc18b7fcc None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:37.193019 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39e3ce-146f-4f69-a309-f394fc8e9925 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:37.193308 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39e3ce-146f-4f69-a309-f394fc8e9925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:37.193582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39e3ce-146f-4f69-a309-f394fc8e9925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:37.193717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0ea0efec-a9d1-4fe2-93cd-2fdcc18b7fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:37.194261 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39e3ce-146f-4f69-a309-f394fc8e9925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:37.195863 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39e3ce-146f-4f69-a309-f394fc8e9925 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:37.206797 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1429/2903] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:21:37.211602 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39e3ce-146f-4f69-a309-f394fc8e9925 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:37.222604 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39e3ce-146f-4f69-a309-f394fc8e9925 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:37.227379 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3dfb6-9eb3-4ea7-b88c-169cc1f02ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:37.228030 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3dfb6-9eb3-4ea7-b88c-169cc1f02ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:37.228319 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3dfb6-9eb3-4ea7-b88c-169cc1f02ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:37.228588 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3dfb6-9eb3-4ea7-b88c-169cc1f02ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:37.229344 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3dfb6-9eb3-4ea7-b88c-169cc1f02ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:37.230981 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3dfb6-9eb3-4ea7-b88c-169cc1f02ef9 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:37.241837 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1430/2904] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:21:37.245922 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3dfb6-9eb3-4ea7-b88c-169cc1f02ef9 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:37.255671 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3dfb6-9eb3-4ea7-b88c-169cc1f02ef9 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:37.256097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0efec-a9d1-4fe2-93cd-2fdcc18b7fcc None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:37.259693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f9b17-52b9-4658-9fa5-cb6dc1911451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:37.260301 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f9b17-52b9-4658-9fa5-cb6dc1911451 service neutron] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:37.260540 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba2337-fd7c-4a35-838f-f0c9e9a16b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:37.260698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f9b17-52b9-4658-9fa5-cb6dc1911451 service neutron] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:37.260838 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f9b17-52b9-4658-9fa5-cb6dc1911451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:37.261177 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba2337-fd7c-4a35-838f-f0c9e9a16b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:37.261459 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba2337-fd7c-4a35-838f-f0c9e9a16b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:37.261740 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba2337-fd7c-4a35-838f-f0c9e9a16b8d admin admin] PATH_INFO: `/v3/projects/d0110a3680e2490ca7cf9ad35d674703/users/26d882470fb148a5b5d3df8132ea2e50/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:37.270688 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f9b17-52b9-4658-9fa5-cb6dc1911451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:37.272115 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f9b17-52b9-4658-9fa5-cb6dc1911451 service neutron] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:37.276437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba2337-fd7c-4a35-838f-f0c9e9a16b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0110a3680e2490ca7cf9ad35d674703, user_id=26d882470fb148a5b5d3df8132ea2e50, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:37.289052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba2337-fd7c-4a35-838f-f0c9e9a16b8d admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:37.289201 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1475/2905] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:21:37.418468 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1431/2906] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:21:37 2022] PUT /identity/v3/projects/d0110a3680e2490ca7cf9ad35d674703/users/26d882470fb148a5b5d3df8132ea2e50/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:21:37.429031 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae727a2-53e8-4976-bdf1-ce991b389b7f None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:37.429322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae727a2-53e8-4976-bdf1-ce991b389b7f None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:37.429600 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae727a2-53e8-4976-bdf1-ce991b389b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:37.458907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-2ae727a2-53e8-4976-bdf1-ce991b389b7f None None] MFA Rules not processed for user `26d882470fb148a5b5d3df8132ea2e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:37.460105 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2ae727a2-53e8-4976-bdf1-ce991b389b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:37.538608 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1476/2907] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:37.549331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba2337-fd7c-4a35-838f-f0c9e9a16b8d admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:37.551111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-feba2337-fd7c-4a35-838f-f0c9e9a16b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:37.614505 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba2337-fd7c-4a35-838f-f0c9e9a16b8d admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:37.618861 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c933e3-158c-4ddb-83e1-9bd271686484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c610ab76127b40429d8e9259446df49a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:37.619593 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c933e3-158c-4ddb-83e1-9bd271686484 service cinder] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:37.619942 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c933e3-158c-4ddb-83e1-9bd271686484 service cinder] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:37.621125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c933e3-158c-4ddb-83e1-9bd271686484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:37.626437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:37.630508 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c933e3-158c-4ddb-83e1-9bd271686484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:37.632095 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c933e3-158c-4ddb-83e1-9bd271686484 service cinder] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:37.641880 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1432/2908] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:37.791395 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae727a2-53e8-4976-bdf1-ce991b389b7f None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:37.793117 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-2ae727a2-53e8-4976-bdf1-ce991b389b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:37.837185 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:37.863665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae727a2-53e8-4976-bdf1-ce991b389b7f None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:37.868147 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:37.868781 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:37.869064 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:37.869343 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] PATH_INFO: `/v3/projects/b85b4f2e00f1471c952908c5ae646db7` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:37.870486 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85b4f2e00f1471c952908c5ae646db7)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:37.872389 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:38.013465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85b4f2e00f1471c952908c5ae646db7', 'request_id': 'req-ca8b06bd-fbc9-4eed-8286-10ea295f273d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:38.212178 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85b4f2e00f1471c952908c5ae646db7', 'request_id': 'req-ca8b06bd-fbc9-4eed-8286-10ea295f273d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:38.219188 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85b4f2e00f1471c952908c5ae646db7', 'request_id': 'req-ca8b06bd-fbc9-4eed-8286-10ea295f273d'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:38.229575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] The token cache is being invalidate because project b85b4f2e00f1471c952908c5ae646db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:21:38.229797 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:38.230461 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:38.232034 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1477/2909] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:21:37 2022] DELETE /identity/v3/projects/b85b4f2e00f1471c952908c5ae646db7 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:38.236544 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c933e3-158c-4ddb-83e1-9bd271686484 service cinder] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:38.247227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c933e3-158c-4ddb-83e1-9bd271686484 service cinder] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:38.303161 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:38.303777 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:38.304052 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:38.304327 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] PATH_INFO: `/v3/users/34b631896a174f21b0fc7c62ec556bc4` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:38.305428 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b631896a174f21b0fc7c62ec556bc4)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:38.307391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:38.558384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b631896a174f21b0fc7c62ec556bc4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:38.566685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b631896a174f21b0fc7c62ec556bc4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:38.581566 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b631896a174f21b0fc7c62ec556bc4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:38.658450 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b631896a174f21b0fc7c62ec556bc4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:38.659099 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b631896a174f21b0fc7c62ec556bc4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:38.665425 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1433/2910] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:21:38 2022] DELETE /identity/v3/users/34b631896a174f21b0fc7c62ec556bc4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:39.157168 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:39.158729 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:39.177894 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b06bd-fbc9-4eed-8286-10ea295f273d admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:39.236142 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:39.236772 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:39.237075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:39.237352 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] PATH_INFO: `/v3/projects/2cf51ad3ba29498884cc9012080d23c5` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:39.238522 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf51ad3ba29498884cc9012080d23c5)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:39.240540 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:39.378359 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf51ad3ba29498884cc9012080d23c5', 'request_id': 'req-d046f14c-cec9-4cf8-b805-d00cfab12077'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:39.458547 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf51ad3ba29498884cc9012080d23c5', 'request_id': 'req-d046f14c-cec9-4cf8-b805-d00cfab12077'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:39.465453 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf51ad3ba29498884cc9012080d23c5', 'request_id': 'req-d046f14c-cec9-4cf8-b805-d00cfab12077'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:39.470718 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:39.476689 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] The token cache is being invalidate because project 2cf51ad3ba29498884cc9012080d23c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:21:39.476982 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:39.477622 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-d046f14c-cec9-4cf8-b805-d00cfab12077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:39.479133 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1478/2911] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:21:39 2022] DELETE /identity/v3/projects/2cf51ad3ba29498884cc9012080d23c5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:39.483884 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:39.485949 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:39.498773 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204f0e1-fb2e-4f5a-b6bb-b6dc30342c6d admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:39.555775 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:39.556460 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:39.556738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:39.557009 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] PATH_INFO: `/v3/users/02d9612302b541e088e15c8c40d3f1d3` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:39.558191 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d9612302b541e088e15c8c40d3f1d3)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:39.560384 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:39.574332 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:39.663007 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11790c52-266c-4287-9b8c-0a736d471fd1 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:39.663292 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11790c52-266c-4287-9b8c-0a736d471fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:39.663570 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11790c52-266c-4287-9b8c-0a736d471fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:39.683413 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-11790c52-266c-4287-9b8c-0a736d471fd1 None None] MFA Rules not processed for user `26d882470fb148a5b5d3df8132ea2e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:39.684624 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-11790c52-266c-4287-9b8c-0a736d471fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:39.738953 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1479/2912] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:21:39.787440 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d9612302b541e088e15c8c40d3f1d3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:39.796541 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d9612302b541e088e15c8c40d3f1d3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:39.808570 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d9612302b541e088e15c8c40d3f1d3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:39.897819 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d9612302b541e088e15c8c40d3f1d3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:39.898485 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d9612302b541e088e15c8c40d3f1d3'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:39.905618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1434/2913] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:21:39 2022] DELETE /identity/v3/users/02d9612302b541e088e15c8c40d3f1d3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:40.314665 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11790c52-266c-4287-9b8c-0a736d471fd1 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:40.316431 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-11790c52-266c-4287-9b8c-0a736d471fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:40.390437 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11790c52-266c-4287-9b8c-0a736d471fd1 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:40.432376 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:40.433940 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:40.452690 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9687846-3c5a-46cd-b373-63e4e84c1dfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:40.453323 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9687846-3c5a-46cd-b373-63e4e84c1dfa service placement] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:40.453984 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9687846-3c5a-46cd-b373-63e4e84c1dfa service placement] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:40.453984 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9687846-3c5a-46cd-b373-63e4e84c1dfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:40.455711 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-f9687846-3c5a-46cd-b373-63e4e84c1dfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:40.468698 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9687846-3c5a-46cd-b373-63e4e84c1dfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:40.480875 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9687846-3c5a-46cd-b373-63e4e84c1dfa service placement] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:40.481021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1480/2914] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:21:40.508070 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b585d23-8e21-4588-8e2e-3ed717296a34 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:40.512799 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:40.513494 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:40.514596 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:40.515067 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] PATH_INFO: `/v3/projects/4597ea975e754e7d81c628e403840d18` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:40.516350 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4597ea975e754e7d81c628e403840d18)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:40.518374 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:40.653290 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4597ea975e754e7d81c628e403840d18', 'request_id': 'req-a149cae4-7bd5-4633-b70d-a955e2e4ff29'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:40.659575 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4597ea975e754e7d81c628e403840d18', 'request_id': 'req-a149cae4-7bd5-4633-b70d-a955e2e4ff29'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:40.665180 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4597ea975e754e7d81c628e403840d18', 'request_id': 'req-a149cae4-7bd5-4633-b70d-a955e2e4ff29'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:40.771356 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] The token cache is being invalidate because project 4597ea975e754e7d81c628e403840d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81557) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:21:40.771644 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:40.772279 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-a149cae4-7bd5-4633-b70d-a955e2e4ff29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:21:40.773772 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1435/2915] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:21:40 2022] DELETE /identity/v3/projects/4597ea975e754e7d81c628e403840d18 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:21:40.778752 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325b092-3605-461c-b49a-5a4683c96a05 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:40.779041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325b092-3605-461c-b49a-5a4683c96a05 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:40.779986 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325b092-3605-461c-b49a-5a4683c96a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:40.800831 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-7325b092-3605-461c-b49a-5a4683c96a05 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:40.802041 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-7325b092-3605-461c-b49a-5a4683c96a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:40.832005 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:40.862675 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1481/2916] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:40.871934 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab99dc-1c49-410b-8152-28b611e03a1c None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:40.872216 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab99dc-1c49-410b-8152-28b611e03a1c None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:40.872487 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab99dc-1c49-410b-8152-28b611e03a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:40.892766 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-6bab99dc-1c49-410b-8152-28b611e03a1c None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:40.893976 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6bab99dc-1c49-410b-8152-28b611e03a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:40.902582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1436/2917] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:40.907733 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325b092-3605-461c-b49a-5a4683c96a05 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:40.917470 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325b092-3605-461c-b49a-5a4683c96a05 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:40.922575 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2de836-334d-4c4f-8c73-285f71a3e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:40.923179 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de836-334d-4c4f-8c73-285f71a3e7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:40.923459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de836-334d-4c4f-8c73-285f71a3e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:40.923732 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de836-334d-4c4f-8c73-285f71a3e7c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:40.936628 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2de836-334d-4c4f-8c73-285f71a3e7c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81556) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:21:40.936914 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2de836-334d-4c4f-8c73-285f71a3e7c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:40.944223 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2de836-334d-4c4f-8c73-285f71a3e7c5 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:40.957322 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1482/2918] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Sep 14 12:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:21:40.961929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab99dc-1c49-410b-8152-28b611e03a1c None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:40.971673 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab99dc-1c49-410b-8152-28b611e03a1c None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:40.976582 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666603b1-53c5-40db-842c-08c7433d5c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:40.977188 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666603b1-53c5-40db-842c-08c7433d5c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:40.977476 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666603b1-53c5-40db-842c-08c7433d5c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:40.977733 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666603b1-53c5-40db-842c-08c7433d5c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:40.978408 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666603b1-53c5-40db-842c-08c7433d5c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:40.980302 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666603b1-53c5-40db-842c-08c7433d5c01 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:40.996093 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:41.122033 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1437/2919] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Sep 14 12:21:40 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:41.127015 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2de836-334d-4c4f-8c73-285f71a3e7c5 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:41.137406 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2de836-334d-4c4f-8c73-285f71a3e7c5 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:41.195186 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43305-47a7-489b-b0ba-bf7696772ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:41.195792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43305-47a7-489b-b0ba-bf7696772ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:41.196070 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43305-47a7-489b-b0ba-bf7696772ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:41.196340 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43305-47a7-489b-b0ba-bf7696772ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:41.196974 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f43305-47a7-489b-b0ba-bf7696772ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:41.198919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f43305-47a7-489b-b0ba-bf7696772ca8 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:41.387065 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1483/2920] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Sep 14 12:21:41 2022] POST /identity/v3/users => generated 285 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:21:41.392433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666603b1-53c5-40db-842c-08c7433d5c01 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:41.403461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666603b1-53c5-40db-842c-08c7433d5c01 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:41.409643 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8f37-244d-4dda-99a3-975af001c02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:41.410436 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8f37-244d-4dda-99a3-975af001c02c admin admin] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:41.422632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8f37-244d-4dda-99a3-975af001c02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:41.422632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8f37-244d-4dda-99a3-975af001c02c admin admin] PATH_INFO: `/v3/roles` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:41.422632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8f37-244d-4dda-99a3-975af001c02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:41.422632 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8f37-244d-4dda-99a3-975af001c02c admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:41.427756 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1438/2921] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:41.428792 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43305-47a7-489b-b0ba-bf7696772ca8 admin admin] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:41.439995 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43305-47a7-489b-b0ba-bf7696772ca8 admin admin] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:41.445399 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db1323-c580-41f0-b614-759066fc55aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:41.446021 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db1323-c580-41f0-b614-759066fc55aa admin admin] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:41.446478 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db1323-c580-41f0-b614-759066fc55aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:41.446758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db1323-c580-41f0-b614-759066fc55aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:41.447414 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db1323-c580-41f0-b614-759066fc55aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:41.449002 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db1323-c580-41f0-b614-759066fc55aa admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:41.464635 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1484/2922] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Sep 14 12:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:21:41.471685 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8f37-244d-4dda-99a3-975af001c02c admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:41.481725 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8f37-244d-4dda-99a3-975af001c02c admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:41.486629 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed066-705d-486b-a9d3-b27ed70ccda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:41.487295 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed066-705d-486b-a9d3-b27ed70ccda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:41.487886 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed066-705d-486b-a9d3-b27ed70ccda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:41.488214 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ed066-705d-486b-a9d3-b27ed70ccda7 admin admin] PATH_INFO: `/v3/projects/e1af3769c0f74ebdb8a16e8125c21f8d/users/da287631e49546f7af27a65bdfc7baa4/roles/5fb006eca1744bd592b59b08b23ef7f2` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:41.503840 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ed066-705d-486b-a9d3-b27ed70ccda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1af3769c0f74ebdb8a16e8125c21f8d, user_id=da287631e49546f7af27a65bdfc7baa4, role_id=5fb006eca1744bd592b59b08b23ef7f2)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:41.506552 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ed066-705d-486b-a9d3-b27ed70ccda7 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:41.677069 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1439/2923] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Sep 14 12:21:41 2022] PUT /identity/v3/projects/e1af3769c0f74ebdb8a16e8125c21f8d/users/da287631e49546f7af27a65bdfc7baa4/roles/5fb006eca1744bd592b59b08b23ef7f2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:21:41.687616 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1b46a-aeb0-43af-9639-ad78f3fccc81 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:41.687907 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1b46a-aeb0-43af-9639-ad78f3fccc81 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:41.688184 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1b46a-aeb0-43af-9639-ad78f3fccc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:41.716448 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-00f1b46a-aeb0-43af-9639-ad78f3fccc81 None None] MFA Rules not processed for user `da287631e49546f7af27a65bdfc7baa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:21:41.718557 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-00f1b46a-aeb0-43af-9639-ad78f3fccc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:41.783508 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1485/2924] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:21:41.795784 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed066-705d-486b-a9d3-b27ed70ccda7 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:41.797546 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-6e8ed066-705d-486b-a9d3-b27ed70ccda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:41.854720 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ed066-705d-486b-a9d3-b27ed70ccda7 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:41.858443 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ee6bf-5318-4522-8e99-2ba249429d53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47bdd5f0b3bc4c099c0d34b3b7c3f3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:41.859057 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ee6bf-5318-4522-8e99-2ba249429d53 service glance] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:41.859340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ee6bf-5318-4522-8e99-2ba249429d53 service glance] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:41.859616 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ee6bf-5318-4522-8e99-2ba249429d53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:41.867890 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ee6bf-5318-4522-8e99-2ba249429d53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:41.869331 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ee6bf-5318-4522-8e99-2ba249429d53 service glance] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:41.878636 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1440/2925] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:21:51.780472 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:51.874321 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:21:51.943594 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1b46a-aeb0-43af-9639-ad78f3fccc81 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:21:51.945100 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-00f1b46a-aeb0-43af-9639-ad78f3fccc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:52.020405 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1b46a-aeb0-43af-9639-ad78f3fccc81 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:21:52.026432 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ac0ee-1b35-4992-ae81-6787226d3334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8882a9f2764648be9bfe4606144660d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:21:52.027075 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ac0ee-1b35-4992-ae81-6787226d3334 service nova] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:21:52.027375 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ac0ee-1b35-4992-ae81-6787226d3334 service nova] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:21:52.027683 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ac0ee-1b35-4992-ae81-6787226d3334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:21:52.030381 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0c4ac0ee-1b35-4992-ae81-6787226d3334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:21:52.042994 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ac0ee-1b35-4992-ae81-6787226d3334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:21:52.044650 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ac0ee-1b35-4992-ae81-6787226d3334 service nova] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:21:52.056271 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1486/2926] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:21:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:22:00.834584 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74dc0-06db-420c-9994-603bf86eced1 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:00.835115 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74dc0-06db-420c-9994-603bf86eced1 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:00.835215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74dc0-06db-420c-9994-603bf86eced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:00.854810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-e3e74dc0-06db-420c-9994-603bf86eced1 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:22:00.856125 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e3e74dc0-06db-420c-9994-603bf86eced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:00.912900 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1441/2927] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:22:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:22:01.046471 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ac0ee-1b35-4992-ae81-6787226d3334 service nova] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:01.047890 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-0c4ac0ee-1b35-4992-ae81-6787226d3334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:01.132620 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ac0ee-1b35-4992-ae81-6787226d3334 service nova] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:01.137662 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6164-690e-4ea6-b128-6a6eab74826c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:01.139097 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6164-690e-4ea6-b128-6a6eab74826c service swift] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:01.139465 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6164-690e-4ea6-b128-6a6eab74826c service swift] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:01.139745 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6164-690e-4ea6-b128-6a6eab74826c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:01.162373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6164-690e-4ea6-b128-6a6eab74826c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:01.162373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6164-690e-4ea6-b128-6a6eab74826c service swift] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:01.162373 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1487/2928] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:22:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 12:22:02.145937 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861ec5-09c9-4a79-bf5d-21a0b28e1904 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:02.146431 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861ec5-09c9-4a79-bf5d-21a0b28e1904 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:02.146542 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861ec5-09c9-4a79-bf5d-21a0b28e1904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:02.166437 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-5d861ec5-09c9-4a79-bf5d-21a0b28e1904 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:22:02.167647 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-5d861ec5-09c9-4a79-bf5d-21a0b28e1904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:02.175257 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1442/2929] 10.222.0.77 () {58 vars in 967 bytes} [Wed Sep 14 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:22:02.188218 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6164-690e-4ea6-b128-6a6eab74826c service swift] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:02.199141 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6164-690e-4ea6-b128-6a6eab74826c service swift] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:02.204835 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd163-c3c5-4547-aa6c-fdb7948be8fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:02.205436 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd163-c3c5-4547-aa6c-fdb7948be8fd service swift] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:02.205720 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd163-c3c5-4547-aa6c-fdb7948be8fd service swift] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:02.205998 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd163-c3c5-4547-aa6c-fdb7948be8fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:02.214139 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdd163-c3c5-4547-aa6c-fdb7948be8fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:02.215819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdd163-c3c5-4547-aa6c-fdb7948be8fd service swift] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:02.224567 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1488/2930] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:22:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:22:02.999457 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8688d-cd4c-4c30-b6d3-c69f9402b087 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:02.999743 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8688d-cd4c-4c30-b6d3-c69f9402b087 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:03.000014 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8688d-cd4c-4c30-b6d3-c69f9402b087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:03.020413 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-b4e8688d-cd4c-4c30-b6d3-c69f9402b087 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:22:03.021692 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-b4e8688d-cd4c-4c30-b6d3-c69f9402b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:03.030503 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1443/2931] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Sep 14 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:22:03.042763 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd163-c3c5-4547-aa6c-fdb7948be8fd service swift] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:03.054843 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd163-c3c5-4547-aa6c-fdb7948be8fd service swift] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:03.060354 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35591d1f-cb83-4e6c-b539-e625ffc7b65d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:03.060965 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35591d1f-cb83-4e6c-b539-e625ffc7b65d service swift] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:03.061245 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35591d1f-cb83-4e6c-b539-e625ffc7b65d service swift] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:03.061515 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35591d1f-cb83-4e6c-b539-e625ffc7b65d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:03.074919 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35591d1f-cb83-4e6c-b539-e625ffc7b65d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:03.077510 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35591d1f-cb83-4e6c-b539-e625ffc7b65d service swift] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:03.086062 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1489/2932] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:22:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:22:03.670287 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026357df-a9ca-4c2c-9cab-f8a8f703b737 None None] REQUEST_METHOD: `POST` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:03.670759 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026357df-a9ca-4c2c-9cab-f8a8f703b737 None None] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:03.670857 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026357df-a9ca-4c2c-9cab-f8a8f703b737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:03.690111 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.auth.core [None req-026357df-a9ca-4c2c-9cab-f8a8f703b737 None None] MFA Rules not processed for user `5e2c84402fe040048c9f238ded4f549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81557) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:22:03.691589 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-026357df-a9ca-4c2c-9cab-f8a8f703b737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:03.698810 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1444/2933] 10.222.0.77 () {58 vars in 967 bytes} [Wed Sep 14 12:22:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:22:03.710558 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35591d1f-cb83-4e6c-b539-e625ffc7b65d service swift] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:03.721183 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35591d1f-cb83-4e6c-b539-e625ffc7b65d service swift] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:03.726145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88928d2-c2c3-4e90-9f60-ff0aeeb1666b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39b77396e6ec432e80f4d06bc09a8605', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:03.726717 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88928d2-c2c3-4e90-9f60-ff0aeeb1666b service swift] REQUEST_METHOD: `GET` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:03.726996 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88928d2-c2c3-4e90-9f60-ff0aeeb1666b service swift] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:03.727267 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88928d2-c2c3-4e90-9f60-ff0aeeb1666b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:03.735889 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88928d2-c2c3-4e90-9f60-ff0aeeb1666b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:03.737442 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88928d2-c2c3-4e90-9f60-ff0aeeb1666b service swift] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:03.745216 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1490/2934] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Sep 14 12:22:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:22:06.635002 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026357df-a9ca-4c2c-9cab-f8a8f703b737 None None] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:06.635769 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-026357df-a9ca-4c2c-9cab-f8a8f703b737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:06.706340 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026357df-a9ca-4c2c-9cab-f8a8f703b737 None None] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:06.710893 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:06.711519 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:06.711800 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:06.712075 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] PATH_INFO: `/v3/users/26d882470fb148a5b5d3df8132ea2e50` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:06.713209 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d882470fb148a5b5d3df8132ea2e50)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:06.715154 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:06.939299 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d882470fb148a5b5d3df8132ea2e50'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:06.946522 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d882470fb148a5b5d3df8132ea2e50'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:06.958729 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d882470fb148a5b5d3df8132ea2e50'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:07.068387 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d882470fb148a5b5d3df8132ea2e50'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:07.069000 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d882470fb148a5b5d3df8132ea2e50'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:07.075595 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1445/2935] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:22:06 2022] DELETE /identity/v3/users/26d882470fb148a5b5d3df8132ea2e50 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:22:07.080228 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68dc0c-3071-4019-af7f-e0cb2cd909b9 None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:07.080758 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68dc0c-3071-4019-af7f-e0cb2cd909b9 None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:07.080899 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68dc0c-3071-4019-af7f-e0cb2cd909b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:07.100735 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-ea68dc0c-3071-4019-af7f-e0cb2cd909b9 None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:22:07.101983 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ea68dc0c-3071-4019-af7f-e0cb2cd909b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:07.122659 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=100 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:07.163632 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1491/2936] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:22:07.173947 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:07.175391 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:07.181841 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:07.235353 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a48084-8acd-481d-beb2-e47272f5db42 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:07.239044 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94a41-97ef-4b94-99ee-91aa16a49886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:07.239652 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94a41-97ef-4b94-99ee-91aa16a49886 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:07.240433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94a41-97ef-4b94-99ee-91aa16a49886 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:07.240433 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94a41-97ef-4b94-99ee-91aa16a49886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:07.249228 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94a41-97ef-4b94-99ee-91aa16a49886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:07.250762 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94a41-97ef-4b94-99ee-91aa16a49886 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:07.260153 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1446/2937] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:22:07.556161 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68dc0c-3071-4019-af7f-e0cb2cd909b9 None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:07.560361 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-ea68dc0c-3071-4019-af7f-e0cb2cd909b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:07.571305 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68dc0c-3071-4019-af7f-e0cb2cd909b9 None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:07.576459 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:07.577103 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:07.577378 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:07.577647 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] PATH_INFO: `/v3/projects/d0110a3680e2490ca7cf9ad35d674703` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:07.578794 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0110a3680e2490ca7cf9ad35d674703)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:07.580693 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:07.710145 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0110a3680e2490ca7cf9ad35d674703', 'request_id': 'req-c1d1e5ac-f816-488c-9126-97fd985efe36'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:07.845955 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0110a3680e2490ca7cf9ad35d674703', 'request_id': 'req-c1d1e5ac-f816-488c-9126-97fd985efe36'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:07.852820 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0110a3680e2490ca7cf9ad35d674703', 'request_id': 'req-c1d1e5ac-f816-488c-9126-97fd985efe36'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:07.863206 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] The token cache is being invalidate because project d0110a3680e2490ca7cf9ad35d674703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:22:07.863497 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:07.868950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-c1d1e5ac-f816-488c-9126-97fd985efe36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:07.868950 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1492/2938] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:22:07 2022] DELETE /identity/v3/projects/d0110a3680e2490ca7cf9ad35d674703 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:22:08.049430 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94a41-97ef-4b94-99ee-91aa16a49886 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:08.051263 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-2fb94a41-97ef-4b94-99ee-91aa16a49886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:08.065803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94a41-97ef-4b94-99ee-91aa16a49886 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:08.126638 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:08.127182 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:08.127463 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:08.127738 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] PATH_INFO: `/v3/users/da287631e49546f7af27a65bdfc7baa4` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:08.128875 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da287631e49546f7af27a65bdfc7baa4)` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:08.130929 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:08.357227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da287631e49546f7af27a65bdfc7baa4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:08.364289 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da287631e49546f7af27a65bdfc7baa4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:08.381920 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da287631e49546f7af27a65bdfc7baa4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:08.457193 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da287631e49546f7af27a65bdfc7baa4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:08.457824 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.notifications [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da287631e49546f7af27a65bdfc7baa4'} {{(pid=81557) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:08.464011 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1447/2939] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Sep 14 12:22:08 2022] DELETE /identity/v3/users/da287631e49546f7af27a65bdfc7baa4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:22:08.469327 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce67c3-af1c-4b70-a81f-04836e44b3ec None None] REQUEST_METHOD: `POST` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:08.473989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce67c3-af1c-4b70-a81f-04836e44b3ec None None] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:08.473989 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce67c3-af1c-4b70-a81f-04836e44b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:08.489633 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.auth.core [None req-e1ce67c3-af1c-4b70-a81f-04836e44b3ec None None] MFA Rules not processed for user `4e56bee89b494082b820a81a258feb86`. Rule list: `[]` (Enabled: `True`). {{(pid=81556) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:22:08.490975 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e1ce67c3-af1c-4b70-a81f-04836e44b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:08.548750 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1493/2940] 10.222.0.77 () {58 vars in 958 bytes} [Wed Sep 14 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:22:08.558618 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:08.560280 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:08.591128 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:08.617803 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf3115-f7b6-4ad0-9daa-27da93851ff5 admin admin] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:08.621451 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210381db-22b3-4b02-837e-2a8e4845ffd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67880641bc954088bef0b601a8410f9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:08.622950 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210381db-22b3-4b02-837e-2a8e4845ffd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:08.623420 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210381db-22b3-4b02-837e-2a8e4845ffd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:08.624084 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210381db-22b3-4b02-837e-2a8e4845ffd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:08.634227 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210381db-22b3-4b02-837e-2a8e4845ffd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:08.634796 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210381db-22b3-4b02-837e-2a8e4845ffd3 service neutron] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:08.645648 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1448/2941] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:22:09.070001 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce67c3-af1c-4b70-a81f-04836e44b3ec None None] Authenticating user token {{(pid=81556) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:09.071475 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.fernet_utils [None req-e1ce67c3-af1c-4b70-a81f-04836e44b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81556) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:09.085762 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce67c3-af1c-4b70-a81f-04836e44b3ec None None] Validating token access rules against request {{(pid=81556) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:09.090650 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e56bee89b494082b820a81a258feb86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44214f6312fa43ec8a83e2996bf5a5af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81556) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:09.091819 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:09.092261 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:09.092550 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] PATH_INFO: `/v3/projects/e1af3769c0f74ebdb8a16e8125c21f8d` {{(pid=81556) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:09.093779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1af3769c0f74ebdb8a16e8125c21f8d)` {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:09.095779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] RBAC: Authorization granted {{(pid=81556) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:09.219851 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:09.223468 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1af3769c0f74ebdb8a16e8125c21f8d', 'request_id': 'req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:09.313976 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1af3769c0f74ebdb8a16e8125c21f8d', 'request_id': 'req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:09.320779 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1af3769c0f74ebdb8a16e8125c21f8d', 'request_id': 'req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4'} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:09.331973 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] The token cache is being invalidate because project e1af3769c0f74ebdb8a16e8125c21f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81556) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:22:09.332264 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:09.332895 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG keystone.notifications [None req-804c6327-f0b8-425a-b6ce-d333b0ce4bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81556) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:22:09.334390 dv-cinder-844962-2-smb devstack@keystone.service[81556]: [pid: 81556|app: 0|req: 1494/2942] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Sep 14 12:22:09 2022] DELETE /identity/v3/projects/e1af3769c0f74ebdb8a16e8125c21f8d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:22:18.685573 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=14 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:19.394527 dv-cinder-844962-2-smb devstack@keystone.service[81556]: DEBUG dbcounter [-] [81556] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81556) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:22:43.078649 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210381db-22b3-4b02-837e-2a8e4845ffd3 service neutron] Authenticating user token {{(pid=81557) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:22:43.080158 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-210381db-22b3-4b02-837e-2a8e4845ffd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:43.149461 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210381db-22b3-4b02-837e-2a8e4845ffd3 service neutron] Validating token access rules against request {{(pid=81557) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:22:43.210035 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c70baa-3fbe-4723-a7ca-a129feb7efb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877b59ec265f42e4bf8edbd9767e3319', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87de90a658c840a8ba257969f074ad67', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81557) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:22:43.210677 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c70baa-3fbe-4723-a7ca-a129feb7efb1 service placement] REQUEST_METHOD: `GET` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:22:43.210954 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c70baa-3fbe-4723-a7ca-a129feb7efb1 service placement] SCRIPT_NAME: `/identity` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:22:43.211252 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c70baa-3fbe-4723-a7ca-a129feb7efb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81557) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:22:43.212975 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.fernet_utils [None req-24c70baa-3fbe-4723-a7ca-a129feb7efb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81557) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:22:43.225235 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c70baa-3fbe-4723-a7ca-a129feb7efb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:22:43.226912 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c70baa-3fbe-4723-a7ca-a129feb7efb1 service placement] RBAC: Authorization granted {{(pid=81557) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:22:43.237448 dv-cinder-844962-2-smb devstack@keystone.service[81557]: [pid: 81557|app: 0|req: 1449/2943] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Sep 14 12:22:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:22:53.233215 dv-cinder-844962-2-smb devstack@keystone.service[81557]: DEBUG dbcounter [-] [81557] Writing DB stats keystone:SELECT=58 {{(pid=81557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}